[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:14.223660 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:39459
I20260709 12:08:14.225344 10697 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:14.226425 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.245842 10703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.245862 10704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.248287 10697 server_base.cc:1061] running on GCE node
W20260709 12:08:14.245867 10706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.463557 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:15.463815 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:15.464093 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598895464064 us; error 0 us; skew 500 ppm
I20260709 12:08:15.464986 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:15.471401 10697 webserver.cc:533] Webserver started at http://127.10.114.126:41285/ using document root <none> and password file <none>
I20260709 12:08:15.472363 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:15.472595 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:15.473109 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:15.479192 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "3b439a7ef2e845038216045156fe9f36"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-08l4"
I20260709 12:08:15.487813 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:15.493781 10712 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:15.495393 10697 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:08:15.495869 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "3b439a7ef2e845038216045156fe9f36"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-08l4"
I20260709 12:08:15.496263 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:15.555281 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:15.556908 10697 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:15.557408 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:15.637593 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:39459
I20260709 12:08:15.637786 10763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:39459 every 8 connection(s)
I20260709 12:08:15.648020 10764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.675441 10764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: Bootstrap starting.
I20260709 12:08:15.683172 10764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.685510 10764 log.cc:826] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:15.691551 10764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: No bootstrap required, opened a new log
I20260709 12:08:15.715471 10764 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER }
I20260709 12:08:15.716243 10764 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.716533 10764 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b439a7ef2e845038216045156fe9f36, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.717830 10764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER }
I20260709 12:08:15.718394 10764 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:15.718729 10764 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:15.719175 10764 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.723870 10764 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER }
I20260709 12:08:15.724764 10764 leader_election.cc:304] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b439a7ef2e845038216045156fe9f36; no voters: 
I20260709 12:08:15.726840 10764 leader_election.cc:290] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:15.727334 10767 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.729990 10767 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 1 LEADER]: Becoming Leader. State: Replica: 3b439a7ef2e845038216045156fe9f36, State: Running, Role: LEADER
I20260709 12:08:15.731178 10767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER }
I20260709 12:08:15.732249 10764 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:15.744391 10768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b439a7ef2e845038216045156fe9f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER } }
I20260709 12:08:15.745294 10768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:15.746632 10769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b439a7ef2e845038216045156fe9f36. Latest consensus state: current_term: 1 leader_uuid: "3b439a7ef2e845038216045156fe9f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b439a7ef2e845038216045156fe9f36" member_type: VOTER } }
I20260709 12:08:15.747351 10769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:15.749702 10776 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:15.764963 10776 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:15.767673 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:15.784579 10776 catalog_manager.cc:1383] Generated new cluster ID: 071c4fb2e45d416ca070116398e9b371
I20260709 12:08:15.784924 10776 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:15.806155 10776 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:15.808523 10776 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:15.843961 10776 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: Generated new TSK 0
I20260709 12:08:15.845175 10776 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:15.899331 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.909868 10786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.911780 10787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.915736 10789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.915908 10697 server_base.cc:1061] running on GCE node
I20260709 12:08:15.917089 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:15.917325 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:15.917470 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598895917458 us; error 0 us; skew 500 ppm
I20260709 12:08:15.918277 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:15.923679 10697 webserver.cc:533] Webserver started at http://127.10.114.65:41523/ using document root <none> and password file <none>
I20260709 12:08:15.924407 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:15.924633 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:15.924980 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:15.926754 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-08l4"
I20260709 12:08:15.933888 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:15.939357 10794 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:15.940357 10697 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:08:15.940696 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-08l4"
I20260709 12:08:15.941015 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:15.963421 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:15.965027 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:15.968338 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:15.973775 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:15.974021 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:15.974396 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:15.974566 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.094887 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:41859
I20260709 12:08:16.094951 10856 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:41859 every 8 connection(s)
I20260709 12:08:16.102660 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.121388 10861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.123345 10862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.130928 10697 server_base.cc:1061] running on GCE node
W20260709 12:08:16.132493 10864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.133852 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.134063 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.134218 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598896134207 us; error 0 us; skew 500 ppm
I20260709 12:08:16.134855 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.138132 10697 webserver.cc:533] Webserver started at http://127.10.114.66:41113/ using document root <none> and password file <none>
I20260709 12:08:16.138871 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.139147 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.139496 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.140985 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-08l4"
I20260709 12:08:16.144914 10857 heartbeater.cc:344] Connected to a master server at 127.10.114.126:39459
I20260709 12:08:16.145519 10857 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.146961 10857 heartbeater.cc:507] Master 127.10.114.126:39459 requested a full tablet report, sending...
I20260709 12:08:16.148031 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:08:16.151237 10729 ts_manager.cc:194] Registered new tserver with Master: c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859)
I20260709 12:08:16.153470 10869 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.154544 10697 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:08:16.154860 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-08l4"
I20260709 12:08:16.154884 10729 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49158
I20260709 12:08:16.155184 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.182998 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.184619 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.187644 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.190662 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.190881 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.191255 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.191463 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.303735 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:46527
I20260709 12:08:16.303875 10931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:46527 every 8 connection(s)
I20260709 12:08:16.311256 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.322569 10935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.323809 10936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.328385 10932 heartbeater.cc:344] Connected to a master server at 127.10.114.126:39459
I20260709 12:08:16.328927 10932 heartbeater.cc:461] Registering TS with master...
W20260709 12:08:16.330310 10938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.330467 10932 heartbeater.cc:507] Master 127.10.114.126:39459 requested a full tablet report, sending...
I20260709 12:08:16.330998 10697 server_base.cc:1061] running on GCE node
I20260709 12:08:16.332185 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.332464 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.332685 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598896332667 us; error 0 us; skew 500 ppm
I20260709 12:08:16.333021 10729 ts_manager.cc:194] Registered new tserver with Master: 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:16.333587 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.334770 10729 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49168
I20260709 12:08:16.337131 10697 webserver.cc:533] Webserver started at http://127.10.114.67:35381/ using document root <none> and password file <none>
I20260709 12:08:16.337878 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.338140 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.338497 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.340039 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "220eb6f412384577a13ceb7e0da3e276"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-08l4"
I20260709 12:08:16.346612 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:08:16.351212 10943 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.352327 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:08:16.352716 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "220eb6f412384577a13ceb7e0da3e276"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-08l4"
I20260709 12:08:16.353116 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.387526 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.389034 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.391106 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.394060 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.394249 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.394586 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.394737 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.499536 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:40841
I20260709 12:08:16.499673 11005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:40841 every 8 connection(s)
I20260709 12:08:16.520974 11006 heartbeater.cc:344] Connected to a master server at 127.10.114.126:39459
I20260709 12:08:16.521608 11006 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.522671 11006 heartbeater.cc:507] Master 127.10.114.126:39459 requested a full tablet report, sending...
I20260709 12:08:16.525331 10729 ts_manager.cc:194] Registered new tserver with Master: 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:16.526192 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0162835s
I20260709 12:08:16.527235 10729 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49176
I20260709 12:08:16.589113 10729 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49190:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:16.593346 10729 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:16.722586 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 4daf08722f5f410587f1d1c20abc32af (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.727573 10819 tablet_service.cc:1511] Processing CreateTablet for tablet 602fa54753274bc18748910d607c7020 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.728885 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 0e01df2247334a6eac7fe2210d4fc140 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.734014 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 0e01df2247334a6eac7fe2210d4fc140 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.724561 10822 tablet_service.cc:1511] Processing CreateTablet for tablet 4daf08722f5f410587f1d1c20abc32af (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.736035 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 602fa54753274bc18748910d607c7020 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.728962 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4928b55ae4a71a5cf968edbe1420c (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.735934 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4928b55ae4a71a5cf968edbe1420c (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.738826 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4daf08722f5f410587f1d1c20abc32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.734680 10818 tablet_service.cc:1511] Processing CreateTablet for tablet f85331ff4aa94022b9ff9c4905609c39 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.746594 10897 tablet_service.cc:1511] Processing CreateTablet for tablet 4daf08722f5f410587f1d1c20abc32af (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.746696 10893 tablet_service.cc:1511] Processing CreateTablet for tablet f85331ff4aa94022b9ff9c4905609c39 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.748266 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4daf08722f5f410587f1d1c20abc32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.742977 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e01df2247334a6eac7fe2210d4fc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.755079 10895 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4928b55ae4a71a5cf968edbe1420c (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.750222 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 602fa54753274bc18748910d607c7020 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.761904 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4928b55ae4a71a5cf968edbe1420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.763355 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85331ff4aa94022b9ff9c4905609c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.767406 10967 tablet_service.cc:1511] Processing CreateTablet for tablet f85331ff4aa94022b9ff9c4905609c39 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.768162 10896 tablet_service.cc:1511] Processing CreateTablet for tablet 0e01df2247334a6eac7fe2210d4fc140 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.765156 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4928b55ae4a71a5cf968edbe1420c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:16.774722 10777 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:16.777419 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e01df2247334a6eac7fe2210d4fc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.777463 10817 tablet_service.cc:1511] Processing CreateTablet for tablet fad1abb455aa44e2b2c97f9fba8db2b8 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.781648 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4928b55ae4a71a5cf968edbe1420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.779758 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4daf08722f5f410587f1d1c20abc32af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.781944 10892 tablet_service.cc:1511] Processing CreateTablet for tablet fad1abb455aa44e2b2c97f9fba8db2b8 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.784530 10966 tablet_service.cc:1511] Processing CreateTablet for tablet fad1abb455aa44e2b2c97f9fba8db2b8 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.789049 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602fa54753274bc18748910d607c7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.790392 10892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1abb455aa44e2b2c97f9fba8db2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.794881 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e01df2247334a6eac7fe2210d4fc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.797766 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602fa54753274bc18748910d607c7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.796581 10818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85331ff4aa94022b9ff9c4905609c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.799566 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1abb455aa44e2b2c97f9fba8db2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.799708 10817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1abb455aa44e2b2c97f9fba8db2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.801801 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85331ff4aa94022b9ff9c4905609c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.803656 10816 tablet_service.cc:1511] Processing CreateTablet for tablet f181afb6990548698f41b48407ff46eb (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.816018 10891 tablet_service.cc:1511] Processing CreateTablet for tablet f181afb6990548698f41b48407ff46eb (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.819550 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602fa54753274bc18748910d607c7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.830195 10816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f181afb6990548698f41b48407ff46eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.832563 10891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f181afb6990548698f41b48407ff46eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.853502 10965 tablet_service.cc:1511] Processing CreateTablet for tablet f181afb6990548698f41b48407ff46eb (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.854852 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f181afb6990548698f41b48407ff46eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.944041 10815 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.945482 10815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.995026 10890 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.996086 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3 (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.996850 10890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.004248 11024 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.002473 10814 tablet_service.cc:1511] Processing CreateTablet for tablet ffc1850d70994df18dec8ee1786684be (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.001881 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6cae4e5d6640dbaecd79f9a3e1f0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.008445 10814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc1850d70994df18dec8ee1786684be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.049082 10889 tablet_service.cc:1511] Processing CreateTablet for tablet ffc1850d70994df18dec8ee1786684be (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.051488 10889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc1850d70994df18dec8ee1786684be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.058436 11024 tablet_bootstrap.cc:654] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.092942 11025 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.095531 10964 tablet_service.cc:1511] Processing CreateTablet for tablet ffc1850d70994df18dec8ee1786684be (DEFAULT_TABLE table=test-workload [id=a275ba8a0c6f4d8b9ce893e60bff78f7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.097751 10964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc1850d70994df18dec8ee1786684be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.128330 11026 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.160005 10857 heartbeater.cc:499] Master 127.10.114.126:39459 was elected leader, sending a full tablet report...
I20260709 12:08:17.168586 11025 tablet_bootstrap.cc:654] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.186487 11026 tablet_bootstrap.cc:654] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.194422 11024 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.194964 11024 ts_tablet_manager.cc:1403] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.019s
I20260709 12:08:17.204540 11024 raft_consensus.cc:359] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.211808 11024 raft_consensus.cc:385] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.218390 11024 raft_consensus.cc:740] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.221302 11025 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.222065 11025 ts_tablet_manager.cc:1403] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.159s	user 0.004s	sys 0.012s
I20260709 12:08:17.222221 11024 consensus_queue.cc:260] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.229171 11025 raft_consensus.cc:359] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.230475 11025 raft_consensus.cc:385] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.230612 11006 heartbeater.cc:499] Master 127.10.114.126:39459 was elected leader, sending a full tablet report...
I20260709 12:08:17.230823 11025 raft_consensus.cc:740] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.231868 11024 ts_tablet_manager.cc:1434] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.006s
I20260709 12:08:17.231570 11025 consensus_queue.cc:260] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.233659 11024 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.236771 11026 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.237418 11026 ts_tablet_manager.cc:1403] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.007s
I20260709 12:08:17.241801 11025 ts_tablet_manager.cc:1434] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 12:08:17.243927 11025 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.243515 11026 raft_consensus.cc:359] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.244326 11026 raft_consensus.cc:385] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.244635 11026 raft_consensus.cc:740] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.245398 11026 consensus_queue.cc:260] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.252391 11025 tablet_bootstrap.cc:654] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.256922 10932 heartbeater.cc:499] Master 127.10.114.126:39459 was elected leader, sending a full tablet report...
I20260709 12:08:17.257577 11026 ts_tablet_manager.cc:1434] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 12:08:17.258504 11026 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
W20260709 12:08:17.262583 11007 tablet.cc:2406] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:17.266683 11026 tablet_bootstrap.cc:654] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.270695 11032 raft_consensus.cc:493] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.273200 11032 raft_consensus.cc:515] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.279928 11032 leader_election.cc:290] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.284368 11024 tablet_bootstrap.cc:654] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.298079 11025 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.299125 11025 ts_tablet_manager.cc:1403] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.007s
I20260709 12:08:17.299935 11024 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.302111 11024 ts_tablet_manager.cc:1403] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.001s
I20260709 12:08:17.309846 11024 raft_consensus.cc:359] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.310907 11024 raft_consensus.cc:385] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.311254 11024 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.312044 11024 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.320748 11024 ts_tablet_manager.cc:1434] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:08:17.309756 11025 raft_consensus.cc:359] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.321439 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:17.321735 11025 raft_consensus.cc:385] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.322357 11025 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.323158 11026 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.323740 11026 ts_tablet_manager.cc:1403] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.022s
I20260709 12:08:17.323189 11025 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.324460 11031 raft_consensus.cc:493] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.324950 11031 raft_consensus.cc:515] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.325187 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
W20260709 12:08:17.326941 10872 leader_election.cc:343] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.326939 11026 raft_consensus.cc:359] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.327734 11026 raft_consensus.cc:385] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.327813 11031 leader_election.cc:290] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.328094 11026 raft_consensus.cc:740] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.329077 11026 consensus_queue.cc:260] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.330044 11025 ts_tablet_manager.cc:1434] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
W20260709 12:08:17.331048 10870 leader_election.cc:343] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.331457 11026 ts_tablet_manager.cc:1434] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:17.331491 10870 leader_election.cc:304] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:17.332357 11032 raft_consensus.cc:2749] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.333211 11026 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.333561 11025 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.341843 11026 tablet_bootstrap.cc:654] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.343730 11025 tablet_bootstrap.cc:654] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.345829 11024 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.380247 11024 tablet_bootstrap.cc:654] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.390587 11025 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.390524 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.392985 11025 ts_tablet_manager.cc:1403] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.006s
W20260709 12:08:17.399026 10795 leader_election.cc:343] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.400833 11026 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.401450 11026 ts_tablet_manager.cc:1403] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.004s
I20260709 12:08:17.402704 11025 raft_consensus.cc:359] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.403635 11025 raft_consensus.cc:385] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.404132 11025 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.403694 11024 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.405628 11024 ts_tablet_manager.cc:1403] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.022s
I20260709 12:08:17.404901 11026 raft_consensus.cc:359] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.407191 11026 raft_consensus.cc:385] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.405584 11025 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.408037 11026 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.410694 11026 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.414433 11025 ts_tablet_manager.cc:1434] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 12:08:17.415287 11024 raft_consensus.cc:359] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.415536 11025 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.416750 11026 ts_tablet_manager.cc:1434] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 12:08:17.416978 11024 raft_consensus.cc:385] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.418136 11024 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.418210 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:17.420123 11026 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.420377 11024 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
W20260709 12:08:17.421378 10795 leader_election.cc:343] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.421921 10795 leader_election.cc:304] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6f92564e8aa49329cdd4fbd17ecada4; no voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:17.423419 11031 raft_consensus.cc:2749] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.427155 11024 ts_tablet_manager.cc:1434] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:08:17.428889 11024 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.432586 11025 tablet_bootstrap.cc:654] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.447024 11026 tablet_bootstrap.cc:654] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.451020 11024 tablet_bootstrap.cc:654] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.460386 11025 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.460896 11025 ts_tablet_manager.cc:1403] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 12:08:17.463836 11025 raft_consensus.cc:359] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.464653 11025 raft_consensus.cc:385] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.465005 11025 raft_consensus.cc:740] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.465783 11025 consensus_queue.cc:260] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.467104 11024 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.463858 11026 tablet_bootstrap.cc:492] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.468526 11024 ts_tablet_manager.cc:1403] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.040s	user 0.002s	sys 0.024s
I20260709 12:08:17.468621 11026 ts_tablet_manager.cc:1403] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.016s
I20260709 12:08:17.471872 11024 raft_consensus.cc:359] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.472681 11024 raft_consensus.cc:385] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.473052 11024 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.467730 11025 ts_tablet_manager.cc:1434] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:08:17.472146 11026 raft_consensus.cc:359] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.474002 11026 raft_consensus.cc:385] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.474282 11026 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.474959 11025 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.475148 11026 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.478102 11026 ts_tablet_manager.cc:1434] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:08:17.479166 11026 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.482025 11030 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.482573 11030 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.483969 11025 tablet_bootstrap.cc:654] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.475497 11024 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.487371 11030 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:17.506451 11026 tablet_bootstrap.cc:654] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.513212 11031 raft_consensus.cc:493] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.515854 11031 raft_consensus.cc:515] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.528469 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.526441 11031 leader_election.cc:290] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.532688 11031 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:17.535498 10795 leader_election.cc:343] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.535641 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:17.536231 11031 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.537686 10907 raft_consensus.cc:2468] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:17.539026 11031 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.539556 11031 raft_consensus.cc:493] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.539989 10795 leader_election.cc:304] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:17.539995 11031 raft_consensus.cc:515] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.540463 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:17.541420 10907 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:17.546679 11031 leader_election.cc:290] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:17.547204 11031 raft_consensus.cc:2804] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.547235 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.548616 11031 raft_consensus.cc:493] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.551446 11031 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.553853 11024 ts_tablet_manager.cc:1434] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.085s	user 0.017s	sys 0.018s
I20260709 12:08:17.556077 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:17.557166 11024 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.550449 10981 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:17.551846 10795 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.559898 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.567142 10980 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
W20260709 12:08:17.570031 10795 leader_election.cc:343] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.571157 10795 leader_election.cc:304] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:17.571375 11053 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.572629 11053 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.573804 11053 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.579656 11054 raft_consensus.cc:2804] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.580111 11054 raft_consensus.cc:493] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.580426 11054 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.580709 11026 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.581997 11026 ts_tablet_manager.cc:1403] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.004s
I20260709 12:08:17.585196 11024 tablet_bootstrap.cc:654] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.585500 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:17.586501 11025 tablet_bootstrap.cc:492] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.587023 11025 ts_tablet_manager.cc:1403] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.024s
I20260709 12:08:17.586789 11026 raft_consensus.cc:359] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
W20260709 12:08:17.587867 10944 leader_election.cc:343] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.588934 11026 raft_consensus.cc:385] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.589783 11026 raft_consensus.cc:740] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.594002 11026 consensus_queue.cc:260] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.599937 11026 ts_tablet_manager.cc:1434] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:08:17.599912 11025 raft_consensus.cc:359] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.603145 11025 raft_consensus.cc:385] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.609870 11025 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.611274 11026 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.611006 11025 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.621343 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:17.622540 11032 raft_consensus.cc:493] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:17.623623 10946 leader_election.cc:343] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.623696 11032 raft_consensus.cc:515] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.607937 11053 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.624290 10946 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276; no voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:17.627288 11049 raft_consensus.cc:2749] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.628181 11032 leader_election.cc:290] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.629405 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:17.630084 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.630110 10832 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:17.631143 10980 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:17.632140 10872 leader_election.cc:304] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.633208 11054 raft_consensus.cc:515] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.633869 11032 raft_consensus.cc:2804] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.634425 11024 tablet_bootstrap.cc:492] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.635263 11024 ts_tablet_manager.cc:1403] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.018s
I20260709 12:08:17.634513 11032 raft_consensus.cc:493] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.636655 11032 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.632424 11031 raft_consensus.cc:515] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.646278 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.646039 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:17.647341 10980 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.640273 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
W20260709 12:08:17.649318 10795 leader_election.cc:343] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.639894 11054 leader_election.cc:290] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Requested vote from peers 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:17.650628 10907 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.651396 11026 tablet_bootstrap.cc:654] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.652145 11053 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.657224 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.658717 10981 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.664075 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:17.664849 10906 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.663030 11025 ts_tablet_manager.cc:1434] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.010s
I20260709 12:08:17.672894 11032 raft_consensus.cc:515] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.673305 11024 raft_consensus.cc:359] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.674188 11024 raft_consensus.cc:385] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.674572 11024 raft_consensus.cc:740] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.675602 11024 consensus_queue.cc:260] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.677673 11031 leader_election.cc:290] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.679883 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.680289 11024 ts_tablet_manager.cc:1434] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:08:17.681068 10979 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.682081 11025 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.683591 11024 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.681231 11032 leader_election.cc:290] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.680246 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:17.682202 10981 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:17.685796 10907 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:17.687745 10832 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.686560 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.690497 10795 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.692539 10978 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.695907 11026 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.696729 11026 ts_tablet_manager.cc:1403] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.005s
I20260709 12:08:17.687062 11058 raft_consensus.cc:493] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.700704 10979 raft_consensus.cc:2468] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:17.701004 11026 raft_consensus.cc:359] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.701905 11026 raft_consensus.cc:385] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.702216 11026 raft_consensus.cc:740] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.703137 11026 consensus_queue.cc:260] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.704285 10978 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:17.705960 10870 leader_election.cc:304] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:17.706854 11032 raft_consensus.cc:2804] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.694141 11031 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.722846 11024 tablet_bootstrap.cc:654] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.712733 11031 raft_consensus.cc:697] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:17.718238 11058 raft_consensus.cc:515] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.718554 10832 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:17.726262 11031 consensus_queue.cc:237] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.733922 10795 leader_election.cc:304] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.722687 10906 raft_consensus.cc:2468] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:17.735951 11053 raft_consensus.cc:2804] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.726764 10980 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:17.737599 11053 raft_consensus.cc:697] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:17.740978 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:17.741472 11053 consensus_queue.cc:237] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.741008 10795 leader_election.cc:304] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 5ba862913e9d42d7b47fcc5fd7e60924
W20260709 12:08:17.744061 10872 leader_election.cc:343] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.744099 11054 raft_consensus.cc:2804] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.745236 11054 raft_consensus.cc:697] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:17.747311 11026 ts_tablet_manager.cc:1434] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.010s
I20260709 12:08:17.748557 11026 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.746402 11058 leader_election.cc:290] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.751070 11054 consensus_queue.cc:237] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.752667 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
W20260709 12:08:17.754101 10870 leader_election.cc:343] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.739317 11032 raft_consensus.cc:697] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:17.754537 10870 leader_election.cc:304] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:17.758478 11058 raft_consensus.cc:2749] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.758373 11032 consensus_queue.cc:237] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.759474 11025 tablet_bootstrap.cc:654] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.765661 10726 catalog_manager.cc:5697] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.773728 11024 tablet_bootstrap.cc:492] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.774358 11024 ts_tablet_manager.cc:1403] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.003s
I20260709 12:08:17.777738 11024 raft_consensus.cc:359] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.778580 11024 raft_consensus.cc:385] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.778931 11024 raft_consensus.cc:740] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
W20260709 12:08:17.779477 10777 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.779990 11024 consensus_queue.cc:260] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.782524 11060 raft_consensus.cc:493] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.783120 11024 ts_tablet_manager.cc:1434] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:08:17.783124 11060 raft_consensus.cc:515] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.784385 11058 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.784868 11058 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.786058 11060 leader_election.cc:290] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.787060 11058 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.789330 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.789875 11026 tablet_bootstrap.cc:654] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.790112 10980 raft_consensus.cc:2468] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:17.790282 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
W20260709 12:08:17.792418 10872 leader_election.cc:343] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.793344 11024 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.793824 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:17.794615 10832 raft_consensus.cc:2468] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:17.796397 10872 leader_election.cc:304] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.797467 11058 raft_consensus.cc:2804] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.797986 11058 raft_consensus.cc:493] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.798372 11058 raft_consensus.cc:3060] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.815011 11025 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.815251 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:17.815641 11025 ts_tablet_manager.cc:1403] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.025s
I20260709 12:08:17.815979 10980 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:17.817379 10870 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:17.813373 11058 raft_consensus.cc:515] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.818197 11032 raft_consensus.cc:2804] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.818624 11032 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.818977 11032 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.818742 11026 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.821152 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:17.821766 10832 raft_consensus.cc:3060] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.823993 11024 tablet_bootstrap.cc:654] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.827696 10728 catalog_manager.cc:5697] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.828334 11025 raft_consensus.cc:359] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.828755 10832 raft_consensus.cc:2468] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:17.826179 11058 leader_election.cc:290] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.829226 11025 raft_consensus.cc:385] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.829624 11025 raft_consensus.cc:740] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.830214 10872 leader_election.cc:304] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:17.830406 11025 consensus_queue.cc:260] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.831246 11058 raft_consensus.cc:2804] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.831919 11058 raft_consensus.cc:697] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:17.832696 11025 ts_tablet_manager.cc:1434] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 12:08:17.834329 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6cae4e5d6640dbaecd79f9a3e1f0c3" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.834980 10980 raft_consensus.cc:3060] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.836225 11032 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.841223 11032 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:17.842350 11025 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.843286 11026 ts_tablet_manager.cc:1403] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.009s
I20260709 12:08:17.844035 10980 raft_consensus.cc:2468] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:17.845368 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:17.846781 11024 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
W20260709 12:08:17.846783 10872 leader_election.cc:343] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.848491 11024 ts_tablet_manager.cc:1403] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.005s
I20260709 12:08:17.832763 11058 consensus_queue.cc:237] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.849470 11025 tablet_bootstrap.cc:654] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.847056 11026 raft_consensus.cc:359] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.849476 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:17.859570 10979 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.859930 11026 raft_consensus.cc:385] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.860558 11026 raft_consensus.cc:740] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.871898 10979 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:17.874101 10870 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:17.874922 11032 raft_consensus.cc:2804] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.875535 11032 raft_consensus.cc:697] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:17.874806 10728 catalog_manager.cc:5697] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.876417 11032 consensus_queue.cc:237] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.876688 11024 raft_consensus.cc:359] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.877462 11024 raft_consensus.cc:385] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.877873 11024 raft_consensus.cc:740] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.877197 10728 catalog_manager.cc:5697] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.878701 11024 consensus_queue.cc:260] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.884426 11024 ts_tablet_manager.cc:1434] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 12:08:17.885504 11024 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.874521 11026 consensus_queue.cc:260] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.889676 11026 ts_tablet_manager.cc:1434] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.004s
I20260709 12:08:17.897080 11026 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.899967 11024 tablet_bootstrap.cc:654] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.906844 11025 tablet_bootstrap.cc:492] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.907405 11025 ts_tablet_manager.cc:1403] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.016s
I20260709 12:08:17.913045 11025 raft_consensus.cc:359] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.913936 11025 raft_consensus.cc:385] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.914216 11025 raft_consensus.cc:740] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.914912 11025 consensus_queue.cc:260] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.915802 10726 catalog_manager.cc:5697] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.917285 11025 ts_tablet_manager.cc:1434] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:08:17.918021 11026 tablet_bootstrap.cc:654] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.920943 11025 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.928783 11025 tablet_bootstrap.cc:654] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.932950 11024 tablet_bootstrap.cc:492] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.933830 11024 ts_tablet_manager.cc:1403] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.013s
I20260709 12:08:17.936833 11025 tablet_bootstrap.cc:492] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.936712 11024 raft_consensus.cc:359] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.937309 11025 ts_tablet_manager.cc:1403] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.010s
I20260709 12:08:17.937605 11024 raft_consensus.cc:385] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.937971 11024 raft_consensus.cc:740] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.938782 11024 consensus_queue.cc:260] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.940102 11025 raft_consensus.cc:359] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.940778 11025 raft_consensus.cc:385] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.941090 11025 raft_consensus.cc:740] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.941458 11024 ts_tablet_manager.cc:1434] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:08:17.941886 11025 consensus_queue.cc:260] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.942543 11024 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: Bootstrap starting.
I20260709 12:08:17.944556 11026 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.944000 10726 catalog_manager.cc:5697] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.945016 11026 ts_tablet_manager.cc:1403] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 12:08:17.947731 11026 raft_consensus.cc:359] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.948387 11025 ts_tablet_manager.cc:1434] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.004s
I20260709 12:08:17.949358 11025 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: Bootstrap starting.
I20260709 12:08:17.955526 11025 tablet_bootstrap.cc:654] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.948383 11026 raft_consensus.cc:385] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.957960 11026 raft_consensus.cc:740] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.958779 11026 consensus_queue.cc:260] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.959342 11024 tablet_bootstrap.cc:654] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.961285 11026 ts_tablet_manager.cc:1434] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:08:17.962373 11026 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: Bootstrap starting.
I20260709 12:08:17.971819 11026 tablet_bootstrap.cc:654] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.978297 11024 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: No bootstrap required, opened a new log
I20260709 12:08:17.978978 11024 ts_tablet_manager.cc:1403] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.016s
I20260709 12:08:17.980758 11025 tablet_bootstrap.cc:492] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: No bootstrap required, opened a new log
I20260709 12:08:17.981287 11025 ts_tablet_manager.cc:1403] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 12:08:17.982568 11024 raft_consensus.cc:359] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.983392 11024 raft_consensus.cc:385] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.983752 11026 tablet_bootstrap.cc:492] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: No bootstrap required, opened a new log
I20260709 12:08:17.983743 11024 raft_consensus.cc:740] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.984470 11026 ts_tablet_manager.cc:1403] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 12:08:17.984642 11025 raft_consensus.cc:359] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.984798 11024 consensus_queue.cc:260] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.985472 11025 raft_consensus.cc:385] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.985807 11025 raft_consensus.cc:740] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.986474 11025 consensus_queue.cc:260] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:17.987699 11024 ts_tablet_manager.cc:1434] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:17.990159 11026 raft_consensus.cc:359] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.990875 11026 raft_consensus.cc:385] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.991112 11026 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.991796 11026 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:17.993782 11026 ts_tablet_manager.cc:1434] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:17.996140 11025 ts_tablet_manager.cc:1434] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:08:18.046027 11054 raft_consensus.cc:493] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.046627 11054 raft_consensus.cc:515] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.048439 11054 leader_election.cc:290] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.049626 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:18.049813 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:18.050413 10906 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:18.050547 10979 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:18.051779 10795 leader_election.cc:304] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.052515 11054 raft_consensus.cc:2804] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.052896 11054 raft_consensus.cc:493] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.053252 11054 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.059466 11054 raft_consensus.cc:515] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.061416 11054 leader_election.cc:290] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.062395 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:18.062628 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.063082 10906 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.063171 10979 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.068137 10979 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:18.069295 10795 leader_election.cc:304] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.070003 11032 raft_consensus.cc:493] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.070144 11054 raft_consensus.cc:2804] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.070287 10906 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:18.070514 11032 raft_consensus.cc:515] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.071455 11054 raft_consensus.cc:697] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:18.072734 11032 leader_election.cc:290] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.073184 11054 consensus_queue.cc:237] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.074064 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" is_pre_election: true
I20260709 12:08:18.074237 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:18.074774 10832 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:18.075053 10979 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 0.
I20260709 12:08:18.076112 10872 leader_election.cc:304] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.076993 11032 raft_consensus.cc:2804] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.077505 11032 raft_consensus.cc:493] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.077982 11032 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.088376 11032 raft_consensus.cc:515] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.092025 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:18.092222 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.093021 10832 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.093107 10979 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.093603 10727 catalog_manager.cc:5697] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.100559 10832 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:18.100915 10979 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 1.
I20260709 12:08:18.090947 11032 leader_election.cc:290] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.101963 10872 leader_election.cc:304] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.103119 11032 raft_consensus.cc:2804] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.103740 11032 raft_consensus.cc:697] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:18.104576 11032 consensus_queue.cc:237] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.114053 10727 catalog_manager.cc:5697] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.154583 10906 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.161164 11053 consensus_queue.cc:1048] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.163901 11054 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.165000 11053 raft_consensus.cc:493] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.165578 11053 raft_consensus.cc:515] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.167696 11053 leader_election.cc:290] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.169665 11053 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.173167 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:18.173899 10978 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:18.173996 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:18.174726 10907 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 0.
I20260709 12:08:18.175963 10795 leader_election.cc:304] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.180706 11054 raft_consensus.cc:2804] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.181185 11054 raft_consensus.cc:493] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.181618 11054 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.199793 11032 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.209460 11032 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.211109 11054 raft_consensus.cc:515] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.220690 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:18.221446 10906 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.236601 11054 leader_election.cc:290] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.235873 11091 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.270131 11091 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.274730 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.275651 10981 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.302206 10831 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.337852 11060 consensus_queue.cc:1048] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:08:18.331523 10906 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:18.339995 11054 consensus_queue.cc:1048] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:08:18.347913 11091 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.356410 11060 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.354730 10981 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 1.
I20260709 12:08:18.375746 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220eb6f412384577a13ceb7e0da3e276" is_pre_election: true
I20260709 12:08:18.376678 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" is_pre_election: true
I20260709 12:08:18.378306 10980 raft_consensus.cc:2393] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6f92564e8aa49329cdd4fbd17ecada4 in current term 1: Already voted for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in this term.
I20260709 12:08:18.380208 10795 leader_election.cc:304] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.381105 11054 raft_consensus.cc:2804] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.381867 11054 raft_consensus.cc:697] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:18.382764 11054 consensus_queue.cc:237] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.387917 11091 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.389319 10795 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6f92564e8aa49329cdd4fbd17ecada4; no voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:18.401710 11092 raft_consensus.cc:2749] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.424448 11092 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.433599 11060 consensus_queue.cc:1048] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.435403 11058 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.452910 10727 catalog_manager.cc:5697] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.502348 11054 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.522710 11058 consensus_queue.cc:1048] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.524844 11054 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.535207 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:44764
I20260709 12:08:18.536196 10907 raft_consensus.cc:606] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Received request to transfer leadership to TS c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:18.544341 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:44764
I20260709 12:08:18.545210 10907 raft_consensus.cc:606] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Received request to transfer leadership to TS c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:18.569661 11058 consensus_queue.cc:1048] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.577370 10831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:18.578117 10831 raft_consensus.cc:606] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:18.588119 10831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:18.588862 10831 raft_consensus.cc:606] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:18.596210 10831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:18.596979 10831 raft_consensus.cc:606] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:18.606902 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:44764
I20260709 12:08:18.607510 10907 raft_consensus.cc:606] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Received request to transfer leadership to TS 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:18.645881 11105 raft_consensus.cc:993] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:18.646360 11105 raft_consensus.cc:1081] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Signalling peer c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:18.648260 10831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:38198
I20260709 12:08:18.648761 10831 raft_consensus.cc:493] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:18.649075 10831 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.655174 10831 raft_consensus.cc:515] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.657424 10831 leader_election.cc:290] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.658447 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:18.658653 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.659267 10907 raft_consensus.cc:3055] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:18.659348 10980 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.659641 10907 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:18.660554 10907 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.661806 10907 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.666108 10980 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 2.
I20260709 12:08:18.666648 10907 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 2.
I20260709 12:08:18.667590 10795 leader_election.cc:304] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.668444 11054 raft_consensus.cc:2804] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:18.668927 11054 raft_consensus.cc:697] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:18.669772 11054 consensus_queue.cc:237] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.677325 10726 catalog_manager.cc:5697] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 1 to 2, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.755458 11092 raft_consensus.cc:993] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:18.756028 11092 raft_consensus.cc:1081] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:18.758013 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:18.758669 10907 raft_consensus.cc:493] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:18.759052 10907 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.765766 10907 raft_consensus.cc:515] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.768446 10907 leader_election.cc:290] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.769035 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:18.769040 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1abb455aa44e2b2c97f9fba8db2b8" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.769824 10831 raft_consensus.cc:3055] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:18.769997 10980 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.770215 10831 raft_consensus.cc:740] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:18.771147 10831 consensus_queue.cc:260] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.772406 10831 raft_consensus.cc:3060] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.777566 10980 raft_consensus.cc:2468] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:18.778962 10870 leader_election.cc:304] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:18.779354 10831 raft_consensus.cc:2468] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:18.779919 11105 raft_consensus.cc:2804] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:18.780475 11105 raft_consensus.cc:697] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:18.781278 11105 consensus_queue.cc:237] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.790393 10726 catalog_manager.cc:5697] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 1 to 2, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.829712 11058 raft_consensus.cc:993] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:18.830264 11105 raft_consensus.cc:1081] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Signalling peer c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:18.832379 10831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:38198
I20260709 12:08:18.832985 10831 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:18.833355 10831 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.842499 10831 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.844158 10831 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:18.845392 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:18.845530 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:18.846007 10907 raft_consensus.cc:3055] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:18.846100 10980 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.846527 10907 raft_consensus.cc:740] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:18.847335 10907 consensus_queue.cc:260] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.848241 10907 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.853379 10907 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 2.
I20260709 12:08:18.853693 10980 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 2.
I20260709 12:08:18.854908 10795 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:18.855755 11054 raft_consensus.cc:2804] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:18.856238 11054 raft_consensus.cc:697] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:18.857091 11054 consensus_queue.cc:237] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:18.864492 10726 catalog_manager.cc:5697] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 1 to 2, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.985720 11054 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.987280 11054 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.998736 11092 raft_consensus.cc:993] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:18.999332 11092 raft_consensus.cc:1081] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:19.004762 10906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:19.005380 10906 raft_consensus.cc:493] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.005769 10906 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.014133 10906 raft_consensus.cc:515] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.017310 10906 leader_election.cc:290] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:19.018011 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:19.018653 10831 raft_consensus.cc:3055] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.019058 10831 raft_consensus.cc:740] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:19.019398 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:19.020134 10980 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.019837 10831 consensus_queue.cc:260] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.021131 10831 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.028268 10980 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:19.029794 10870 leader_election.cc:304] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:19.030797 11105 raft_consensus.cc:2804] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.031423 11105 raft_consensus.cc:697] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:19.032745 11105 consensus_queue.cc:237] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.035084 10831 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:19.043016 10727 catalog_manager.cc:5697] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 1 to 2, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.057222 11054 raft_consensus.cc:993] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:19.057888 11053 raft_consensus.cc:1081] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:19.059840 10906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:19.060385 10906 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.060691 10906 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.065109 10906 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.066857 10906 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:19.067764 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:19.068378 10831 raft_consensus.cc:3055] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.068133 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:19.068697 10831 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:19.068941 10980 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.069511 10831 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.070534 10831 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.075664 10831 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:19.076850 10872 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:19.077591 11105 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.077715 10980 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:19.078066 11105 raft_consensus.cc:697] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:19.079033 11105 consensus_queue.cc:237] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.086051 10727 catalog_manager.cc:5697] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 1 to 2, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.133847 11058 raft_consensus.cc:993] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:19.134441 11058 raft_consensus.cc:1081] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Signalling peer 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:19.136036 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:60040
I20260709 12:08:19.136579 10980 raft_consensus.cc:493] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.136919 10980 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.142589 10980 raft_consensus.cc:515] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.145313 10980 leader_election.cc:290] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:19.146483 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:19.147185 10831 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.147279 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc1850d70994df18dec8ee1786684be" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:19.148065 10906 raft_consensus.cc:3055] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.148507 10906 raft_consensus.cc:740] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:19.149614 10906 consensus_queue.cc:260] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.151281 10906 raft_consensus.cc:3060] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.157289 10831 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 2.
I20260709 12:08:19.158893 10946 leader_election.cc:304] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:19.159866 11100 raft_consensus.cc:2804] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.160030 10906 raft_consensus.cc:2468] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 2.
I20260709 12:08:19.163060 11100 raft_consensus.cc:697] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Becoming Leader. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:19.164276 11100 consensus_queue.cc:237] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:19.172066 10727 catalog_manager.cc:5697] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 reported cstate change: term changed from 1 to 2, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "220eb6f412384577a13ceb7e0da3e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.232883 10906 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.234470 10977 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.234583 11053 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:19.236068 11053 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.264154 10831 raft_consensus.cc:1275] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.265597 11058 consensus_queue.cc:1048] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.275271 10977 raft_consensus.cc:1275] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.276968 11032 consensus_queue.cc:1048] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.418435 10831 raft_consensus.cc:1275] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.419683 11032 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.427799 10977 raft_consensus.cc:1275] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.429286 11032 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.436625 10906 raft_consensus.cc:1275] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.438036 11054 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.449791 10977 raft_consensus.cc:1275] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.451664 11053 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.554541 10831 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.554519 10977 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.556600 11058 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.557273 11032 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.586709 10831 raft_consensus.cc:1275] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.588168 11100 consensus_queue.cc:1048] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.598006 10906 raft_consensus.cc:1275] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.600066 11100 consensus_queue.cc:1048] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.645848 10697 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:21.646792 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:21.670893 10831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:41200
I20260709 12:08:21.671612 10831 raft_consensus.cc:606] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Received request to transfer leadership to TS 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:21.683672 10906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:21.684401 10906 raft_consensus.cc:606] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Received request to transfer leadership to TS 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:21.686288 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:21.686954 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.084218 11134 raft_consensus.cc:993] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:22.084785 11032 raft_consensus.cc:1081] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Signalling peer 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:22.086424 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:60040
I20260709 12:08:22.087083 10977 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.087515 10977 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.092842 10977 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:22.094784 10977 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 3 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:22.095705 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:22.096376 10831 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.096244 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:22.097100 10906 raft_consensus.cc:3055] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.097401 10906 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:22.098184 10906 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:22.099125 10906 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.102136 10831 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 3.
I20260709 12:08:22.103511 10946 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:22.104398 11130 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.104238 10906 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 3.
I20260709 12:08:22.106045 11130 raft_consensus.cc:697] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 LEADER]: Becoming Leader. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:22.106863 11130 consensus_queue.cc:237] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:22.114877 10726 catalog_manager.cc:5697] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 reported cstate change: term changed from 2 to 3, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "220eb6f412384577a13ceb7e0da3e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.260867 11135 raft_consensus.cc:993] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:22.261449 11128 raft_consensus.cc:1081] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Signalling peer 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:22.263453 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:60048
I20260709 12:08:22.264020 10977 raft_consensus.cc:493] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.264485 10977 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.269207 10977 raft_consensus.cc:515] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:22.270987 10977 leader_election.cc:290] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:22.272135 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:22.272228 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:22.272780 10831 raft_consensus.cc:3055] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.272898 10906 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.273249 10831 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:22.274802 10831 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:22.275817 10831 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.282799 10906 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 2.
I20260709 12:08:22.282686 10831 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 2.
I20260709 12:08:22.284502 10946 leader_election.cc:304] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:22.285367 11130 raft_consensus.cc:2804] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.285888 11130 raft_consensus.cc:697] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Becoming Leader. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:22.286727 11130 consensus_queue.cc:237] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:22.295372 10726 catalog_manager.cc:5697] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 reported cstate change: term changed from 1 to 2, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "220eb6f412384577a13ceb7e0da3e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:22.630972 10831 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.632318 11130 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:22.645792 10906 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.647572 11145 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.688277 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.689128 10906 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.690654 11145 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.695495 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:22.696231 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.701856 10831 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.703603 11145 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.697336 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.702570 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.703008 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.704682 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.711354 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.711917 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.713150 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.718605 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.719071 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.720199 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.725348 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.725879 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.727092 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.732591 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.733193 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.734520 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.742230 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.742818 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.744830 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.750615 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.751411 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.752560 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.758852 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.759289 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.789426 10697 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:31.805001 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:08:31.805716 10980 raft_consensus.cc:606] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:31.811275 10832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:31.811862 10832 raft_consensus.cc:606] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:31.817047 10832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:31.817602 10832 raft_consensus.cc:606] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:31.822643 10832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:41186
I20260709 12:08:31.823169 10832 raft_consensus.cc:606] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:31.833678 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
mode: GRACEFUL
new_leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:08:31.834363 10980 raft_consensus.cc:606] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 LEADER]: Received request to transfer leadership to TS 5ba862913e9d42d7b47fcc5fd7e60924
I20260709 12:08:31.873517 11155 raft_consensus.cc:993] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:31.874228 11163 raft_consensus.cc:1081] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:31.875996 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44748
I20260709 12:08:31.876587 10907 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.876907 10907 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.882634 10907 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:31.884336 10907 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 4 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:31.885649 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:31.885604 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:31.886469 10980 raft_consensus.cc:3055] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:31.886596 10832 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.886817 10980 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:31.887774 10980 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:31.888892 10980 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.892202 10832 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 4.
I20260709 12:08:31.893604 10872 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:31.894387 11156 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:31.894809 10980 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 4.
I20260709 12:08:31.895512 11156 raft_consensus.cc:697] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:31.896548 11156 consensus_queue.cc:237] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:31.904137 10727 catalog_manager.cc:5697] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 3 to 4, leader changed from 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 4 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:31.926805 11155 raft_consensus.cc:993] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:31.927299 11155 raft_consensus.cc:1081] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:31.928875 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44748
I20260709 12:08:31.929472 10907 raft_consensus.cc:493] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.929863 10907 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.936884 10907 raft_consensus.cc:515] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:31.938642 10907 leader_election.cc:290] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Requested vote from peers 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841), c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859)
I20260709 12:08:31.939604 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:31.939939 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:31.940230 10980 raft_consensus.cc:3055] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:31.940527 10832 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.940593 10980 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:31.941526 10980 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:31.942524 10980 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.946556 10832 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:31.947844 10872 leader_election.cc:304] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba862913e9d42d7b47fcc5fd7e60924, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:31.948871 10980 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:31.948827 11156 raft_consensus.cc:2804] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:31.949628 11156 raft_consensus.cc:697] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:31.950560 11156 consensus_queue.cc:237] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:31.958401 10727 catalog_manager.cc:5697] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 2 to 3, leader changed from 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:32.046782 11128 raft_consensus.cc:993] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.047356 11171 raft_consensus.cc:1081] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.049019 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:32.049569 10907 raft_consensus.cc:493] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.049823 10907 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.055604 10907 raft_consensus.cc:515] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.057317 10907 leader_election.cc:290] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:32.058312 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:32.058578 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:32.058897 10832 raft_consensus.cc:3055] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:32.059131 10980 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.059293 10832 raft_consensus.cc:740] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:32.060127 10832 consensus_queue.cc:260] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.061136 10832 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.064072 10980 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:32.065408 10870 leader_election.cc:304] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:32.066283 11156 raft_consensus.cc:2804] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:32.066630 10832 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 2.
I20260709 12:08:32.066716 11156 raft_consensus.cc:697] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:32.067945 11156 consensus_queue.cc:237] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.076596 10727 catalog_manager.cc:5697] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 1 to 2, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.128703 11128 raft_consensus.cc:993] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.129262 11171 raft_consensus.cc:1081] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.130990 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:32.131551 10907 raft_consensus.cc:493] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.131834 10907 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.137434 10907 raft_consensus.cc:515] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.138909 10907 leader_election.cc:290] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:32.140039 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:32.140107 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4928b55ae4a71a5cf968edbe1420c" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:32.140705 10832 raft_consensus.cc:3055] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.140724 10980 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.141211 10832 raft_consensus.cc:740] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:32.141985 10832 consensus_queue.cc:260] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.142938 10832 raft_consensus.cc:3060] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.145942 10980 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:32.147080 10870 leader_election.cc:304] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:32.147957 11156 raft_consensus.cc:2804] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.148413 11156 raft_consensus.cc:697] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:32.148795 10832 raft_consensus.cc:2468] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:32.149328 11156 consensus_queue.cc:237] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.158854 11128 raft_consensus.cc:993] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: : Instructing follower 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.158329 10727 catalog_manager.cc:5697] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 2 to 3, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.159355 11128 raft_consensus.cc:1081] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Signalling peer 5ba862913e9d42d7b47fcc5fd7e60924 to start an election
I20260709 12:08:32.160777 10907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
 from {username='slave'} at 127.0.0.1:44740
I20260709 12:08:32.161355 10907 raft_consensus.cc:493] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.161743 10907 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.167629 10907 raft_consensus.cc:515] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.169256 10907 leader_election.cc:290] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:32.170073 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:32.170490 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:32.170687 10832 raft_consensus.cc:3055] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.170953 10980 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.171046 10832 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:32.171790 10832 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.172844 10832 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.177083 10980 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:32.178264 10870 leader_election.cc:304] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, 5ba862913e9d42d7b47fcc5fd7e60924; no voters: 
I20260709 12:08:32.178797 10832 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ba862913e9d42d7b47fcc5fd7e60924 in term 3.
I20260709 12:08:32.179149 11156 raft_consensus.cc:2804] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.179724 11156 raft_consensus.cc:697] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Becoming Leader. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:32.180533 11156 consensus_queue.cc:237] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:32.187776 10727 catalog_manager.cc:5697] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 reported cstate change: term changed from 2 to 3, leader changed from c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65) to 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.407305 10831 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.408665 11156 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.419471 10980 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.421411 11156 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.514154 10831 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.515448 11156 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.525117 10980 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.529345 11156 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:32.564548 10980 raft_consensus.cc:1275] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.566031 11156 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.575595 10831 raft_consensus.cc:1275] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.577934 11156 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.578104 10977 raft_consensus.cc:1275] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.580844 11181 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:32.592669 10831 raft_consensus.cc:1275] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.594379 11156 consensus_queue.cc:1048] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.795347 10831 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.796765 11183 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:32.806284 10977 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Refusing update from remote peer 5ba862913e9d42d7b47fcc5fd7e60924: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.808054 11156 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.875857 10697 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:34.876950 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:34.884651 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:34.885296 10907 raft_consensus.cc:606] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Received request to transfer leadership to TS c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:34.888137 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:34.888525 10907 raft_consensus.cc:606] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Received request to transfer leadership to TS 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:34.890868 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:34.891252 10907 raft_consensus.cc:606] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Received request to transfer leadership to TS 220eb6f412384577a13ceb7e0da3e276
I20260709 12:08:34.893517 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:34.893963 10907 raft_consensus.cc:606] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 LEADER]: Received request to transfer leadership to TS c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:34.896222 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39"
dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
mode: GRACEFUL
new_leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:46150
I20260709 12:08:34.896673 10907 raft_consensus.cc:606] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Received request to transfer leadership to TS c6f92564e8aa49329cdd4fbd17ecada4
I20260709 12:08:34.897734 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:34.898339 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.069478 11195 raft_consensus.cc:993] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.070183 11193 raft_consensus.cc:1081] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Signalling peer c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.071928 10831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:38198
I20260709 12:08:35.072419 10831 raft_consensus.cc:493] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.072719 10831 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.077512 10831 raft_consensus.cc:515] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.079648 10831 leader_election.cc:290] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:35.080767 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:35.081601 10907 raft_consensus.cc:3055] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.081426 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85331ff4aa94022b9ff9c4905609c39" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:35.081915 10907 raft_consensus.cc:740] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:35.082314 10977 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.082858 10907 consensus_queue.cc:260] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.084254 10907 raft_consensus.cc:3060] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.089905 10977 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 3.
I20260709 12:08:35.090665 10907 raft_consensus.cc:2468] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 3.
I20260709 12:08:35.091522 10795 leader_election.cc:304] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:35.093130 11196 raft_consensus.cc:2804] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.094146 11196 raft_consensus.cc:697] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:35.095178 11196 consensus_queue.cc:237] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.103825 10727 catalog_manager.cc:5697] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 2 to 3, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.117929 11195 raft_consensus.cc:993] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:35.118553 11193 raft_consensus.cc:1081] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Signalling peer 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:35.120229 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:60040
I20260709 12:08:35.120656 10977 raft_consensus.cc:493] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.120882 10977 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.124861 10977 raft_consensus.cc:515] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:35.126881 10977 leader_election.cc:290] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 4 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:35.128029 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:35.128162 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4daf08722f5f410587f1d1c20abc32af" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:35.128836 10907 raft_consensus.cc:3055] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.128826 10831 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.129313 10907 raft_consensus.cc:740] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:35.130713 11195 raft_consensus.cc:993] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:35.130267 10907 consensus_queue.cc:260] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:35.131223 11195 raft_consensus.cc:1081] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Signalling peer 220eb6f412384577a13ceb7e0da3e276 to start an election
I20260709 12:08:35.131722 10907 raft_consensus.cc:3060] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.133090 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "602fa54753274bc18748910d607c7020"
dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
 from {username='slave'} at 127.0.0.1:60040
I20260709 12:08:35.133837 10977 raft_consensus.cc:493] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.134244 10977 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.134999 10831 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 4.
I20260709 12:08:35.136237 10946 leader_election.cc:304] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:35.137240 11186 raft_consensus.cc:2804] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.138609 11186 raft_consensus.cc:697] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 4 LEADER]: Becoming Leader. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:35.139463 11186 consensus_queue.cc:237] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } }
I20260709 12:08:35.139806 10907 raft_consensus.cc:2468] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 4.
I20260709 12:08:35.142210 10977 raft_consensus.cc:515] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.144328 10977 leader_election.cc:290] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 4 election: Requested vote from peers c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859), 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527)
I20260709 12:08:35.145206 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
I20260709 12:08:35.145861 10831 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.146976 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602fa54753274bc18748910d607c7020" candidate_uuid: "220eb6f412384577a13ceb7e0da3e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:35.147480 10907 raft_consensus.cc:3055] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.147746 10907 raft_consensus.cc:740] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:35.148226 10727 catalog_manager.cc:5697] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 reported cstate change: term changed from 3 to 4, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "220eb6f412384577a13ceb7e0da3e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.148449 10907 consensus_queue.cc:260] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.149693 10907 raft_consensus.cc:3060] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.152097 10831 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 4.
I20260709 12:08:35.153218 10946 leader_election.cc:304] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:35.154107 11186 raft_consensus.cc:2804] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.154620 11186 raft_consensus.cc:697] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 4 LEADER]: Becoming Leader. State: Replica: 220eb6f412384577a13ceb7e0da3e276, State: Running, Role: LEADER
I20260709 12:08:35.155912 10907 raft_consensus.cc:2468] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220eb6f412384577a13ceb7e0da3e276 in term 4.
I20260709 12:08:35.155594 11186 consensus_queue.cc:237] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.163177 10727 catalog_manager.cc:5697] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 reported cstate change: term changed from 3 to 4, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "220eb6f412384577a13ceb7e0da3e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:35.349346 11193 raft_consensus.cc:993] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.349957 11195 raft_consensus.cc:1081] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Signalling peer c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.351872 10831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:38198
I20260709 12:08:35.352699 10831 raft_consensus.cc:493] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.353111 10831 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.354672 11195 raft_consensus.cc:993] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: : Instructing follower c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.355293 11193 raft_consensus.cc:1081] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 LEADER]: Signalling peer c6f92564e8aa49329cdd4fbd17ecada4 to start an election
I20260709 12:08:35.357316 10832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f181afb6990548698f41b48407ff46eb"
dest_uuid: "c6f92564e8aa49329cdd4fbd17ecada4"
 from {username='slave'} at 127.0.0.1:38198
I20260709 12:08:35.357908 10832 raft_consensus.cc:493] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.358249 10832 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.359056 10831 raft_consensus.cc:515] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.360565 10831 leader_election.cc:290] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:35.361670 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:35.361975 10977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e01df2247334a6eac7fe2210d4fc140" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:35.362259 10907 raft_consensus.cc:3055] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.362509 10977 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.362593 10907 raft_consensus.cc:740] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:35.363467 10907 consensus_queue.cc:260] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.364492 10907 raft_consensus.cc:3060] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.364290 10832 raft_consensus.cc:515] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.366181 10832 leader_election.cc:290] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527), 220eb6f412384577a13ceb7e0da3e276 (127.10.114.67:40841)
I20260709 12:08:35.367421 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "220eb6f412384577a13ceb7e0da3e276"
I20260709 12:08:35.367980 10980 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.370262 10977 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 3.
I20260709 12:08:35.371436 10795 leader_election.cc:304] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:35.372303 11196 raft_consensus.cc:2804] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.372771 11196 raft_consensus.cc:697] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:35.373942 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f181afb6990548698f41b48407ff46eb" candidate_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5ba862913e9d42d7b47fcc5fd7e60924"
I20260709 12:08:35.374583 10906 raft_consensus.cc:3055] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.373746 11196 consensus_queue.cc:237] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.374876 10906 raft_consensus.cc:740] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ba862913e9d42d7b47fcc5fd7e60924, State: Running, Role: LEADER
I20260709 12:08:35.375707 10980 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 5.
I20260709 12:08:35.375638 10906 consensus_queue.cc:260] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.377002 10906 raft_consensus.cc:3060] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.377064 10795 leader_election.cc:304] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220eb6f412384577a13ceb7e0da3e276, c6f92564e8aa49329cdd4fbd17ecada4; no voters: 
I20260709 12:08:35.378073 11197 raft_consensus.cc:2804] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.379539 11197 raft_consensus.cc:697] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 5 LEADER]: Becoming Leader. State: Replica: c6f92564e8aa49329cdd4fbd17ecada4, State: Running, Role: LEADER
I20260709 12:08:35.380486 11197 consensus_queue.cc:237] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } }
I20260709 12:08:35.385813 10907 raft_consensus.cc:2468] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 3.
I20260709 12:08:35.389097 10906 raft_consensus.cc:2468] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f92564e8aa49329cdd4fbd17ecada4 in term 5.
I20260709 12:08:35.392831 10727 catalog_manager.cc:5697] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 2 to 3, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.405268 10727 catalog_manager.cc:5697] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 reported cstate change: term changed from 4 to 5, leader changed from 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66) to c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65). New cstate: current_term: 5 leader_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.584913 10980 raft_consensus.cc:1275] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.586633 11196 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.589572 10906 raft_consensus.cc:1275] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.590772 11196 consensus_queue.cc:1048] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.593689 10832 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.595853 11186 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.624322 10907 raft_consensus.cc:1275] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.626353 11217 consensus_queue.cc:1048] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.682519 10907 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.683990 11216 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.693382 10832 raft_consensus.cc:1275] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Refusing update from remote peer 220eb6f412384577a13ceb7e0da3e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.695353 11216 consensus_queue.cc:1048] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f92564e8aa49329cdd4fbd17ecada4" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.854168 10980 raft_consensus.cc:1275] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.855515 11196 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:35.864923 10907 raft_consensus.cc:1275] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.866844 11208 consensus_queue.cc:1048] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.876649 10907 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 5 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:35.878480 11208 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba862913e9d42d7b47fcc5fd7e60924" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:35.889325 10980 raft_consensus.cc:1275] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 5 FOLLOWER]: Refusing update from remote peer c6f92564e8aa49329cdd4fbd17ecada4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:35.893622 11215 consensus_queue.cc:1048] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220eb6f412384577a13ceb7e0da3e276" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:35.899603 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.907184 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:35.907779 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.908905 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.913950 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.914304 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.915477 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.921089 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.921772 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.923067 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.928140 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.928553 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.929600 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.936115 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.936468 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.937413 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.943498 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.943991 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.945173 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.950757 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.951400 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.952606 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.958485 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.958992 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.960175 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.966390 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.967016 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.001338 10697 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.002126 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
W20260709 12:08:45.026849 10946 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:08:45.036149 10946 consensus_peers.cc:597] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 -> Peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Couldn't send request to peer c6f92564e8aa49329cdd4fbd17ecada4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.039011 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.040009 10697 tablet_replica.cc:333] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.040933 10697 raft_consensus.cc:2243] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.041726 10697 raft_consensus.cc:2272] T ffc1850d70994df18dec8ee1786684be P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.044517 10697 tablet_replica.cc:333] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.045077 10697 raft_consensus.cc:2243] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.046092 10697 raft_consensus.cc:2272] T f85331ff4aa94022b9ff9c4905609c39 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.047914 10697 tablet_replica.cc:333] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.048456 10697 raft_consensus.cc:2243] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.048906 10697 raft_consensus.cc:2272] T 1cc4928b55ae4a71a5cf968edbe1420c P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.051576 10697 tablet_replica.cc:333] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.052304 10697 raft_consensus.cc:2243] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.052938 10697 raft_consensus.cc:2272] T fad1abb455aa44e2b2c97f9fba8db2b8 P c6f92564e8aa49329cdd4fbd17ecada4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.055594 10697 tablet_replica.cc:333] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.056461 10697 raft_consensus.cc:2243] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.057111 10697 raft_consensus.cc:2272] T 602fa54753274bc18748910d607c7020 P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.059952 10697 tablet_replica.cc:333] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.060729 10697 raft_consensus.cc:2243] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.061484 10697 raft_consensus.cc:2272] T 4daf08722f5f410587f1d1c20abc32af P c6f92564e8aa49329cdd4fbd17ecada4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.063989 10697 tablet_replica.cc:333] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.064673 10697 raft_consensus.cc:2243] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.065757 10697 raft_consensus.cc:2272] T 0e01df2247334a6eac7fe2210d4fc140 P c6f92564e8aa49329cdd4fbd17ecada4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.067567 10697 tablet_replica.cc:333] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.068005 10697 raft_consensus.cc:2243] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.068809 10697 raft_consensus.cc:2272] T f181afb6990548698f41b48407ff46eb P c6f92564e8aa49329cdd4fbd17ecada4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.070669 10697 tablet_replica.cc:333] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4: stopping tablet replica
I20260709 12:08:45.071079 10697 raft_consensus.cc:2243] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.071460 10697 raft_consensus.cc:2272] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P c6f92564e8aa49329cdd4fbd17ecada4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.086421 10946 connection.cc:573] client connection to 127.10.114.65:41859 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:08:45.086951 10946 consensus_peers.cc:597] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 -> Peer c6f92564e8aa49329cdd4fbd17ecada4 (127.10.114.65:41859): Couldn't send request to peer c6f92564e8aa49329cdd4fbd17ecada4. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.168121 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
I20260709 12:08:45.191793 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
I20260709 12:08:45.230234 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.231106 10697 tablet_replica.cc:333] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.231889 10697 raft_consensus.cc:2243] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.232522 10697 raft_consensus.cc:2272] T 4daf08722f5f410587f1d1c20abc32af P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.234897 10697 tablet_replica.cc:333] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.235489 10697 raft_consensus.cc:2243] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.235953 10697 raft_consensus.cc:2272] T ffc1850d70994df18dec8ee1786684be P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.237865 10697 tablet_replica.cc:333] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.238402 10697 raft_consensus.cc:2243] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.239250 10697 raft_consensus.cc:2272] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.241039 10697 tablet_replica.cc:333] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.241652 10697 raft_consensus.cc:2243] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.242084 10697 raft_consensus.cc:2272] T 0e01df2247334a6eac7fe2210d4fc140 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.243778 10697 tablet_replica.cc:333] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.244304 10697 raft_consensus.cc:2243] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.244760 10697 raft_consensus.cc:2272] T f181afb6990548698f41b48407ff46eb P 5ba862913e9d42d7b47fcc5fd7e60924 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.246477 10697 tablet_replica.cc:333] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.246973 10697 raft_consensus.cc:2243] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.247462 10697 raft_consensus.cc:2272] T 602fa54753274bc18748910d607c7020 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.249339 10697 tablet_replica.cc:333] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.249950 10697 raft_consensus.cc:2243] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.250491 10697 raft_consensus.cc:2272] T f85331ff4aa94022b9ff9c4905609c39 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.252712 10697 tablet_replica.cc:333] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.253238 10697 raft_consensus.cc:2243] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.254110 10697 raft_consensus.cc:2272] T 1cc4928b55ae4a71a5cf968edbe1420c P 5ba862913e9d42d7b47fcc5fd7e60924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.255894 10697 tablet_replica.cc:333] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924: stopping tablet replica
I20260709 12:08:45.256346 10697 raft_consensus.cc:2243] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.257356 10697 raft_consensus.cc:2272] T fad1abb455aa44e2b2c97f9fba8db2b8 P 5ba862913e9d42d7b47fcc5fd7e60924 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.274111 10872 connection.cc:466] server connection from 127.0.0.1:44748 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44748 (request call id 145) could send its response
W20260709 12:08:45.279470 10944 consensus_peers.cc:597] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 -> Peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Couldn't send request to peer 5ba862913e9d42d7b47fcc5fd7e60924. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:45.291138 10944 consensus_peers.cc:597] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 -> Peer 5ba862913e9d42d7b47fcc5fd7e60924 (127.10.114.66:46527): Couldn't send request to peer 5ba862913e9d42d7b47fcc5fd7e60924. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.291668 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:08:45.311964 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
I20260709 12:08:45.343648 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.344453 10697 tablet_replica.cc:333] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.345252 10697 raft_consensus.cc:2243] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.346120 10697 raft_consensus.cc:2272] T ffc1850d70994df18dec8ee1786684be P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.347995 10697 tablet_replica.cc:333] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.348610 10697 raft_consensus.cc:2243] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.349025 10697 raft_consensus.cc:2272] T f85331ff4aa94022b9ff9c4905609c39 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.350839 10697 tablet_replica.cc:333] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.351387 10697 raft_consensus.cc:2243] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.351742 10697 raft_consensus.cc:2272] T 3d6cae4e5d6640dbaecd79f9a3e1f0c3 P 220eb6f412384577a13ceb7e0da3e276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.353519 10697 tablet_replica.cc:333] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.354087 10697 raft_consensus.cc:2243] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.354857 10697 raft_consensus.cc:2272] T 602fa54753274bc18748910d607c7020 P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.356774 10697 tablet_replica.cc:333] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.357275 10697 raft_consensus.cc:2243] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.358086 10697 raft_consensus.cc:2272] T 4daf08722f5f410587f1d1c20abc32af P 220eb6f412384577a13ceb7e0da3e276 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.359752 10697 tablet_replica.cc:333] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.360285 10697 raft_consensus.cc:2243] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.360734 10697 raft_consensus.cc:2272] T 0e01df2247334a6eac7fe2210d4fc140 P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.362469 10697 tablet_replica.cc:333] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.363011 10697 raft_consensus.cc:2243] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.363469 10697 raft_consensus.cc:2272] T f181afb6990548698f41b48407ff46eb P 220eb6f412384577a13ceb7e0da3e276 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.365726 10697 tablet_replica.cc:333] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.366230 10697 raft_consensus.cc:2243] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.366658 10697 raft_consensus.cc:2272] T fad1abb455aa44e2b2c97f9fba8db2b8 P 220eb6f412384577a13ceb7e0da3e276 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.368302 10697 tablet_replica.cc:333] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276: stopping tablet replica
I20260709 12:08:45.368791 10697 raft_consensus.cc:2243] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.369226 10697 raft_consensus.cc:2272] T 1cc4928b55ae4a71a5cf968edbe1420c P 220eb6f412384577a13ceb7e0da3e276 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.397980 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:08:45.418738 10697 master.cc:562] Master@127.10.114.126:39459 shutting down...
I20260709 12:08:45.643184 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.643957 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.644330 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3b439a7ef2e845038216045156fe9f36: stopping tablet replica
I20260709 12:08:45.666074 10697 master.cc:584] Master@127.10.114.126:39459 shutdown complete.
220eb6f412384577a13ceb7e0da3e276  1
5ba862913e9d42d7b47fcc5fd7e60924  4
c6f92564e8aa49329cdd4fbd17ecada4  4
220eb6f412384577a13ceb7e0da3e276  3
5ba862913e9d42d7b47fcc5fd7e60924  3
c6f92564e8aa49329cdd4fbd17ecada4  3
220eb6f412384577a13ceb7e0da3e276  1
5ba862913e9d42d7b47fcc5fd7e60924  8
c6f92564e8aa49329cdd4fbd17ecada4  0
220eb6f412384577a13ceb7e0da3e276  3
5ba862913e9d42d7b47fcc5fd7e60924  3
c6f92564e8aa49329cdd4fbd17ecada4  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31491 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:45.712216 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:33727
I20260709 12:08:45.713610 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:45.720008 11242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.720479 11243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.721374 11245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.722837 10697 server_base.cc:1061] running on GCE node
I20260709 12:08:45.723879 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:45.724112 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:45.724291 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598925724257 us; error 0 us; skew 500 ppm
I20260709 12:08:45.724865 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:45.727622 10697 webserver.cc:533] Webserver started at http://127.10.114.126:43135/ using document root <none> and password file <none>
I20260709 12:08:45.728181 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:45.728384 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:45.728686 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:45.729948 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "aea0d79c6b514846b24da4153272ba7e"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-08l4"
I20260709 12:08:45.734978 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:45.738638 11250 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.739516 10697 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:45.739821 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "aea0d79c6b514846b24da4153272ba7e"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-08l4"
I20260709 12:08:45.740118 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:45.774798 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:45.776232 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:45.819507 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:33727
I20260709 12:08:45.819650 11301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:33727 every 8 connection(s)
I20260709 12:08:45.823949 11302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:45.836066 11302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e: Bootstrap starting.
I20260709 12:08:45.842186 11302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.847393 11302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e: No bootstrap required, opened a new log
I20260709 12:08:45.850127 11302 raft_consensus.cc:359] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER }
I20260709 12:08:45.850630 11302 raft_consensus.cc:385] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.850942 11302 raft_consensus.cc:740] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea0d79c6b514846b24da4153272ba7e, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.851758 11302 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER }
I20260709 12:08:45.852288 11302 raft_consensus.cc:399] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:45.852531 11302 raft_consensus.cc:493] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:45.852919 11302 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.857792 11302 raft_consensus.cc:515] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER }
I20260709 12:08:45.858417 11302 leader_election.cc:304] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aea0d79c6b514846b24da4153272ba7e; no voters: 
I20260709 12:08:45.859786 11302 leader_election.cc:290] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:45.860293 11305 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.861791 11305 raft_consensus.cc:697] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 1 LEADER]: Becoming Leader. State: Replica: aea0d79c6b514846b24da4153272ba7e, State: Running, Role: LEADER
I20260709 12:08:45.862538 11305 consensus_queue.cc:237] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER }
I20260709 12:08:45.863408 11302 sys_catalog.cc:565] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:45.868000 11306 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aea0d79c6b514846b24da4153272ba7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER } }
I20260709 12:08:45.868216 11307 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader aea0d79c6b514846b24da4153272ba7e. Latest consensus state: current_term: 1 leader_uuid: "aea0d79c6b514846b24da4153272ba7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea0d79c6b514846b24da4153272ba7e" member_type: VOTER } }
I20260709 12:08:45.868966 11306 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:45.869102 11307 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:45.873395 11311 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:45.878613 11311 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:45.884402 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:45.889479 11311 catalog_manager.cc:1383] Generated new cluster ID: 692c298ef3b24ffdb9b43d92d9f62715
I20260709 12:08:45.889786 11311 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:45.911433 11311 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:45.912693 11311 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:45.940061 11311 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e: Generated new TSK 0
I20260709 12:08:45.940732 11311 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:45.954397 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:45.960636 11323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.961684 11324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.963243 11326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.964110 10697 server_base.cc:1061] running on GCE node
I20260709 12:08:45.964934 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:45.965122 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:45.965247 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598925965237 us; error 0 us; skew 500 ppm
I20260709 12:08:45.965822 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:45.968302 10697 webserver.cc:533] Webserver started at http://127.10.114.65:44741/ using document root <none> and password file <none>
I20260709 12:08:45.968756 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:45.968914 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:45.969146 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:45.970279 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "8ba602336c1d4ac380a98775f2b15f3a"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-08l4"
I20260709 12:08:45.974911 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:08:45.978667 11331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.979594 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:45.979943 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "8ba602336c1d4ac380a98775f2b15f3a"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-08l4"
I20260709 12:08:45.980255 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:45.995826 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:45.997306 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:45.998915 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.001266 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.001489 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.001796 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.002002 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.045182 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:45399
I20260709 12:08:46.045342 11393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:45399 every 8 connection(s)
I20260709 12:08:46.050290 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.058531 11398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.061823 11399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.063649 10697 server_base.cc:1061] running on GCE node
W20260709 12:08:46.063692 11401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.065900 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.066212 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.066421 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598926066402 us; error 0 us; skew 500 ppm
I20260709 12:08:46.067034 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.069985 10697 webserver.cc:533] Webserver started at http://127.10.114.66:39717/ using document root <none> and password file <none>
I20260709 12:08:46.070137 11394 heartbeater.cc:344] Connected to a master server at 127.10.114.126:33727
I20260709 12:08:46.070576 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.070598 11394 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.071036 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.071374 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.071725 11394 heartbeater.cc:507] Master 127.10.114.126:33727 requested a full tablet report, sending...
I20260709 12:08:46.072628 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "3660a96e158e481eae07ef352a27919c"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-08l4"
I20260709 12:08:46.074287 11267 ts_manager.cc:194] Registered new tserver with Master: 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399)
I20260709 12:08:46.076231 11267 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34350
I20260709 12:08:46.077811 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:08:46.081686 11406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.082742 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:08:46.083045 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "3660a96e158e481eae07ef352a27919c"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-08l4"
I20260709 12:08:46.083316 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.107595 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.108997 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.110671 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.113158 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.113358 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.113724 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.113879 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.162585 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:39219
I20260709 12:08:46.162701 11468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:39219 every 8 connection(s)
I20260709 12:08:46.168020 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.175788 11472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.178030 11473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.179199 10697 server_base.cc:1061] running on GCE node
W20260709 12:08:46.180244 11475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.181509 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.181850 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.182075 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598926182056 us; error 0 us; skew 500 ppm
I20260709 12:08:46.182722 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.183115 11469 heartbeater.cc:344] Connected to a master server at 127.10.114.126:33727
I20260709 12:08:46.183542 11469 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.184569 11469 heartbeater.cc:507] Master 127.10.114.126:33727 requested a full tablet report, sending...
I20260709 12:08:46.186203 10697 webserver.cc:533] Webserver started at http://127.10.114.67:45699/ using document root <none> and password file <none>
I20260709 12:08:46.186821 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.187076 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.187172 11267 ts_manager.cc:194] Registered new tserver with Master: 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:46.187407 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.188952 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "5401d24f7636498f994916da59f82c87"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-08l4"
I20260709 12:08:46.189006 11267 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34362
I20260709 12:08:46.194495 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:08:46.198271 11480 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.199275 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:08:46.199648 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "5401d24f7636498f994916da59f82c87"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-08l4"
I20260709 12:08:46.199980 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.213616 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.214898 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.216475 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.218807 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.219050 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.219300 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.219475 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.262809 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:33047
I20260709 12:08:46.262965 11542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:33047 every 8 connection(s)
I20260709 12:08:46.279300 11543 heartbeater.cc:344] Connected to a master server at 127.10.114.126:33727
I20260709 12:08:46.279742 11543 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.280660 11543 heartbeater.cc:507] Master 127.10.114.126:33727 requested a full tablet report, sending...
I20260709 12:08:46.283205 11267 ts_manager.cc:194] Registered new tserver with Master: 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:46.283309 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01713381s
I20260709 12:08:46.284817 11267 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34364
I20260709 12:08:46.311276 11267 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34378:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:46.314479 11267 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:46.403713 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 19c4eb8c14e3463b8000a16b2d4d0220 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.405324 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c4eb8c14e3463b8000a16b2d4d0220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.406806 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb152dd1ba7479d8e632375f382edd3 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.408344 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb152dd1ba7479d8e632375f382edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.410905 11356 tablet_service.cc:1511] Processing CreateTablet for tablet bb3985fcc41b456181fb9e8cad074edc (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.411051 11434 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec1ad87f8da4fad805942e89420d02b (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.412505 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3985fcc41b456181fb9e8cad074edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.414002 11430 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1105bf404dcfaa00abab83de7215 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.414767 11433 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb152dd1ba7479d8e632375f382edd3 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.414961 11354 tablet_service.cc:1511] Processing CreateTablet for tablet ee57df0b446140df966d20424e844376 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.416425 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee57df0b446140df966d20424e844376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.416574 11429 tablet_service.cc:1511] Processing CreateTablet for tablet ee57df0b446140df966d20424e844376 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.414969 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1105bf404dcfaa00abab83de7215 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.417089 11432 tablet_service.cc:1511] Processing CreateTablet for tablet 19c4eb8c14e3463b8000a16b2d4d0220 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.404848 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec1ad87f8da4fad805942e89420d02b (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.418428 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1105bf404dcfaa00abab83de7215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.419255 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec1ad87f8da4fad805942e89420d02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.418941 11428 tablet_service.cc:1511] Processing CreateTablet for tablet 57a714516c824115b1943a9ec760a647 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.412743 11431 tablet_service.cc:1511] Processing CreateTablet for tablet bb3985fcc41b456181fb9e8cad074edc (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.412547 11434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec1ad87f8da4fad805942e89420d02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.423219 11432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c4eb8c14e3463b8000a16b2d4d0220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.423535 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 57a714516c824115b1943a9ec760a647 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.425007 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a714516c824115b1943a9ec760a647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.427013 11352 tablet_service.cc:1511] Processing CreateTablet for tablet e12f937358984b698dc6acbd7e4443f0 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.428824 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f937358984b698dc6acbd7e4443f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.429953 11428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a714516c824115b1943a9ec760a647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.430814 11433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb152dd1ba7479d8e632375f382edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.431562 11430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1105bf404dcfaa00abab83de7215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.434028 11427 tablet_service.cc:1511] Processing CreateTablet for tablet e12f937358984b698dc6acbd7e4443f0 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.435518 11427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f937358984b698dc6acbd7e4443f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.435801 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 805afbf44fdf46ce82a4b64c1b70d516 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.437325 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805afbf44fdf46ce82a4b64c1b70d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.437950 11431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3985fcc41b456181fb9e8cad074edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.439730 11426 tablet_service.cc:1511] Processing CreateTablet for tablet 805afbf44fdf46ce82a4b64c1b70d516 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.441100 11426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805afbf44fdf46ce82a4b64c1b70d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.445204 11429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee57df0b446140df966d20424e844376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.446864 11350 tablet_service.cc:1511] Processing CreateTablet for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.448228 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.455129 11508 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec1ad87f8da4fad805942e89420d02b (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.456760 11508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec1ad87f8da4fad805942e89420d02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.462646 11507 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb152dd1ba7479d8e632375f382edd3 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.464172 11507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb152dd1ba7479d8e632375f382edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.471513 11506 tablet_service.cc:1511] Processing CreateTablet for tablet 19c4eb8c14e3463b8000a16b2d4d0220 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.473055 11506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c4eb8c14e3463b8000a16b2d4d0220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.475320 11505 tablet_service.cc:1511] Processing CreateTablet for tablet bb3985fcc41b456181fb9e8cad074edc (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.476789 11505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3985fcc41b456181fb9e8cad074edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.489627 11425 tablet_service.cc:1511] Processing CreateTablet for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.491031 11425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.495714 11504 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1105bf404dcfaa00abab83de7215 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.498951 11503 tablet_service.cc:1511] Processing CreateTablet for tablet ee57df0b446140df966d20424e844376 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.503228 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 57a714516c824115b1943a9ec760a647 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.503923 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 805afbf44fdf46ce82a4b64c1b70d516 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.497409 11504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1105bf404dcfaa00abab83de7215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.507611 11499 tablet_service.cc:1511] Processing CreateTablet for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.511281 11501 tablet_service.cc:1511] Processing CreateTablet for tablet e12f937358984b698dc6acbd7e4443f0 (DEFAULT_TABLE table=test-workload [id=4f91f66f833446b092f1ab77816d5716]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.512683 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f937358984b698dc6acbd7e4443f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.540721 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee57df0b446140df966d20424e844376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.565852 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a714516c824115b1943a9ec760a647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.584177 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805afbf44fdf46ce82a4b64c1b70d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.592716 11558 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:46.596011 11559 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.602052 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef6412a5417e4b0cb6a0e98fe21fb6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.608134 11559 tablet_bootstrap.cc:654] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.610387 11560 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.627875 11558 tablet_bootstrap.cc:654] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.648258 11560 tablet_bootstrap.cc:654] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.655510 11559 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.655948 11559 ts_tablet_manager.cc:1403] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.004s
I20260709 12:08:46.656335 11558 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:46.656876 11558 ts_tablet_manager.cc:1403] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.011s
I20260709 12:08:46.661391 11560 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:46.659888 11558 raft_consensus.cc:359] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.658509 11559 raft_consensus.cc:359] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.662524 11560 ts_tablet_manager.cc:1403] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 12:08:46.662779 11558 raft_consensus.cc:385] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.662968 11559 raft_consensus.cc:385] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.663216 11558 raft_consensus.cc:740] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.663455 11559 raft_consensus.cc:740] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.664132 11558 consensus_queue.cc:260] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.664371 11559 consensus_queue.cc:260] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.666273 11560 raft_consensus.cc:359] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.667086 11560 raft_consensus.cc:385] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.667379 11560 raft_consensus.cc:740] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.667860 11559 ts_tablet_manager.cc:1434] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:08:46.668690 11394 heartbeater.cc:499] Master 127.10.114.126:33727 was elected leader, sending a full tablet report...
I20260709 12:08:46.668318 11560 consensus_queue.cc:260] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.668915 11558 ts_tablet_manager.cc:1434] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.011s
I20260709 12:08:46.669946 11558 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:46.674019 11469 heartbeater.cc:499] Master 127.10.114.126:33727 was elected leader, sending a full tablet report...
I20260709 12:08:46.675063 11543 heartbeater.cc:499] Master 127.10.114.126:33727 was elected leader, sending a full tablet report...
I20260709 12:08:46.675341 11560 ts_tablet_manager.cc:1434] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:08:46.675597 11558 tablet_bootstrap.cc:654] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.676424 11560 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.682961 11559 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.692330 11560 tablet_bootstrap.cc:654] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.693993 11559 tablet_bootstrap.cc:654] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.708299 11560 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:46.708930 11560 ts_tablet_manager.cc:1403] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.009s
I20260709 12:08:46.712033 11559 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.712281 11560 raft_consensus.cc:359] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.712870 11559 ts_tablet_manager.cc:1403] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.009s
I20260709 12:08:46.713115 11560 raft_consensus.cc:385] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.713657 11560 raft_consensus.cc:740] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.714617 11560 consensus_queue.cc:260] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.717190 11560 ts_tablet_manager.cc:1434] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:08:46.718266 11560 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.717718 11559 raft_consensus.cc:359] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.719007 11559 raft_consensus.cc:385] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.719483 11559 raft_consensus.cc:740] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.720527 11559 consensus_queue.cc:260] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.724004 11559 ts_tablet_manager.cc:1434] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:08:46.725356 11559 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.725647 11565 raft_consensus.cc:493] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.726235 11565 raft_consensus.cc:515] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.735203 11559 tablet_bootstrap.cc:654] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.740306 11565 leader_election.cc:290] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:46.749002 11559 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.749732 11559 ts_tablet_manager.cc:1403] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 12:08:46.751785 11560 tablet_bootstrap.cc:654] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.753407 11559 raft_consensus.cc:359] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.754405 11559 raft_consensus.cc:385] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.754770 11559 raft_consensus.cc:740] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.755479 11558 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:46.756081 11558 ts_tablet_manager.cc:1403] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.055s
I20260709 12:08:46.755703 11559 consensus_queue.cc:260] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.759512 11558 raft_consensus.cc:359] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.760310 11558 raft_consensus.cc:385] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.760630 11558 raft_consensus.cc:740] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.761423 11558 consensus_queue.cc:260] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.763514 11558 ts_tablet_manager.cc:1434] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:46.764524 11558 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:46.765497 11559 ts_tablet_manager.cc:1434] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:08:46.766629 11559 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.771589 11558 tablet_bootstrap.cc:654] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.774667 11559 tablet_bootstrap.cc:654] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.782047 11558 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:46.782595 11558 ts_tablet_manager.cc:1403] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 12:08:46.785109 11560 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:46.785722 11560 ts_tablet_manager.cc:1403] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.005s
I20260709 12:08:46.785809 11558 raft_consensus.cc:359] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.786413 11559 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.786695 11558 raft_consensus.cc:385] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.786929 11559 ts_tablet_manager.cc:1403] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
I20260709 12:08:46.787061 11558 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.788039 11558 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.789389 11560 raft_consensus.cc:359] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.789594 11559 raft_consensus.cc:359] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.790333 11559 raft_consensus.cc:385] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.790318 11560 raft_consensus.cc:385] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.790786 11559 raft_consensus.cc:740] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.790882 11560 raft_consensus.cc:740] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.793390 11558 ts_tablet_manager.cc:1434] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:46.793920 11560 consensus_queue.cc:260] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.794457 11558 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:46.794802 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:46.791723 11559 consensus_queue.cc:260] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.797730 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:46.798422 11444 raft_consensus.cc:2468] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
W20260709 12:08:46.799600 11333 leader_election.cc:343] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.800107 11559 ts_tablet_manager.cc:1434] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:08:46.801322 11559 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.801477 11334 leader_election.cc:304] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 5401d24f7636498f994916da59f82c87
I20260709 12:08:46.803288 11565 raft_consensus.cc:2804] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.804204 11565 raft_consensus.cc:493] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.804579 11565 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.807879 11558 tablet_bootstrap.cc:654] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.808503 11560 ts_tablet_manager.cc:1434] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:08:46.809679 11560 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.815543 11565 raft_consensus.cc:515] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.816222 11560 tablet_bootstrap.cc:654] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.818863 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:46.819572 11444 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.822821 11559 tablet_bootstrap.cc:654] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.828305 11444 raft_consensus.cc:2468] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 1.
I20260709 12:08:46.832307 11334 leader_election.cc:304] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:46.838723 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:46.839154 11565 leader_election.cc:290] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:46.840025 11565 raft_consensus.cc:2804] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.840588 11565 raft_consensus.cc:697] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
W20260709 12:08:46.840900 11333 leader_election.cc:343] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.845281 11565 consensus_queue.cc:237] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.851861 11559 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.852011 11560 tablet_bootstrap.cc:492] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:46.852906 11560 ts_tablet_manager.cc:1403] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.012s
I20260709 12:08:46.852974 11559 ts_tablet_manager.cc:1403] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.011s
I20260709 12:08:46.855388 11558 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:46.856062 11558 ts_tablet_manager.cc:1403] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.031s
I20260709 12:08:46.856544 11560 raft_consensus.cc:359] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.857394 11560 raft_consensus.cc:385] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.857844 11560 raft_consensus.cc:740] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.857420 11559 raft_consensus.cc:359] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.858745 11559 raft_consensus.cc:385] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.859297 11558 raft_consensus.cc:359] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.860069 11558 raft_consensus.cc:385] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.860370 11558 raft_consensus.cc:740] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.858906 11560 consensus_queue.cc:260] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.859315 11559 raft_consensus.cc:740] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.862006 11559 consensus_queue.cc:260] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.862823 11560 ts_tablet_manager.cc:1434] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:08:46.864007 11560 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.864233 11559 ts_tablet_manager.cc:1434] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:08:46.866762 11564 raft_consensus.cc:493] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.867105 11566 raft_consensus.cc:493] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.867236 11564 raft_consensus.cc:515] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.868144 11566 raft_consensus.cc:515] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.870190 11265 catalog_manager.cc:5697] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 1 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.872534 11564 leader_election.cc:290] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:46.873466 11559 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.865816 11558 consensus_queue.cc:260] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.887075 11583 raft_consensus.cc:493] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.895290 11566 leader_election.cc:290] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
W20260709 12:08:46.911201 11315 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:46.908025 11558 ts_tablet_manager.cc:1434] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.002s
I20260709 12:08:46.918675 11560 tablet_bootstrap.cc:654] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.899232 11583 raft_consensus.cc:515] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.923746 11558 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:46.929308 11583 leader_election.cc:290] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:46.932858 11559 tablet_bootstrap.cc:654] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.935236 11558 tablet_bootstrap.cc:654] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.947041 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
W20260709 12:08:46.948626 11408 leader_election.cc:343] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.950781 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:46.952275 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
W20260709 12:08:46.954035 11484 leader_election.cc:343] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.954259 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
W20260709 12:08:46.954705 11484 leader_election.cc:343] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.954838 11368 raft_consensus.cc:2468] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 0.
I20260709 12:08:46.956339 11410 leader_election.cc:304] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 5401d24f7636498f994916da59f82c87
I20260709 12:08:46.957437 11581 raft_consensus.cc:2804] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.958071 11581 raft_consensus.cc:493] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.958519 11581 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.960852 11560 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:46.961457 11560 ts_tablet_manager.cc:1403] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.003s
I20260709 12:08:46.964578 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:46.965884 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:46.966604 11443 raft_consensus.cc:2468] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 0.
I20260709 12:08:46.967438 11559 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:46.968019 11559 ts_tablet_manager.cc:1403] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.095s	user 0.005s	sys 0.014s
W20260709 12:08:46.966065 11483 leader_election.cc:343] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.967851 11581 raft_consensus.cc:515] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.968518 11483 leader_election.cc:304] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5401d24f7636498f994916da59f82c87; no voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:46.969385 11583 raft_consensus.cc:2749] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:46.969877 11483 leader_election.cc:304] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:46.970711 11583 raft_consensus.cc:2804] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.971112 11583 raft_consensus.cc:493] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.971478 11583 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.971961 11558 tablet_bootstrap.cc:492] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:46.972527 11558 ts_tablet_manager.cc:1403] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.012s
I20260709 12:08:46.975823 11558 raft_consensus.cc:359] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.976703 11558 raft_consensus.cc:385] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.977022 11558 raft_consensus.cc:740] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.965152 11560 raft_consensus.cc:359] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:46.978274 11560 raft_consensus.cc:385] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.978754 11560 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.979287 11559 raft_consensus.cc:359] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.980145 11559 raft_consensus.cc:385] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.979874 11560 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:46.980495 11559 raft_consensus.cc:740] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.980419 11583 raft_consensus.cc:515] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.980762 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:46.981570 11368 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.984193 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:46.981839 11559 consensus_queue.cc:260] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
W20260709 12:08:46.985877 11484 leader_election.cc:343] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.988169 11566 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.988747 11566 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:46.990343 11368 raft_consensus.cc:2468] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 1.
I20260709 12:08:46.991156 11566 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:46.988124 11559 ts_tablet_manager.cc:1434] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:08:46.991986 11560 ts_tablet_manager.cc:1434] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 12:08:46.991819 11410 leader_election.cc:304] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:46.992359 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:46.992820 11559 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:46.992926 11564 raft_consensus.cc:2804] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.977905 11558 consensus_queue.cc:260] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:46.994166 11581 leader_election.cc:290] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
W20260709 12:08:46.994692 11483 leader_election.cc:343] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.000196 11583 leader_election.cc:290] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.001259 11559 tablet_bootstrap.cc:654] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.003136 11558 ts_tablet_manager.cc:1434] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 12:08:47.004575 11558 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:47.006280 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
W20260709 12:08:47.008072 11484 leader_election.cc:343] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.008594 11484 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5401d24f7636498f994916da59f82c87; no voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.010632 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.011339 11443 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.014106 11558 tablet_bootstrap.cc:654] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.021787 11583 raft_consensus.cc:2749] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:46.995219 11560 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:46.995427 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
W20260709 12:08:47.025461 11408 leader_election.cc:343] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.028784 11559 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:47.029425 11559 ts_tablet_manager.cc:1403] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 12:08:47.032341 11443 raft_consensus.cc:2468] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 1.
I20260709 12:08:47.033763 11564 raft_consensus.cc:697] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.034044 11483 leader_election.cc:304] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.035230 11558 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:47.034847 11564 consensus_queue.cc:237] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.035437 11583 raft_consensus.cc:2804] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.036041 11558 ts_tablet_manager.cc:1403] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.014s
I20260709 12:08:47.036181 11560 tablet_bootstrap.cc:654] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.036094 11583 raft_consensus.cc:697] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:47.038245 11583 consensus_queue.cc:237] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.040195 11558 raft_consensus.cc:359] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.041600 11558 raft_consensus.cc:385] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.042112 11558 raft_consensus.cc:740] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.043336 11558 consensus_queue.cc:260] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.032872 11559 raft_consensus.cc:359] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.045240 11559 raft_consensus.cc:385] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.052457 11558 ts_tablet_manager.cc:1434] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:08:47.053731 11558 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:47.055634 11266 catalog_manager.cc:5697] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.058804 11560 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:47.058287 11265 catalog_manager.cc:5697] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.059376 11560 ts_tablet_manager.cc:1403] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.007s
I20260709 12:08:47.045754 11559 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.062741 11560 raft_consensus.cc:359] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.063663 11560 raft_consensus.cc:385] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.064052 11560 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.063781 11559 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.064946 11560 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.067106 11559 ts_tablet_manager.cc:1434] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 12:08:47.067595 11560 ts_tablet_manager.cc:1434] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:47.068230 11559 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:47.068818 11560 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:47.071017 11558 tablet_bootstrap.cc:654] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.075734 11559 tablet_bootstrap.cc:654] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.077064 11560 tablet_bootstrap.cc:654] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.088477 11560 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:47.088542 11558 tablet_bootstrap.cc:492] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:47.089025 11560 ts_tablet_manager.cc:1403] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 12:08:47.089144 11558 ts_tablet_manager.cc:1403] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.005s
I20260709 12:08:47.091934 11559 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:47.092545 11559 ts_tablet_manager.cc:1403] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:08:47.092348 11560 raft_consensus.cc:359] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.092667 11558 raft_consensus.cc:359] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.093176 11560 raft_consensus.cc:385] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.093518 11558 raft_consensus.cc:385] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.093627 11560 raft_consensus.cc:740] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.094009 11558 raft_consensus.cc:740] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.094882 11558 consensus_queue.cc:260] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.094694 11560 consensus_queue.cc:260] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.097416 11560 ts_tablet_manager.cc:1434] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:47.097455 11559 raft_consensus.cc:359] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.098361 11559 raft_consensus.cc:385] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.098677 11559 raft_consensus.cc:740] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.099892 11560 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:47.099524 11559 consensus_queue.cc:260] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.100510 11558 ts_tablet_manager.cc:1434] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:08:47.101683 11558 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:47.102192 11559 ts_tablet_manager.cc:1434] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:47.103528 11559 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:47.108035 11560 tablet_bootstrap.cc:654] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.108924 11558 tablet_bootstrap.cc:654] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.109958 11559 tablet_bootstrap.cc:654] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.121438 11558 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:47.122031 11558 ts_tablet_manager.cc:1403] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:08:47.125105 11559 tablet_bootstrap.cc:492] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:47.124958 11558 raft_consensus.cc:359] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.125885 11558 raft_consensus.cc:385] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.126103 11559 ts_tablet_manager.cc:1403] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 12:08:47.126191 11558 raft_consensus.cc:740] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.127609 11558 consensus_queue.cc:260] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.128301 11583 raft_consensus.cc:493] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.128793 11583 raft_consensus.cc:515] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.131102 11583 leader_election.cc:290] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.130961 11559 raft_consensus.cc:359] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.132427 11559 raft_consensus.cc:385] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.132895 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.132900 11559 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.133805 11368 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 0.
I20260709 12:08:47.134778 11558 ts_tablet_manager.cc:1434] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:08:47.135228 11484 leader_election.cc:304] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.134716 11559 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.136104 11558 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:47.137354 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.138109 11443 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 0.
I20260709 12:08:47.138947 11559 ts_tablet_manager.cc:1434] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:08:47.140398 11559 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: Bootstrap starting.
I20260709 12:08:47.143102 11564 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.143667 11558 tablet_bootstrap.cc:654] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.143998 11564 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.144833 11583 raft_consensus.cc:2804] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.145277 11583 raft_consensus.cc:493] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.145633 11583 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.148826 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.149562 11564 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.150136 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.150784 11518 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 0.
W20260709 12:08:47.150879 11410 leader_election.cc:343] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.152529 11408 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.153954 11564 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.154338 11564 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.154711 11564 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.158004 11559 tablet_bootstrap.cc:654] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.166041 11558 tablet_bootstrap.cc:492] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:47.166623 11558 ts_tablet_manager.cc:1403] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.002s
I20260709 12:08:47.168035 11566 raft_consensus.cc:493] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.168521 11566 raft_consensus.cc:515] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.169768 11558 raft_consensus.cc:359] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.170439 11558 raft_consensus.cc:385] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.170733 11558 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.170780 11566 leader_election.cc:290] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.171666 11558 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.172458 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef6412a5417e4b0cb6a0e98fe21fb6d6" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.173091 11368 raft_consensus.cc:2468] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 0.
I20260709 12:08:47.173508 11565 raft_consensus.cc:493] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.174007 11565 raft_consensus.cc:515] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.175299 11484 leader_election.cc:304] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.176209 11565 leader_election.cc:290] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.176836 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef6412a5417e4b0cb6a0e98fe21fb6d6" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.176275 11564 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
W20260709 12:08:47.178277 11483 leader_election.cc:343] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.180310 11594 raft_consensus.cc:493] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.180835 11594 raft_consensus.cc:515] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.181942 11564 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.184262 11594 leader_election.cc:290] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.185060 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.185760 11518 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
I20260709 12:08:47.187595 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.188130 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.188659 11517 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.188072 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.189893 11333 leader_election.cc:304] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.191654 11558 ts_tablet_manager.cc:1434] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 12:08:47.192554 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.193127 11558 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: Bootstrap starting.
I20260709 12:08:47.182821 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.190797 11566 raft_consensus.cc:2804] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.196015 11566 raft_consensus.cc:493] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.191634 11583 raft_consensus.cc:515] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.196439 11566 raft_consensus.cc:3060] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.189419 11443 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
I20260709 12:08:47.193683 11516 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 0.
I20260709 12:08:47.202716 11579 raft_consensus.cc:493] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.203339 11579 raft_consensus.cc:515] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.204698 11583 leader_election.cc:290] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.198542 11565 raft_consensus.cc:2804] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.199952 11368 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:47.200897 11410 leader_election.cc:343] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.207670 11565 raft_consensus.cc:493] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.213596 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.210208 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.214462 11565 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.218035 11369 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.214438 11444 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.221694 11564 raft_consensus.cc:493] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.222429 11564 raft_consensus.cc:515] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.223788 11408 leader_election.cc:304] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.224776 11594 raft_consensus.cc:2804] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.225158 11594 raft_consensus.cc:493] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.225493 11594 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.230326 11560 tablet_bootstrap.cc:492] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:47.230995 11560 ts_tablet_manager.cc:1403] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.041s
I20260709 12:08:47.228178 11367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.239651 11367 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 0.
I20260709 12:08:47.241312 11564 leader_election.cc:290] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.239986 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.241518 11560 raft_consensus.cc:359] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.242447 11443 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
I20260709 12:08:47.242982 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.243327 11517 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 1.
I20260709 12:08:47.244074 11410 leader_election.cc:304] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.244201 11334 leader_election.cc:304] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.245009 11564 raft_consensus.cc:2804] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.245391 11564 raft_consensus.cc:493] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.245431 11408 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:08:47.245946 11564 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.246510 11581 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.246685 11444 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 1.
I20260709 12:08:47.242421 11560 raft_consensus.cc:385] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.247481 11560 raft_consensus.cc:740] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.248436 11560 consensus_queue.cc:260] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.251971 11609 raft_consensus.cc:493] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.238986 11565 raft_consensus.cc:515] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.262537 11608 raft_consensus.cc:2804] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.263351 11608 raft_consensus.cc:493] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.263849 11608 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.262709 11483 leader_election.cc:304] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:08:47.268476 11368 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 1.
I20260709 12:08:47.252534 11516 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 0.
I20260709 12:08:47.270037 11583 raft_consensus.cc:2804] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.271034 11559 tablet_bootstrap.cc:492] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: No bootstrap required, opened a new log
I20260709 12:08:47.277503 11559 ts_tablet_manager.cc:1403] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: Time spent bootstrapping tablet: real 0.137s	user 0.033s	sys 0.019s
I20260709 12:08:47.272403 11560 ts_tablet_manager.cc:1434] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
W20260709 12:08:47.273118 11544 tablet.cc:2406] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:47.266608 11579 leader_election.cc:290] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.274686 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.275588 11565 leader_election.cc:290] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.279247 11560 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:47.286283 11558 tablet_bootstrap.cc:654] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.285957 11559 raft_consensus.cc:359] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.287935 11559 raft_consensus.cc:385] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.288348 11559 raft_consensus.cc:740] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.286746 11579 raft_consensus.cc:493] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.297799 11559 consensus_queue.cc:260] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.291249 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.289767 11581 raft_consensus.cc:697] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.301980 11583 raft_consensus.cc:697] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:47.290100 11369 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 1.
I20260709 12:08:47.304114 11594 raft_consensus.cc:515] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.305284 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.306006 11516 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.307039 11594 leader_election.cc:290] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.308255 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.281013 11564 raft_consensus.cc:515] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
W20260709 12:08:47.309870 11410 leader_election.cc:343] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.311297 11564 leader_election.cc:290] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.312260 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.312711 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.313107 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.313442 11518 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.313772 11517 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.318877 11581 consensus_queue.cc:237] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.260252 11609 raft_consensus.cc:515] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.325264 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.326181 11443 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
I20260709 12:08:47.315071 11444 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.312675 11583 consensus_queue.cc:237] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.332479 11334 leader_election.cc:304] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.340760 11559 ts_tablet_manager.cc:1434] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.025s
I20260709 12:08:47.338810 11610 raft_consensus.cc:2804] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.342353 11610 raft_consensus.cc:493] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.342824 11610 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.343098 11444 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 1.
I20260709 12:08:47.344704 11334 leader_election.cc:304] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.345659 11565 raft_consensus.cc:2804] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.346154 11609 leader_election.cc:290] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.300518 11579 raft_consensus.cc:515] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.352276 11515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.363173 11566 raft_consensus.cc:515] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.366549 11608 raft_consensus.cc:515] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.367149 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.367776 11368 raft_consensus.cc:2393] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3660a96e158e481eae07ef352a27919c in current term 1: Already voted for candidate 8ba602336c1d4ac380a98775f2b15f3a in this term.
I20260709 12:08:47.368443 11444 raft_consensus.cc:2393] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ba602336c1d4ac380a98775f2b15f3a in current term 1: Already voted for candidate 5401d24f7636498f994916da59f82c87 in this term.
I20260709 12:08:47.370766 11608 leader_election.cc:290] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.364532 11560 tablet_bootstrap.cc:654] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.373327 11565 raft_consensus.cc:697] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:47.373454 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.373562 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.374363 11444 raft_consensus.cc:2393] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ba602336c1d4ac380a98775f2b15f3a in current term 1: Already voted for candidate 3660a96e158e481eae07ef352a27919c in this term.
I20260709 12:08:47.358043 11515 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 0.
I20260709 12:08:47.368927 11517 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 1.
I20260709 12:08:47.375123 11565 consensus_queue.cc:237] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.378065 11334 leader_election.cc:304] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ba602336c1d4ac380a98775f2b15f3a; no voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87
I20260709 12:08:47.378927 11608 raft_consensus.cc:2749] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.383095 11518 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 1.
I20260709 12:08:47.384423 11408 leader_election.cc:304] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.387070 11581 raft_consensus.cc:2804] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.387907 11581 raft_consensus.cc:697] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.388029 11516 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 1.
I20260709 12:08:47.390019 11579 leader_election.cc:290] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.390771 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef6412a5417e4b0cb6a0e98fe21fb6d6" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.391434 11368 raft_consensus.cc:3060] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.389168 11581 consensus_queue.cc:237] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.395913 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.395459 11610 raft_consensus.cc:515] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.389266 11408 leader_election.cc:304] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.400753 11333 leader_election.cc:304] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ba602336c1d4ac380a98775f2b15f3a; no voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87
I20260709 12:08:47.401664 11565 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.402668 11613 raft_consensus.cc:2804] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.403199 11613 raft_consensus.cc:697] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.403414 11558 tablet_bootstrap.cc:492] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: No bootstrap required, opened a new log
I20260709 12:08:47.397451 11566 leader_election.cc:290] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.403949 11558 ts_tablet_manager.cc:1403] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.006s
I20260709 12:08:47.406275 11264 catalog_manager.cc:5697] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.412241 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.413628 11444 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.417608 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef6412a5417e4b0cb6a0e98fe21fb6d6" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.418252 11443 raft_consensus.cc:3060] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.418829 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.419467 11516 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.419694 11265 catalog_manager.cc:5697] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 1 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.422183 11444 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 1.
I20260709 12:08:47.424854 11368 raft_consensus.cc:2468] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 1.
I20260709 12:08:47.426146 11484 leader_election.cc:304] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.426764 11334 leader_election.cc:304] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.427567 11566 raft_consensus.cc:2804] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.408491 11610 leader_election.cc:290] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.404109 11613 consensus_queue.cc:237] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.431309 11608 raft_consensus.cc:2804] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.431625 11558 raft_consensus.cc:359] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.432331 11558 raft_consensus.cc:385] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.432585 11558 raft_consensus.cc:740] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.433326 11558 consensus_queue.cc:260] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.436543 11558 ts_tablet_manager.cc:1434] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:08:47.436808 11608 raft_consensus.cc:697] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:47.438630 11608 consensus_queue.cc:237] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.428573 11566 raft_consensus.cc:697] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
W20260709 12:08:47.443123 11333 consensus_peers.cc:597] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a -> Peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Couldn't send request to peer 5401d24f7636498f994916da59f82c87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.425493 11516 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 1.
I20260709 12:08:47.449785 11565 raft_consensus.cc:2749] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.451442 11443 raft_consensus.cc:2468] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 1.
I20260709 12:08:47.453286 11566 consensus_queue.cc:237] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.435439 11267 catalog_manager.cc:5697] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.458393 11565 consensus_queue.cc:1048] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.480976 11560 tablet_bootstrap.cc:492] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:47.481722 11560 ts_tablet_manager.cc:1403] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.203s	user 0.007s	sys 0.011s
I20260709 12:08:47.490294 11560 raft_consensus.cc:359] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.491439 11560 raft_consensus.cc:385] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.491814 11560 raft_consensus.cc:740] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.500279 11265 catalog_manager.cc:5697] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 1 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.492820 11560 consensus_queue.cc:260] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.508489 11560 ts_tablet_manager.cc:1434] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:08:47.511509 11560 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: Bootstrap starting.
I20260709 12:08:47.515575 11264 catalog_manager.cc:5697] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.518877 11560 tablet_bootstrap.cc:654] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.517923 11264 catalog_manager.cc:5697] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.529412 11560 tablet_bootstrap.cc:492] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: No bootstrap required, opened a new log
I20260709 12:08:47.530103 11560 ts_tablet_manager.cc:1403] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 12:08:47.532001 11566 consensus_queue.cc:1048] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.531598 11267 catalog_manager.cc:5697] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
W20260709 12:08:47.538863 11408 consensus_peers.cc:597] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c -> Peer 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047): Couldn't send request to peer 5401d24f7636498f994916da59f82c87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.533421 11560 raft_consensus.cc:359] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.540767 11560 raft_consensus.cc:385] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.541812 11560 raft_consensus.cc:740] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.543268 11560 consensus_queue.cc:260] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.546481 11560 ts_tablet_manager.cc:1434] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:08:47.562166 11583 consensus_queue.cc:1048] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.662938 11613 consensus_queue.cc:1048] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.690790 11444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:52512
I20260709 12:08:47.691489 11444 raft_consensus.cc:606] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.707036 11516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3"
dest_uuid: "5401d24f7636498f994916da59f82c87"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:48274
I20260709 12:08:47.707691 11516 raft_consensus.cc:606] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.720777 11444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:52512
I20260709 12:08:47.721335 11444 raft_consensus.cc:606] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.736672 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:37392
I20260709 12:08:47.737267 11368 raft_consensus.cc:606] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Received request to transfer leadership to TS 3660a96e158e481eae07ef352a27919c
I20260709 12:08:47.746770 11583 raft_consensus.cc:493] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.747407 11583 raft_consensus.cc:515] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.749615 11583 leader_election.cc:290] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.750456 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:47.750631 11516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516"
dest_uuid: "5401d24f7636498f994916da59f82c87"
mode: GRACEFUL
new_leader_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:48274
I20260709 12:08:47.750715 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.751185 11516 raft_consensus.cc:606] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Received request to transfer leadership to TS 3660a96e158e481eae07ef352a27919c
I20260709 12:08:47.752477 11483 leader_election.cc:304] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5401d24f7636498f994916da59f82c87; no voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:47.753314 11583 raft_consensus.cc:2749] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.777426 11617 raft_consensus.cc:493] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.778136 11617 raft_consensus.cc:515] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.779999 11617 leader_election.cc:290] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.781052 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:47.781231 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5401d24f7636498f994916da59f82c87" is_pre_election: true
I20260709 12:08:47.782285 11516 raft_consensus.cc:2393] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ba602336c1d4ac380a98775f2b15f3a in current term 1: Already voted for candidate 3660a96e158e481eae07ef352a27919c in this term.
I20260709 12:08:47.783306 11333 leader_election.cc:304] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ba602336c1d4ac380a98775f2b15f3a; no voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87
I20260709 12:08:47.784098 11617 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.789366 11617 raft_consensus.cc:2749] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.806177 11613 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.818472 11613 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.825114 11613 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.830111 11613 raft_consensus.cc:993] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:47.830691 11613 raft_consensus.cc:1081] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:47.832448 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37378
I20260709 12:08:47.833171 11368 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.833578 11368 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.838093 11581 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.840611 11368 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.843076 11368 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Requested vote from peers 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:47.843937 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.844674 11517 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.845175 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:47.845845 11444 raft_consensus.cc:3055] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.846148 11444 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.846959 11444 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.848253 11444 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.854712 11581 consensus_queue.cc:1048] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.855436 11444 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:47.856731 11334 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.857728 11617 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.858191 11617 raft_consensus.cc:697] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:47.858999 11617 consensus_queue.cc:237] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:47.860014 11517 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:47.861896 11566 consensus_queue.cc:1048] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.867413 11264 catalog_manager.cc:5697] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 1 to 2, leader changed from 3660a96e158e481eae07ef352a27919c (127.10.114.66) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 2 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.871534 11613 consensus_queue.cc:1048] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.877386 11566 consensus_queue.cc:1048] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.882805 11583 raft_consensus.cc:993] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: : Instructing follower 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:08:47.884130 11612 raft_consensus.cc:1081] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Signalling peer 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:08:47.887490 11443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:52498
I20260709 12:08:47.888648 11516 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.890184 11443 raft_consensus.cc:493] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.890622 11443 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.907207 11443 raft_consensus.cc:515] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.907769 11617 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.917162 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.917799 11369 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.917871 11443 leader_election.cc:290] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 2 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.920964 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805afbf44fdf46ce82a4b64c1b70d516" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.922029 11516 raft_consensus.cc:3055] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.922477 11516 raft_consensus.cc:740] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:47.923666 11516 consensus_queue.cc:260] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.925756 11516 raft_consensus.cc:3060] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.927922 11369 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 2.
I20260709 12:08:47.929306 11410 leader_election.cc:304] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:47.930261 11581 raft_consensus.cc:2804] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.930751 11581 raft_consensus.cc:697] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.931556 11581 consensus_queue.cc:237] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.936576 11516 raft_consensus.cc:2468] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 2.
I20260709 12:08:47.946040 11565 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.947767 11264 catalog_manager.cc:5697] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 1 to 2, leader changed from 5401d24f7636498f994916da59f82c87 (127.10.114.67) to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.954377 11617 raft_consensus.cc:993] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:08:47.954865 11565 raft_consensus.cc:1081] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Signalling peer 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:08:47.956890 11443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:52486
I20260709 12:08:47.957386 11443 raft_consensus.cc:493] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.958528 11443 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.964214 11443 raft_consensus.cc:515] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.965674 11565 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.967247 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:47.967573 11443 leader_election.cc:290] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 2 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:47.967722 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:47.968384 11517 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.967880 11369 raft_consensus.cc:3055] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.969161 11369 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:47.970255 11369 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:47.971621 11369 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.974359 11644 consensus_queue.cc:1048] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.975796 11644 consensus_queue.cc:1048] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.978440 11517 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 2.
I20260709 12:08:47.981485 11408 leader_election.cc:304] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:08:47.984454 11369 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 2.
I20260709 12:08:47.986068 11581 raft_consensus.cc:2804] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.986824 11581 raft_consensus.cc:697] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:47.986972 11617 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.987943 11581 consensus_queue.cc:237] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.003756 11517 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.010311 11265 catalog_manager.cc:5697] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 1 to 2, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.017069 11612 raft_consensus.cc:493] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3660a96e158e481eae07ef352a27919c)
I20260709 12:08:48.017699 11612 raft_consensus.cc:515] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.022054 11583 raft_consensus.cc:993] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:48.022526 11583 raft_consensus.cc:1081] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:48.022866 11612 leader_election.cc:290] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:48.023243 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3660a96e158e481eae07ef352a27919c" is_pre_election: true
I20260709 12:08:48.023741 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a" is_pre_election: true
I20260709 12:08:48.026391 11484 leader_election.cc:304] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5401d24f7636498f994916da59f82c87; no voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:08:48.027906 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37384
I20260709 12:08:48.028544 11368 raft_consensus.cc:493] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.028687 11612 raft_consensus.cc:2749] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:08:48.028952 11368 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.035408 11368 raft_consensus.cc:515] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.037406 11368 leader_election.cc:290] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:48.038162 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:48.038581 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb152dd1ba7479d8e632375f382edd3" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:48.038794 11443 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.039127 11517 raft_consensus.cc:3055] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.039444 11517 raft_consensus.cc:740] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:48.040266 11517 consensus_queue.cc:260] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.041460 11517 raft_consensus.cc:3060] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.045742 11443 raft_consensus.cc:2468] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:48.046983 11334 leader_election.cc:304] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:48.047909 11617 raft_consensus.cc:2804] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.048380 11517 raft_consensus.cc:2468] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:48.048411 11617 raft_consensus.cc:697] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:48.049583 11617 consensus_queue.cc:237] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.056427 11265 catalog_manager.cc:5697] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 1 to 2, leader changed from 5401d24f7636498f994916da59f82c87 (127.10.114.67) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 2 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.080889 11613 raft_consensus.cc:993] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:48.081418 11581 raft_consensus.cc:1081] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:08:48.083305 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37378
I20260709 12:08:48.083847 11368 raft_consensus.cc:493] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.084167 11368 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.089187 11368 raft_consensus.cc:515] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.090972 11368 leader_election.cc:290] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:08:48.091753 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:48.092208 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1105bf404dcfaa00abab83de7215" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:08:48.092417 11443 raft_consensus.cc:3055] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.092804 11517 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.092801 11443 raft_consensus.cc:740] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:08:48.093868 11443 consensus_queue.cc:260] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.094924 11443 raft_consensus.cc:3060] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.098008 11517 raft_consensus.cc:2468] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:48.099284 11333 leader_election.cc:304] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:08:48.100100 11617 raft_consensus.cc:2804] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.100654 11617 raft_consensus.cc:697] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:48.101207 11443 raft_consensus.cc:2468] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:08:48.101652 11617 consensus_queue.cc:237] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:48.108603 11265 catalog_manager.cc:5697] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 1 to 2, leader changed from 3660a96e158e481eae07ef352a27919c (127.10.114.66) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 2 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.298892 11517 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.300240 11617 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.309116 11443 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.311398 11565 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.384040 11517 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.385636 11611 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.394558 11368 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.395977 11611 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.516332 11517 raft_consensus.cc:1275] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.517594 11565 consensus_queue.cc:1048] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.527990 11443 raft_consensus.cc:1275] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.530567 11517 raft_consensus.cc:1275] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.530333 11617 consensus_queue.cc:1048] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.532066 11368 raft_consensus.cc:1275] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.532085 11613 consensus_queue.cc:1048] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:48.535392 11611 consensus_queue.cc:1048] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.563015 11517 raft_consensus.cc:1275] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.564481 11617 consensus_queue.cc:1048] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.572705 11443 raft_consensus.cc:1275] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.574739 11608 consensus_queue.cc:1048] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.786042 10697 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:50.786746 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:50.804539 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:08:50.805287 11368 raft_consensus.cc:606] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Received request to transfer leadership to TS 5401d24f7636498f994916da59f82c87
I20260709 12:08:50.808436 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:08:50.809063 11368 raft_consensus.cc:606] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Received request to transfer leadership to TS 5401d24f7636498f994916da59f82c87
I20260709 12:08:50.810243 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:50.810822 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:50.873386 11565 raft_consensus.cc:993] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:08:50.873981 11653 raft_consensus.cc:1081] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Signalling peer 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:08:50.875648 11517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:08:50.876289 11517 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.876631 11517 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.882829 11517 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:50.884500 11517 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 3 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:50.885522 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:50.885689 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:50.886230 11368 raft_consensus.cc:3055] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:50.886327 11443 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.886610 11368 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:50.887533 11368 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:50.888607 11368 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.892160 11443 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 3.
I20260709 12:08:50.893385 11368 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 3.
I20260709 12:08:50.893380 11483 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:08:50.894539 11612 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:50.895660 11612 raft_consensus.cc:697] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:50.896448 11612 consensus_queue.cc:237] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:08:50.904208 11267 catalog_manager.cc:5697] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 2 to 3, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.106251 11565 raft_consensus.cc:993] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:08:51.106767 11653 raft_consensus.cc:1081] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Signalling peer 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:08:51.108616 11517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc"
dest_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:08:51.109190 11517 raft_consensus.cc:493] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.109591 11517 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.114372 11517 raft_consensus.cc:515] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:51.116221 11517 leader_election.cc:290] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:08:51.117367 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:08:51.117486 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:08:51.118083 11443 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.118255 11368 raft_consensus.cc:3055] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.118701 11368 raft_consensus.cc:740] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:08:51.119560 11368 consensus_queue.cc:260] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:51.120685 11368 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.124187 11443 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 2.
I20260709 12:08:51.125123 11444 raft_consensus.cc:1240] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Rejecting Update request from peer 8ba602336c1d4ac380a98775f2b15f3a for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:51.125572 11483 leader_election.cc:304] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:08:51.127239 11612 raft_consensus.cc:2804] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:51.127785 11612 raft_consensus.cc:697] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:08:51.128005 11368 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 2.
I20260709 12:08:51.128672 11612 consensus_queue.cc:237] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:08:51.136674 11267 catalog_manager.cc:5697] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 1 to 2, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.326683 11368 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:51.328001 11612 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:51.338888 11444 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:51.341565 11656 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:51.660020 11444 raft_consensus.cc:1275] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:51.661782 11656 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:51.671834 11368 raft_consensus.cc:1275] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:51.673475 11656 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:51.811849 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.818743 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:51.819183 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.820379 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.828202 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.828766 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.829830 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.835309 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.835866 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.837499 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.844795 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.845304 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.846443 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.851850 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.852298 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.853488 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.859454 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.859997 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.860996 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.866474 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.866918 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.867859 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.874221 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.874656 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.875754 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.881865 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.882342 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.918308 10697 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:00.924232 11516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "5401d24f7636498f994916da59f82c87"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:48274
I20260709 12:09:00.925058 11516 raft_consensus.cc:606] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:09:00.936606 11516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc"
dest_uuid: "5401d24f7636498f994916da59f82c87"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:48274
I20260709 12:09:00.937161 11516 raft_consensus.cc:606] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:09:00.945555 11444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:52512
I20260709 12:09:00.946151 11444 raft_consensus.cc:606] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:09:00.952019 11444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57a714516c824115b1943a9ec760a647"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:52512
I20260709 12:09:00.952597 11444 raft_consensus.cc:606] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:09:00.957967 11444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
mode: GRACEFUL
new_leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:52512
I20260709 12:09:00.958545 11444 raft_consensus.cc:606] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Received request to transfer leadership to TS 8ba602336c1d4ac380a98775f2b15f3a
I20260709 12:09:01.146822 11679 raft_consensus.cc:993] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.147559 11682 raft_consensus.cc:1081] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.149747 11369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37384
I20260709 12:09:01.150331 11369 raft_consensus.cc:493] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.150730 11369 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.156694 11679 raft_consensus.cc:993] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.157219 11682 raft_consensus.cc:1081] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.158865 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37384
I20260709 12:09:01.158667 11369 raft_consensus.cc:515] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.159401 11368 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.159780 11368 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.161362 11369 leader_election.cc:290] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 3 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:01.162533 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:01.162798 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3985fcc41b456181fb9e8cad074edc" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:01.163338 11516 raft_consensus.cc:3055] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:01.163405 11444 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.163782 11516 raft_consensus.cc:740] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:09:01.165642 11516 consensus_queue.cc:260] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.166908 11516 raft_consensus.cc:3060] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.167527 11368 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:01.170625 11444 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 3.
I20260709 12:09:01.171993 11334 leader_election.cc:304] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:09:01.172700 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:01.173085 11676 raft_consensus.cc:2804] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:01.173251 11517 raft_consensus.cc:3055] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:01.173887 11517 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:09:01.174182 11516 raft_consensus.cc:2468] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 3.
I20260709 12:09:01.174798 11517 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:01.175838 11368 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 4 election: Requested vote from peers 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:09:01.176077 11517 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.175292 11676 raft_consensus.cc:697] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:01.177726 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:01.178339 11444 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.177939 11676 consensus_queue.cc:237] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.184474 11444 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 4.
I20260709 12:09:01.185514 11517 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 4.
I20260709 12:09:01.185961 11334 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:09:01.186736 11676 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:01.187170 11676 raft_consensus.cc:697] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:01.188011 11676 consensus_queue.cc:237] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:01.190094 11267 catalog_manager.cc:5697] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 2 to 3, leader changed from 5401d24f7636498f994916da59f82c87 (127.10.114.67) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 3 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.211582 11267 catalog_manager.cc:5697] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 3 to 4, leader changed from 5401d24f7636498f994916da59f82c87 (127.10.114.67) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 4 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.260035 11677 raft_consensus.cc:993] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.260668 11690 raft_consensus.cc:1081] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.262436 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57a714516c824115b1943a9ec760a647"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37378
I20260709 12:09:01.262953 11368 raft_consensus.cc:493] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.263250 11368 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.268651 11368 raft_consensus.cc:515] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.270248 11368 leader_election.cc:290] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:01.271322 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:01.271440 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a714516c824115b1943a9ec760a647" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:01.271905 11444 raft_consensus.cc:3055] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:01.271981 11517 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.272238 11444 raft_consensus.cc:740] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:09:01.273123 11444 consensus_queue.cc:260] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.274238 11444 raft_consensus.cc:3060] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.278676 11517 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:09:01.279556 11444 raft_consensus.cc:2468] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:09:01.280072 11333 leader_election.cc:304] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:09:01.280911 11676 raft_consensus.cc:2804] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:01.281404 11676 raft_consensus.cc:697] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:01.282380 11676 consensus_queue.cc:237] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.290693 11267 catalog_manager.cc:5697] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 1 to 2, leader changed from 3660a96e158e481eae07ef352a27919c (127.10.114.66) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 2 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.387769 11677 raft_consensus.cc:993] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.388295 11677 raft_consensus.cc:1081] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.390144 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37378
I20260709 12:09:01.390681 11368 raft_consensus.cc:493] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.391010 11368 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.395824 11368 raft_consensus.cc:515] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.397603 11368 leader_election.cc:290] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:01.398519 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:01.398872 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:01.399304 11444 raft_consensus.cc:3055] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:01.399446 11517 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.399696 11444 raft_consensus.cc:740] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:09:01.400774 11444 consensus_queue.cc:260] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.401904 11444 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.404762 11517 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:09:01.406018 11333 leader_election.cc:304] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:09:01.406729 11444 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 2.
I20260709 12:09:01.406908 11676 raft_consensus.cc:2804] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:01.407516 11676 raft_consensus.cc:697] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:01.408473 11676 consensus_queue.cc:237] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.417249 11267 catalog_manager.cc:5697] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 1 to 2, leader changed from 3660a96e158e481eae07ef352a27919c (127.10.114.66) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 2 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.479202 11690 raft_consensus.cc:993] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: : Instructing follower 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.479704 11677 raft_consensus.cc:1081] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Signalling peer 8ba602336c1d4ac380a98775f2b15f3a to start an election
I20260709 12:09:01.481240 11368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
 from {username='slave'} at 127.0.0.1:37378
I20260709 12:09:01.481770 11368 raft_consensus.cc:493] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.482055 11368 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.486991 11368 raft_consensus.cc:515] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.488695 11368 leader_election.cc:290] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 3 election: Requested vote from peers 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:01.489760 11444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:01.489845 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "8ba602336c1d4ac380a98775f2b15f3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:01.490340 11444 raft_consensus.cc:3055] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:01.490427 11517 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.490672 11444 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:09:01.491539 11444 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.492492 11444 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.495215 11517 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 3.
I20260709 12:09:01.496328 11333 leader_election.cc:304] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5401d24f7636498f994916da59f82c87, 8ba602336c1d4ac380a98775f2b15f3a; no voters: 
I20260709 12:09:01.497076 11676 raft_consensus.cc:2804] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:01.497479 11676 raft_consensus.cc:697] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Becoming Leader. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:01.497941 11444 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba602336c1d4ac380a98775f2b15f3a in term 3.
I20260709 12:09:01.498373 11676 consensus_queue.cc:237] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:01.506249 11267 catalog_manager.cc:5697] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a reported cstate change: term changed from 2 to 3, leader changed from 3660a96e158e481eae07ef352a27919c (127.10.114.66) to 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65). New cstate: current_term: 3 leader_uuid: "8ba602336c1d4ac380a98775f2b15f3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.571156 11444 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.572443 11676 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:01.586668 11516 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.589077 11683 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:01.628185 11517 raft_consensus.cc:1275] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.629483 11683 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.639189 11444 raft_consensus.cc:1275] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.640879 11676 consensus_queue.cc:1048] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.706869 11517 raft_consensus.cc:1275] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.708308 11676 consensus_queue.cc:1048] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:01.719802 11444 raft_consensus.cc:1275] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.721526 11676 consensus_queue.cc:1048] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:01.861932 11444 raft_consensus.cc:1275] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.863236 11676 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:01.873203 11517 raft_consensus.cc:1275] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.875558 11676 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:01.912135 11517 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.913744 11676 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.924041 11443 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Refusing update from remote peer 8ba602336c1d4ac380a98775f2b15f3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.925945 11695 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:03.999497 10697 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:04.000247 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.009275 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:09:04.009745 11368 raft_consensus.cc:606] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 LEADER]: Received request to transfer leadership to TS 3660a96e158e481eae07ef352a27919c
I20260709 12:09:04.012362 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:09:04.012789 11368 raft_consensus.cc:606] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Received request to transfer leadership to TS 5401d24f7636498f994916da59f82c87
I20260709 12:09:04.015260 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:09:04.015676 11368 raft_consensus.cc:606] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Received request to transfer leadership to TS 5401d24f7636498f994916da59f82c87
I20260709 12:09:04.018044 11368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
mode: GRACEFUL
new_leader_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:09:04.018460 11368 raft_consensus.cc:606] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Received request to transfer leadership to TS 3660a96e158e481eae07ef352a27919c
I20260709 12:09:04.019665 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:04.020287 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.039888 11709 raft_consensus.cc:993] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:09:04.040405 11710 raft_consensus.cc:1081] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Signalling peer 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:09:04.042194 11443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee57df0b446140df966d20424e844376"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:52486
I20260709 12:09:04.042727 11443 raft_consensus.cc:493] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.043001 11443 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.047883 11443 raft_consensus.cc:515] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.049944 11443 leader_election.cc:290] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 4 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:04.051033 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:09:04.051115 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee57df0b446140df966d20424e844376" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:04.051693 11368 raft_consensus.cc:3055] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:04.051878 11517 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.052073 11368 raft_consensus.cc:740] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:04.052848 11368 consensus_queue.cc:260] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.053793 11368 raft_consensus.cc:3060] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.056579 11517 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 4.
I20260709 12:09:04.057884 11408 leader_election.cc:304] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:09:04.058706 11677 raft_consensus.cc:2804] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:04.058887 11368 raft_consensus.cc:2468] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 4.
I20260709 12:09:04.059868 11677 raft_consensus.cc:697] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 4 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:09:04.060702 11677 consensus_queue.cc:237] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.068063 11267 catalog_manager.cc:5697] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 3 to 4, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 4 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:04.170964 11709 raft_consensus.cc:993] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:09:04.171547 11710 raft_consensus.cc:1081] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Signalling peer 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:09:04.173071 11517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220"
dest_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:09:04.173611 11517 raft_consensus.cc:493] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.173899 11517 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.178762 11517 raft_consensus.cc:515] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.180814 11517 leader_election.cc:290] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:09:04.181957 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:09:04.182020 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c4eb8c14e3463b8000a16b2d4d0220" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:04.182863 11443 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.182847 11368 raft_consensus.cc:3055] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:04.183383 11368 raft_consensus.cc:740] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:04.184166 11368 consensus_queue.cc:260] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.185477 11368 raft_consensus.cc:3060] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.189581 11443 raft_consensus.cc:2468] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 2.
I20260709 12:09:04.190965 11483 leader_election.cc:304] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:09:04.191406 11368 raft_consensus.cc:2468] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 2.
I20260709 12:09:04.191763 11682 raft_consensus.cc:2804] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:04.193147 11682 raft_consensus.cc:697] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:09:04.193905 11682 consensus_queue.cc:237] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.200762 11267 catalog_manager.cc:5697] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 1 to 2, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:04.243235 11709 raft_consensus.cc:993] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:09:04.243860 11710 raft_consensus.cc:1081] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 LEADER]: Signalling peer 3660a96e158e481eae07ef352a27919c to start an election
I20260709 12:09:04.245334 11443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b"
dest_uuid: "3660a96e158e481eae07ef352a27919c"
 from {username='slave'} at 127.0.0.1:52486
I20260709 12:09:04.245769 11443 raft_consensus.cc:493] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.246002 11443 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.249965 11443 raft_consensus.cc:515] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:04.251518 11443 leader_election.cc:290] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 5 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 5401d24f7636498f994916da59f82c87 (127.10.114.67:33047)
I20260709 12:09:04.252462 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:09:04.252650 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec1ad87f8da4fad805942e89420d02b" candidate_uuid: "3660a96e158e481eae07ef352a27919c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5401d24f7636498f994916da59f82c87"
I20260709 12:09:04.253155 11368 raft_consensus.cc:3055] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:04.253171 11517 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.253681 11368 raft_consensus.cc:740] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:04.254462 11368 consensus_queue.cc:260] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:04.255649 11368 raft_consensus.cc:3060] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.260476 11517 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 5.
I20260709 12:09:04.261700 11408 leader_election.cc:304] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:09:04.262372 11368 raft_consensus.cc:2468] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3660a96e158e481eae07ef352a27919c in term 5.
I20260709 12:09:04.262579 11677 raft_consensus.cc:2804] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:04.263307 11677 raft_consensus.cc:697] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 5 LEADER]: Becoming Leader. State: Replica: 3660a96e158e481eae07ef352a27919c, State: Running, Role: LEADER
I20260709 12:09:04.264076 11677 consensus_queue.cc:237] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } }
I20260709 12:09:04.271685 11267 catalog_manager.cc:5697] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c reported cstate change: term changed from 4 to 5, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 3660a96e158e481eae07ef352a27919c (127.10.114.66). New cstate: current_term: 5 leader_uuid: "3660a96e158e481eae07ef352a27919c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:04.559255 11709 raft_consensus.cc:993] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: : Instructing follower 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:09:04.559988 11710 raft_consensus.cc:1081] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Signalling peer 5401d24f7636498f994916da59f82c87 to start an election
I20260709 12:09:04.561944 11517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0"
dest_uuid: "5401d24f7636498f994916da59f82c87"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:09:04.562786 11517 raft_consensus.cc:493] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.563177 11517 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.570637 11517 raft_consensus.cc:515] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.572718 11517 leader_election.cc:290] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 3 election: Requested vote from peers 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399), 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219)
I20260709 12:09:04.574993 11368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ba602336c1d4ac380a98775f2b15f3a"
I20260709 12:09:04.575364 11443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f937358984b698dc6acbd7e4443f0" candidate_uuid: "5401d24f7636498f994916da59f82c87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3660a96e158e481eae07ef352a27919c"
I20260709 12:09:04.576058 11368 raft_consensus.cc:3055] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:04.576288 11443 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.576450 11368 raft_consensus.cc:740] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ba602336c1d4ac380a98775f2b15f3a, State: Running, Role: LEADER
I20260709 12:09:04.576989 11517 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:04.577806 11368 consensus_queue.cc:260] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.579869 11368 raft_consensus.cc:3060] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.578711 11677 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:04.587914 11443 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 3.
I20260709 12:09:04.589947 11483 leader_election.cc:304] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3660a96e158e481eae07ef352a27919c, 5401d24f7636498f994916da59f82c87; no voters: 
I20260709 12:09:04.591115 11682 raft_consensus.cc:2804] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:04.591768 11682 raft_consensus.cc:697] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Becoming Leader. State: Replica: 5401d24f7636498f994916da59f82c87, State: Running, Role: LEADER
I20260709 12:09:04.593007 11682 consensus_queue.cc:237] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } }
I20260709 12:09:04.598487 11368 raft_consensus.cc:2468] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5401d24f7636498f994916da59f82c87 in term 3.
I20260709 12:09:04.608954 11368 raft_consensus.cc:1275] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:04.613673 11711 consensus_queue.cc:1048] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:04.616739 11265 catalog_manager.cc:5697] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 reported cstate change: term changed from 2 to 3, leader changed from 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65) to 5401d24f7636498f994916da59f82c87 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "5401d24f7636498f994916da59f82c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:04.692396 11516 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 5 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.693727 11677 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5401d24f7636498f994916da59f82c87" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.699242 11368 raft_consensus.cc:1275] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 5 FOLLOWER]: Refusing update from remote peer 3660a96e158e481eae07ef352a27919c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.701579 11711 consensus_queue.cc:1048] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.702905 11443 raft_consensus.cc:1275] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:04.705755 11682 consensus_queue.cc:1048] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:04.723191 11369 raft_consensus.cc:1275] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:04.725114 11731 consensus_queue.cc:1048] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:05.021692 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.029255 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.029745 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.062883 11369 raft_consensus.cc:1275] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.064613 11731 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba602336c1d4ac380a98775f2b15f3a" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.074759 11443 raft_consensus.cc:1275] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Refusing update from remote peer 5401d24f7636498f994916da59f82c87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.077023 11682 consensus_queue.cc:1048] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3660a96e158e481eae07ef352a27919c" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:06.031158 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.037055 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.037611 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.038831 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.045151 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.045706 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.046751 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.052793 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.053238 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.054299 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.059717 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.060174 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.061291 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.068257 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.068791 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.070051 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.077104 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.077661 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.078652 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.084306 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.084700 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.085920 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.091858 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.092442 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.127736 10697 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:14.128554 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
I20260709 12:09:14.164875 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:14.165828 10697 tablet_replica.cc:333] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.166556 10697 raft_consensus.cc:2243] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.167362 10697 raft_consensus.cc:2272] T bb3985fcc41b456181fb9e8cad074edc P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.169258 10697 tablet_replica.cc:333] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.169868 10697 raft_consensus.cc:2243] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.170289 10697 raft_consensus.cc:2272] T e12f937358984b698dc6acbd7e4443f0 P 8ba602336c1d4ac380a98775f2b15f3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.171927 10697 tablet_replica.cc:333] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.172427 10697 raft_consensus.cc:2243] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.173184 10697 raft_consensus.cc:2272] T 8cb152dd1ba7479d8e632375f382edd3 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.175061 10697 tablet_replica.cc:333] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.175592 10697 raft_consensus.cc:2243] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.175978 10697 raft_consensus.cc:2272] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 8ba602336c1d4ac380a98775f2b15f3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.177779 10697 tablet_replica.cc:333] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.178298 10697 raft_consensus.cc:2243] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.178994 10697 raft_consensus.cc:2272] T 79eb1105bf404dcfaa00abab83de7215 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.180667 10697 tablet_replica.cc:333] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.181248 10697 raft_consensus.cc:2243] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.181814 10697 raft_consensus.cc:2272] T 0ec1ad87f8da4fad805942e89420d02b P 8ba602336c1d4ac380a98775f2b15f3a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.183386 10697 tablet_replica.cc:333] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.183871 10697 raft_consensus.cc:2243] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.184585 10697 raft_consensus.cc:2272] T 57a714516c824115b1943a9ec760a647 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.186399 10697 tablet_replica.cc:333] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.186913 10697 raft_consensus.cc:2243] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.187351 10697 raft_consensus.cc:2272] T ee57df0b446140df966d20424e844376 P 8ba602336c1d4ac380a98775f2b15f3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.189011 10697 tablet_replica.cc:333] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.189517 10697 raft_consensus.cc:2243] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.189971 10697 raft_consensus.cc:2272] T 805afbf44fdf46ce82a4b64c1b70d516 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.191594 10697 tablet_replica.cc:333] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a: stopping tablet replica
I20260709 12:09:14.192037 10697 raft_consensus.cc:2243] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.192436 10697 raft_consensus.cc:2272] T 19c4eb8c14e3463b8000a16b2d4d0220 P 8ba602336c1d4ac380a98775f2b15f3a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:14.204238 11484 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:09:14.209096 11484 consensus_peers.cc:597] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 -> Peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Couldn't send request to peer 8ba602336c1d4ac380a98775f2b15f3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.227526 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
I20260709 12:09:14.255016 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
W20260709 12:09:14.262319 11410 consensus_peers.cc:597] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c -> Peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Couldn't send request to peer 8ba602336c1d4ac380a98775f2b15f3a. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:45399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.293411 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:14.294248 10697 tablet_replica.cc:333] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.294842 10697 raft_consensus.cc:2243] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.295358 10697 raft_consensus.cc:2272] T bb3985fcc41b456181fb9e8cad074edc P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.297341 10697 tablet_replica.cc:333] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.297921 10697 raft_consensus.cc:2243] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.298717 10697 raft_consensus.cc:2272] T 805afbf44fdf46ce82a4b64c1b70d516 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.300632 10697 tablet_replica.cc:333] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.301167 10697 raft_consensus.cc:2243] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.301638 10697 raft_consensus.cc:2272] T 19c4eb8c14e3463b8000a16b2d4d0220 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.303416 10697 tablet_replica.cc:333] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.303943 10697 raft_consensus.cc:2243] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.304384 10697 raft_consensus.cc:2272] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 3660a96e158e481eae07ef352a27919c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.306291 10697 tablet_replica.cc:333] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.306802 10697 raft_consensus.cc:2243] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.307250 10697 raft_consensus.cc:2272] T e12f937358984b698dc6acbd7e4443f0 P 3660a96e158e481eae07ef352a27919c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.308936 10697 tablet_replica.cc:333] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.309479 10697 raft_consensus.cc:2243] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.309994 10697 raft_consensus.cc:2272] T 79eb1105bf404dcfaa00abab83de7215 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.311902 10697 tablet_replica.cc:333] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.312430 10697 raft_consensus.cc:2243] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.312858 10697 raft_consensus.cc:2272] T 8cb152dd1ba7479d8e632375f382edd3 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.315213 10697 tablet_replica.cc:333] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.315773 10697 raft_consensus.cc:2243] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.316603 10697 raft_consensus.cc:2272] T ee57df0b446140df966d20424e844376 P 3660a96e158e481eae07ef352a27919c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.319046 10697 tablet_replica.cc:333] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
W20260709 12:09:14.319530 11484 consensus_peers.cc:597] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 -> Peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Couldn't send request to peer 8ba602336c1d4ac380a98775f2b15f3a. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:45399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.319727 10697 raft_consensus.cc:2243] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.320575 10697 raft_consensus.cc:2272] T 0ec1ad87f8da4fad805942e89420d02b P 3660a96e158e481eae07ef352a27919c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.322350 10697 tablet_replica.cc:333] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c: stopping tablet replica
I20260709 12:09:14.322780 10697 raft_consensus.cc:2243] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.323168 10697 raft_consensus.cc:2272] T 57a714516c824115b1943a9ec760a647 P 3660a96e158e481eae07ef352a27919c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.346400 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
W20260709 12:09:14.347195 11483 consensus_peers.cc:597] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 -> Peer 3660a96e158e481eae07ef352a27919c (127.10.114.66:39219): Couldn't send request to peer 3660a96e158e481eae07ef352a27919c. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.367285 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
W20260709 12:09:14.380357 11484 consensus_peers.cc:597] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 -> Peer 8ba602336c1d4ac380a98775f2b15f3a (127.10.114.65:45399): Couldn't send request to peer 8ba602336c1d4ac380a98775f2b15f3a. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:45399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.400406 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:14.401188 10697 tablet_replica.cc:333] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.402029 10697 raft_consensus.cc:2243] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.402926 10697 raft_consensus.cc:2272] T 19c4eb8c14e3463b8000a16b2d4d0220 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.404876 10697 tablet_replica.cc:333] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.405426 10697 raft_consensus.cc:2243] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.405934 10697 raft_consensus.cc:2272] T 57a714516c824115b1943a9ec760a647 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.407835 10697 tablet_replica.cc:333] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.408401 10697 raft_consensus.cc:2243] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.408870 10697 raft_consensus.cc:2272] T ee57df0b446140df966d20424e844376 P 5401d24f7636498f994916da59f82c87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.410667 10697 tablet_replica.cc:333] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.411357 10697 raft_consensus.cc:2243] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.411900 10697 raft_consensus.cc:2272] T 0ec1ad87f8da4fad805942e89420d02b P 5401d24f7636498f994916da59f82c87 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.413687 10697 tablet_replica.cc:333] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.414151 10697 raft_consensus.cc:2243] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.414603 10697 raft_consensus.cc:2272] T 805afbf44fdf46ce82a4b64c1b70d516 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.416458 10697 tablet_replica.cc:333] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.416952 10697 raft_consensus.cc:2243] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.417337 10697 raft_consensus.cc:2272] T 79eb1105bf404dcfaa00abab83de7215 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.419059 10697 tablet_replica.cc:333] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.419528 10697 raft_consensus.cc:2243] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.420234 10697 raft_consensus.cc:2272] T e12f937358984b698dc6acbd7e4443f0 P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.422283 10697 tablet_replica.cc:333] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.422851 10697 raft_consensus.cc:2243] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.423645 10697 raft_consensus.cc:2272] T ef6412a5417e4b0cb6a0e98fe21fb6d6 P 5401d24f7636498f994916da59f82c87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.425398 10697 tablet_replica.cc:333] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.425930 10697 raft_consensus.cc:2243] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.426323 10697 raft_consensus.cc:2272] T 8cb152dd1ba7479d8e632375f382edd3 P 5401d24f7636498f994916da59f82c87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.427934 10697 tablet_replica.cc:333] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87: stopping tablet replica
I20260709 12:09:14.428347 10697 raft_consensus.cc:2243] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.428706 10697 raft_consensus.cc:2272] T bb3985fcc41b456181fb9e8cad074edc P 5401d24f7636498f994916da59f82c87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.458680 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:09:14.502399 10697 master.cc:562] Master@127.10.114.126:33727 shutting down...
I20260709 12:09:14.531713 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.532577 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.532943 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P aea0d79c6b514846b24da4153272ba7e: stopping tablet replica
I20260709 12:09:14.555612 10697 master.cc:584] Master@127.10.114.126:33727 shutdown complete.
3660a96e158e481eae07ef352a27919c  4
5401d24f7636498f994916da59f82c87  1
8ba602336c1d4ac380a98775f2b15f3a  5
3660a96e158e481eae07ef352a27919c  4
5401d24f7636498f994916da59f82c87  3
8ba602336c1d4ac380a98775f2b15f3a  3
3660a96e158e481eae07ef352a27919c  1
5401d24f7636498f994916da59f82c87  1
8ba602336c1d4ac380a98775f2b15f3a  8
3660a96e158e481eae07ef352a27919c  3
5401d24f7636498f994916da59f82c87  3
8ba602336c1d4ac380a98775f2b15f3a  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28895 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:14.608731 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:46571
I20260709 12:09:14.610275 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.617835 11746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.618347 11747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.619645 11749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.621115 10697 server_base.cc:1061] running on GCE node
I20260709 12:09:14.622692 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.622915 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.623106 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598954623088 us; error 0 us; skew 500 ppm
I20260709 12:09:14.623838 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.627070 10697 webserver.cc:533] Webserver started at http://127.10.114.126:45605/ using document root <none> and password file <none>
I20260709 12:09:14.627652 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.627861 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.628211 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.629889 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "5830ee4e61e44665868e20af26f32046"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.635416 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:14.639803 11754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.640897 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:14.641172 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "5830ee4e61e44665868e20af26f32046"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.641436 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.652168 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.653371 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.695199 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:46571
I20260709 12:09:14.695420 11805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:46571 every 8 connection(s)
I20260709 12:09:14.699621 11806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.710599 11806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Bootstrap starting.
I20260709 12:09:14.716121 11806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.721185 11806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: No bootstrap required, opened a new log
I20260709 12:09:14.723624 11806 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER }
I20260709 12:09:14.724128 11806 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.724315 11806 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5830ee4e61e44665868e20af26f32046, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.724839 11806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER }
I20260709 12:09:14.725308 11806 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:14.725512 11806 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:14.725857 11806 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.730700 11806 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER }
I20260709 12:09:14.731247 11806 leader_election.cc:304] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5830ee4e61e44665868e20af26f32046; no voters: 
I20260709 12:09:14.732496 11806 leader_election.cc:290] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:14.733053 11809 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.734630 11809 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 1 LEADER]: Becoming Leader. State: Replica: 5830ee4e61e44665868e20af26f32046, State: Running, Role: LEADER
I20260709 12:09:14.735435 11809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER }
I20260709 12:09:14.735724 11806 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:14.744028 11810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5830ee4e61e44665868e20af26f32046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER } }
I20260709 12:09:14.744599 11810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:14.745745 11811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5830ee4e61e44665868e20af26f32046. Latest consensus state: current_term: 1 leader_uuid: "5830ee4e61e44665868e20af26f32046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5830ee4e61e44665868e20af26f32046" member_type: VOTER } }
I20260709 12:09:14.746557 11811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:14.751370 11817 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:14.756745 11817 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:14.759125 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:14.766454 11817 catalog_manager.cc:1383] Generated new cluster ID: fb31d286848947609029f9889d4820af
I20260709 12:09:14.766772 11817 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:14.785156 11817 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:14.786563 11817 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:14.803027 11817 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Generated new TSK 0
I20260709 12:09:14.803659 11817 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:14.825881 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.832875 11827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.834110 11828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.836544 11830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.838640 10697 server_base.cc:1061] running on GCE node
I20260709 12:09:14.839792 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.840052 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.840225 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598954840201 us; error 0 us; skew 500 ppm
I20260709 12:09:14.840796 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.843569 10697 webserver.cc:533] Webserver started at http://127.10.114.65:34435/ using document root <none> and password file <none>
I20260709 12:09:14.844091 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.844300 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.844578 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.845861 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.850841 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:09:14.854717 11835 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.855806 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:14.856110 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.856396 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.867633 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.869035 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.870988 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:14.873694 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:14.873886 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.874158 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:14.874367 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.922506 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:39113
I20260709 12:09:14.922618 11897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:39113 every 8 connection(s)
I20260709 12:09:14.928282 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.936791 11902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.937309 11903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.940116 10697 server_base.cc:1061] running on GCE node
W20260709 12:09:14.940553 11905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.942198 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.942555 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.942756 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598954942737 us; error 0 us; skew 500 ppm
I20260709 12:09:14.943547 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.946475 11898 heartbeater.cc:344] Connected to a master server at 127.10.114.126:46571
I20260709 12:09:14.946897 11898 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:14.947170 10697 webserver.cc:533] Webserver started at http://127.10.114.66:45595/ using document root <none> and password file <none>
I20260709 12:09:14.947705 11898 heartbeater.cc:507] Master 127.10.114.126:46571 requested a full tablet report, sending...
I20260709 12:09:14.947803 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.948180 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.948527 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.950001 11771 ts_manager.cc:194] Registered new tserver with Master: 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:14.950083 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.951841 11771 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57548
I20260709 12:09:14.955730 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:14.959959 11910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.960937 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:14.961246 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-08l4"
I20260709 12:09:14.961519 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.981208 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.982718 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.984309 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:14.986780 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:14.987003 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.987254 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:14.987422 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.032322 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:45949
I20260709 12:09:15.032536 11972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:45949 every 8 connection(s)
I20260709 12:09:15.037298 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.044786 11976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.046921 11977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.051409 11979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.052062 10697 server_base.cc:1061] running on GCE node
I20260709 12:09:15.053117 11973 heartbeater.cc:344] Connected to a master server at 127.10.114.126:46571
I20260709 12:09:15.053275 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.053557 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.053563 11973 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.053889 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598955053868 us; error 0 us; skew 500 ppm
I20260709 12:09:15.054586 11973 heartbeater.cc:507] Master 127.10.114.126:46571 requested a full tablet report, sending...
I20260709 12:09:15.054705 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.057101 11771 ts_manager.cc:194] Registered new tserver with Master: 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:15.057811 10697 webserver.cc:533] Webserver started at http://127.10.114.67:45887/ using document root <none> and password file <none>
I20260709 12:09:15.058415 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.058673 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.058979 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.058962 11771 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57556
I20260709 12:09:15.060664 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "46f08e8ff3774f25acad18252e5cd57d"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-08l4"
I20260709 12:09:15.065487 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:09:15.070874 11984 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.071897 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:15.072245 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "46f08e8ff3774f25acad18252e5cd57d"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-08l4"
I20260709 12:09:15.072556 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.096254 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.097642 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.099253 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.101662 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.101893 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.102144 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.102326 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.147176 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:37161
I20260709 12:09:15.147460 12046 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:37161 every 8 connection(s)
I20260709 12:09:15.163218 12047 heartbeater.cc:344] Connected to a master server at 127.10.114.126:46571
I20260709 12:09:15.163861 12047 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.164816 12047 heartbeater.cc:507] Master 127.10.114.126:46571 requested a full tablet report, sending...
I20260709 12:09:15.167366 11771 ts_manager.cc:194] Registered new tserver with Master: 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:15.167830 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017288137s
I20260709 12:09:15.168900 11771 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57560
I20260709 12:09:15.196753 11771 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57572:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:15.202888 11771 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:15.437093 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd3b75a5fa040ba872559d73e67a565 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:15.439862 12011 tablet_service.cc:1511] Processing CreateTablet for tablet be722abe8c2249e0862fd29352eed5da (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:15.440339 12010 tablet_service.cc:1511] Processing CreateTablet for tablet f4f2784828ee4269bb9bb741533de573 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:15.441628 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd3b75a5fa040ba872559d73e67a565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.442507 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae562d279c44236883cb0e50643fa9c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:15.443881 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae562d279c44236883cb0e50643fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.445348 12003 tablet_service.cc:1511] Processing CreateTablet for tablet 005405ff7b534db6b4c6be122c445915 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:15.447295 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005405ff7b534db6b4c6be122c445915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.455920 12008 tablet_service.cc:1511] Processing CreateTablet for tablet cbba5e6f295144a79461c5afc2e273ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:15.456094 11862 tablet_service.cc:1511] Processing CreateTablet for tablet be722abe8c2249e0862fd29352eed5da (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:15.457846 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be722abe8c2249e0862fd29352eed5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.463376 12006 tablet_service.cc:1511] Processing CreateTablet for tablet 54f6b4dc8b6a484da6aa10c1562ab511 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:15.457651 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 6a334a018a5045c29f59fb1e4e5119ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:15.459089 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 6a334a018a5045c29f59fb1e4e5119ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:15.464843 11855 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e790dfc8a4be2938233d59465f7b8 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:15.459421 11861 tablet_service.cc:1511] Processing CreateTablet for tablet f4f2784828ee4269bb9bb741533de573 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:15.460054 11857 tablet_service.cc:1511] Processing CreateTablet for tablet 54f6b4dc8b6a484da6aa10c1562ab511 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:15.461387 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae562d279c44236883cb0e50643fa9c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:15.462389 11856 tablet_service.cc:1511] Processing CreateTablet for tablet 854cd8d1c97d4fff9b7c0600dd83259b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:15.461217 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 854cd8d1c97d4fff9b7c0600dd83259b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:15.449461 12004 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e790dfc8a4be2938233d59465f7b8 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:15.468727 11854 tablet_service.cc:1511] Processing CreateTablet for tablet 005405ff7b534db6b4c6be122c445915 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:15.463403 11859 tablet_service.cc:1511] Processing CreateTablet for tablet cbba5e6f295144a79461c5afc2e273ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:15.469431 11856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854cd8d1c97d4fff9b7c0600dd83259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.471333 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e790dfc8a4be2938233d59465f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.472049 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f6b4dc8b6a484da6aa10c1562ab511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.472368 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbba5e6f295144a79461c5afc2e273ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.472820 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd3b75a5fa040ba872559d73e67a565 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:15.474566 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd3b75a5fa040ba872559d73e67a565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.475296 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f2784828ee4269bb9bb741533de573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.477954 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae562d279c44236883cb0e50643fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.478684 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f2784828ee4269bb9bb741533de573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.477943 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854cd8d1c97d4fff9b7c0600dd83259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.479355 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a334a018a5045c29f59fb1e4e5119ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.479979 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbba5e6f295144a79461c5afc2e273ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.481298 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005405ff7b534db6b4c6be122c445915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.484700 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be722abe8c2249e0862fd29352eed5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.485954 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a334a018a5045c29f59fb1e4e5119ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.486992 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f6b4dc8b6a484da6aa10c1562ab511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.487802 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e790dfc8a4be2938233d59465f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.563001 11860 tablet_service.cc:1511] Processing CreateTablet for tablet c3402a9e1fa24f56be441155ae895d98 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.565052 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3402a9e1fa24f56be441155ae895d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.567533 11854 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed1e68af58741ceb833c997cabb45a3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.570503 12061 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:15.575941 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 99ffb9377dca4ebd94a32fd00a581fb5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.576314 11855 tablet_service.cc:1511] Processing CreateTablet for tablet 99ffb9377dca4ebd94a32fd00a581fb5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.578002 12062 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:15.579952 11863 tablet_service.cc:1511] Processing CreateTablet for tablet b6b73f446b5a4a9891731cc5f2c0877f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.581789 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed1e68af58741ceb833c997cabb45a3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.592973 12007 tablet_service.cc:1511] Processing CreateTablet for tablet b6b73f446b5a4a9891731cc5f2c0877f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.582489 12004 tablet_service.cc:1511] Processing CreateTablet for tablet c3402a9e1fa24f56be441155ae895d98 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.599259 11857 tablet_service.cc:1511] Processing CreateTablet for tablet 198dd765f8a54a299a0558eccc0f684f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.604512 11859 tablet_service.cc:1511] Processing CreateTablet for tablet b00e47b0acb44843a177246087e87ffd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.577461 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ffb9377dca4ebd94a32fd00a581fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.614830 12061 tablet_bootstrap.cc:654] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.615491 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd3b75a5fa040ba872559d73e67a565 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:15.616923 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd3b75a5fa040ba872559d73e67a565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.618710 11937 tablet_service.cc:1511] Processing CreateTablet for tablet be722abe8c2249e0862fd29352eed5da (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:15.620153 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be722abe8c2249e0862fd29352eed5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.619928 11932 tablet_service.cc:1511] Processing CreateTablet for tablet 54f6b4dc8b6a484da6aa10c1562ab511 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:15.621227 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f6b4dc8b6a484da6aa10c1562ab511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.622210 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed1e68af58741ceb833c997cabb45a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.622294 11936 tablet_service.cc:1511] Processing CreateTablet for tablet f4f2784828ee4269bb9bb741533de573 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:15.624502 11930 tablet_service.cc:1511] Processing CreateTablet for tablet eb3e790dfc8a4be2938233d59465f7b8 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:15.626794 11929 tablet_service.cc:1511] Processing CreateTablet for tablet 005405ff7b534db6b4c6be122c445915 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:15.629367 11934 tablet_service.cc:1511] Processing CreateTablet for tablet cbba5e6f295144a79461c5afc2e273ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:15.630127 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3402a9e1fa24f56be441155ae895d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.622709 11931 tablet_service.cc:1511] Processing CreateTablet for tablet 854cd8d1c97d4fff9b7c0600dd83259b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:15.618713 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 6a334a018a5045c29f59fb1e4e5119ae (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:15.616789 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae562d279c44236883cb0e50643fa9c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:15.637876 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e790dfc8a4be2938233d59465f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.646920 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbba5e6f295144a79461c5afc2e273ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.649895 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f2784828ee4269bb9bb741533de573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.650628 11929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005405ff7b534db6b4c6be122c445915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.652470 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854cd8d1c97d4fff9b7c0600dd83259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.653654 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a334a018a5045c29f59fb1e4e5119ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.657778 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae562d279c44236883cb0e50643fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.687983 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b73f446b5a4a9891731cc5f2c0877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.688606 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed1e68af58741ceb833c997cabb45a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.689909 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ffb9377dca4ebd94a32fd00a581fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.690405 12012 tablet_service.cc:1511] Processing CreateTablet for tablet b00e47b0acb44843a177246087e87ffd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.691450 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198dd765f8a54a299a0558eccc0f684f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.700523 12008 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb8ee4e7b34277ac74a869a9f66f97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.702227 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb8ee4e7b34277ac74a869a9f66f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.702098 11934 tablet_service.cc:1511] Processing CreateTablet for tablet b6b73f446b5a4a9891731cc5f2c0877f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.703590 11856 tablet_service.cc:1511] Processing CreateTablet for tablet bf27a0b964974f51bc07dec427f3a190 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.704830 11856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf27a0b964974f51bc07dec427f3a190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.702116 11858 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb8ee4e7b34277ac74a869a9f66f97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.710199 12010 tablet_service.cc:1511] Processing CreateTablet for tablet bf27a0b964974f51bc07dec427f3a190 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.703627 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b73f446b5a4a9891731cc5f2c0877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.710295 11862 tablet_service.cc:1511] Processing CreateTablet for tablet a431e9f3bc6146ccbaa801baac0eeb37 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.713500 12005 tablet_service.cc:1511] Processing CreateTablet for tablet a431e9f3bc6146ccbaa801baac0eeb37 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.715138 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00e47b0acb44843a177246087e87ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.715909 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf27a0b964974f51bc07dec427f3a190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.705951 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 198dd765f8a54a299a0558eccc0f684f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.718938 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198dd765f8a54a299a0558eccc0f684f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.719901 12063 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:15.730131 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a431e9f3bc6146ccbaa801baac0eeb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.734432 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00e47b0acb44843a177246087e87ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.735451 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b73f446b5a4a9891731cc5f2c0877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.738742 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb8ee4e7b34277ac74a869a9f66f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.741840 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a431e9f3bc6146ccbaa801baac0eeb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.744551 12006 tablet_service.cc:1511] Processing CreateTablet for tablet c21839ab34e84260a341ab0c1eeab564 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:15.747442 12003 tablet_service.cc:1511] Processing CreateTablet for tablet 628666a2024d4a61831835e7dee5737a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.763083 11861 tablet_service.cc:1511] Processing CreateTablet for tablet c21839ab34e84260a341ab0c1eeab564 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 12:09:15.766891 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:15.774277 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21839ab34e84260a341ab0c1eeab564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.782618 11938 tablet_service.cc:1511] Processing CreateTablet for tablet c3402a9e1fa24f56be441155ae895d98 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.784096 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3402a9e1fa24f56be441155ae895d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.788728 11929 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed1e68af58741ceb833c997cabb45a3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.800094 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 198dd765f8a54a299a0558eccc0f684f (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.793017 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 99ffb9377dca4ebd94a32fd00a581fb5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.803205 11855 tablet_service.cc:1511] Processing CreateTablet for tablet 628666a2024d4a61831835e7dee5737a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.784185 12062 tablet_bootstrap.cc:654] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.818046 11929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed1e68af58741ceb833c997cabb45a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.820230 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ffb9377dca4ebd94a32fd00a581fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.807729 12061 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:15.821933 12061 ts_tablet_manager.cc:1403] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.252s	user 0.008s	sys 0.008s
I20260709 12:09:15.824911 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198dd765f8a54a299a0558eccc0f684f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.809996 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628666a2024d4a61831835e7dee5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.811656 12063 tablet_bootstrap.cc:654] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.813117 11933 tablet_service.cc:1511] Processing CreateTablet for tablet b00e47b0acb44843a177246087e87ffd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.814884 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 72e0c467da954999a14a9ba2a9af25b9 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.832398 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e0c467da954999a14a9ba2a9af25b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.833698 12061 raft_consensus.cc:359] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:15.834522 12061 raft_consensus.cc:385] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.815827 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21839ab34e84260a341ab0c1eeab564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.834832 12061 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.835256 11931 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb8ee4e7b34277ac74a869a9f66f97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.835867 12061 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:15.836609 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb8ee4e7b34277ac74a869a9f66f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.840368 11930 tablet_service.cc:1511] Processing CreateTablet for tablet bf27a0b964974f51bc07dec427f3a190 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.842357 11932 tablet_service.cc:1511] Processing CreateTablet for tablet a431e9f3bc6146ccbaa801baac0eeb37 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.844497 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 92c36db79b9b44bf9225011eaecc17c4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.840365 12007 tablet_service.cc:1511] Processing CreateTablet for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:15.854934 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.855185 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628666a2024d4a61831835e7dee5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.859452 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 0061f3d1f1a748729a1af7a6da2ecbb2 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:15.860848 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0061f3d1f1a748729a1af7a6da2ecbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.844497 12008 tablet_service.cc:1511] Processing CreateTablet for tablet 92c36db79b9b44bf9225011eaecc17c4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.862767 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c36db79b9b44bf9225011eaecc17c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.849186 11854 tablet_service.cc:1511] Processing CreateTablet for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:15.850649 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 72e0c467da954999a14a9ba2a9af25b9 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.862804 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c36db79b9b44bf9225011eaecc17c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.848124 12004 tablet_service.cc:1511] Processing CreateTablet for tablet 4755afb6a253477badd7f673bff77faa (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:15.869869 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a431e9f3bc6146ccbaa801baac0eeb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.870456 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4755afb6a253477badd7f673bff77faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.872500 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00e47b0acb44843a177246087e87ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.874099 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e0c467da954999a14a9ba2a9af25b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.874680 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c59801bf644679a9e155c914bbc97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:15.878823 11857 tablet_service.cc:1511] Processing CreateTablet for tablet 4755afb6a253477badd7f673bff77faa (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:15.893165 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf27a0b964974f51bc07dec427f3a190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.892257 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c59801bf644679a9e155c914bbc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.890497 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 72e0c467da954999a14a9ba2a9af25b9 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.901975 12010 tablet_service.cc:1511] Processing CreateTablet for tablet 8673bd187fa94b98baa982f36c6d2102 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:15.905784 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4755afb6a253477badd7f673bff77faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.913043 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.927309 12047 heartbeater.cc:499] Master 127.10.114.126:46571 was elected leader, sending a full tablet report...
I20260709 12:09:15.938405 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8673bd187fa94b98baa982f36c6d2102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.920897 12006 tablet_service.cc:1511] Processing CreateTablet for tablet 1867813aeb8b457984895a6ccb759346 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:15.949010 12063 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:15.949579 12063 ts_tablet_manager.cc:1403] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.230s	user 0.017s	sys 0.004s
I20260709 12:09:15.954663 11898 heartbeater.cc:499] Master 127.10.114.126:46571 was elected leader, sending a full tablet report...
I20260709 12:09:15.952445 12063 raft_consensus.cc:359] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:15.955837 12063 raft_consensus.cc:385] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.956171 12063 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.954273 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e0c467da954999a14a9ba2a9af25b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.952803 12061 ts_tablet_manager.cc:1434] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.130s	user 0.017s	sys 0.000s
I20260709 12:09:15.958986 12061 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:15.961896 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1867813aeb8b457984895a6ccb759346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.963208 12063 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:15.939035 11856 tablet_service.cc:1511] Processing CreateTablet for tablet 0061f3d1f1a748729a1af7a6da2ecbb2 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:15.970883 11856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0061f3d1f1a748729a1af7a6da2ecbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.974572 12062 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:15.965138 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 628666a2024d4a61831835e7dee5737a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.975173 12062 ts_tablet_manager.cc:1403] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.398s	user 0.014s	sys 0.008s
I20260709 12:09:15.975888 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628666a2024d4a61831835e7dee5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.980038 11929 tablet_service.cc:1511] Processing CreateTablet for tablet 92c36db79b9b44bf9225011eaecc17c4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.981331 11929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c36db79b9b44bf9225011eaecc17c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.983861 12061 tablet_bootstrap.cc:654] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.986557 11934 tablet_service.cc:1511] Processing CreateTablet for tablet c21839ab34e84260a341ab0c1eeab564 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:15.994451 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21839ab34e84260a341ab0c1eeab564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.002944 12062 raft_consensus.cc:359] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:16.003825 12062 raft_consensus.cc:385] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.004128 12062 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.005187 12062 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:16.008857 12005 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923a6db4400eb4027dc16134d310 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.010366 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923a6db4400eb4027dc16134d310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.032526 11973 heartbeater.cc:499] Master 127.10.114.126:46571 was elected leader, sending a full tablet report...
I20260709 12:09:16.035146 11932 tablet_service.cc:1511] Processing CreateTablet for tablet 4755afb6a253477badd7f673bff77faa (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.042177 11861 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c59801bf644679a9e155c914bbc97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.043618 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c59801bf644679a9e155c914bbc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.050509 11938 tablet_service.cc:1511] Processing CreateTablet for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.051738 11863 tablet_service.cc:1511] Processing CreateTablet for tablet ecd86af74b304d58a84939321319d52b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.046609 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4755afb6a253477badd7f673bff77faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.053174 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd86af74b304d58a84939321319d52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.063555 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.067539 11862 tablet_service.cc:1511] Processing CreateTablet for tablet 1867813aeb8b457984895a6ccb759346 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.069104 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1867813aeb8b457984895a6ccb759346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.069000 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 8673bd187fa94b98baa982f36c6d2102 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.070506 12063 ts_tablet_manager.cc:1434] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.005s
I20260709 12:09:16.071609 12063 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:16.070546 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8673bd187fa94b98baa982f36c6d2102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.074082 12061 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:16.074666 12061 ts_tablet_manager.cc:1403] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.116s	user 0.006s	sys 0.017s
I20260709 12:09:16.075203 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 6dded4de56124928b0b4c23213e34af4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.076651 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dded4de56124928b0b4c23213e34af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.071746 12003 tablet_service.cc:1511] Processing CreateTablet for tablet ecd86af74b304d58a84939321319d52b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.079509 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd86af74b304d58a84939321319d52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.082496 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 8673bd187fa94b98baa982f36c6d2102 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.084154 11931 tablet_service.cc:1511] Processing CreateTablet for tablet 0061f3d1f1a748729a1af7a6da2ecbb2 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.075007 11854 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923a6db4400eb4027dc16134d310 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.093923 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923a6db4400eb4027dc16134d310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.084169 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8673bd187fa94b98baa982f36c6d2102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.104833 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0061f3d1f1a748729a1af7a6da2ecbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.106755 12062 ts_tablet_manager.cc:1434] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.131s	user 0.019s	sys 0.018s
I20260709 12:09:16.108006 12062 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:16.114444 11934 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c59801bf644679a9e155c914bbc97 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.116010 11930 tablet_service.cc:1511] Processing CreateTablet for tablet 1867813aeb8b457984895a6ccb759346 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.126542 12061 raft_consensus.cc:359] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.127375 12061 raft_consensus.cc:385] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.127691 12061 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.128468 12061 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.129904 12068 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.133924 12068 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.131029 12006 tablet_service.cc:1511] Processing CreateTablet for tablet a1d0a2103114406e9d43b045cd4acfe0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.153165 12061 ts_tablet_manager.cc:1434] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.002s
I20260709 12:09:16.153271 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1867813aeb8b457984895a6ccb759346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.153656 12066 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.154155 12066 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.154829 12004 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcc1200587447cb913298cc7ed8c931 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.157240 12062 tablet_bootstrap.cc:654] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.157691 12063 tablet_bootstrap.cc:654] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.137391 11933 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923a6db4400eb4027dc16134d310 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.164929 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 6dded4de56124928b0b4c23213e34af4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.165723 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923a6db4400eb4027dc16134d310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.166874 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dded4de56124928b0b4c23213e34af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.167959 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c59801bf644679a9e155c914bbc97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.178009 11855 tablet_service.cc:1511] Processing CreateTablet for tablet a1d0a2103114406e9d43b045cd4acfe0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.184836 11937 tablet_service.cc:1511] Processing CreateTablet for tablet ecd86af74b304d58a84939321319d52b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.188549 11860 tablet_service.cc:1511] Processing CreateTablet for tablet f845a1dd30e04dccb21da2a17ebf1415 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.190249 12066 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:16.206511 12068 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:16.215495 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d0a2103114406e9d43b045cd4acfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.226899 12061 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:16.231865 12007 tablet_service.cc:1511] Processing CreateTablet for tablet f845a1dd30e04dccb21da2a17ebf1415 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.236994 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd86af74b304d58a84939321319d52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.236222 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d0a2103114406e9d43b045cd4acfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.276433 12061 tablet_bootstrap.cc:654] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.294456 12008 tablet_service.cc:1511] Processing CreateTablet for tablet e4f11d66c6904b2bb34a6291c444fbcd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:16.296350 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f845a1dd30e04dccb21da2a17ebf1415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.300313 11856 tablet_service.cc:1511] Processing CreateTablet for tablet e4f11d66c6904b2bb34a6291c444fbcd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:16.301373 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcc1200587447cb913298cc7ed8c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.302709 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f845a1dd30e04dccb21da2a17ebf1415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.303121 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:16.304896 11914 leader_election.cc:343] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.220813 11861 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcc1200587447cb913298cc7ed8c931 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.320472 12063 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:16.325821 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f11d66c6904b2bb34a6291c444fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.346619 11854 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361e6345864efa81f207f2a9dafda0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:16.325016 12063 ts_tablet_manager.cc:1403] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.254s	user 0.022s	sys 0.008s
I20260709 12:09:16.328459 11856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f11d66c6904b2bb34a6291c444fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.369419 12062 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:16.373528 12062 ts_tablet_manager.cc:1403] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.266s	user 0.026s	sys 0.035s
I20260709 12:09:16.378240 11931 tablet_service.cc:1511] Processing CreateTablet for tablet 6dded4de56124928b0b4c23213e34af4 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.384841 11857 tablet_service.cc:1511] Processing CreateTablet for tablet c0a71dd6e2e74227b7e93c1026aa2e8d (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:16.388374 11935 tablet_service.cc:1511] Processing CreateTablet for tablet f845a1dd30e04dccb21da2a17ebf1415 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.401927 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcc1200587447cb913298cc7ed8c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.407721 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:16.408845 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361e6345864efa81f207f2a9dafda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.388938 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dded4de56124928b0b4c23213e34af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.411428 12062 raft_consensus.cc:359] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.412238 12062 raft_consensus.cc:385] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.412001 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcc1200587447cb913298cc7ed8c931 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.412549 12062 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.426713 12063 raft_consensus.cc:359] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:16.427635 12063 raft_consensus.cc:385] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.427994 12063 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.414702 12062 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.432535 12070 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.433092 12070 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:16.428913 12063 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:16.402091 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:16.448472 12070 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:16.459060 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361e6345864efa81f207f2a9dafda0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:16.459491 12061 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:16.460227 12061 ts_tablet_manager.cc:1403] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.237s	user 0.000s	sys 0.022s
I20260709 12:09:16.460752 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361e6345864efa81f207f2a9dafda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.462874 11938 tablet_service.cc:1511] Processing CreateTablet for tablet e4f11d66c6904b2bb34a6291c444fbcd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:16.463454 12061 raft_consensus.cc:359] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.464275 12061 raft_consensus.cc:385] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.464613 12061 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.465667 12063 ts_tablet_manager.cc:1434] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.005s
I20260709 12:09:16.476573 11855 tablet_service.cc:1511] Processing CreateTablet for tablet eba16e46f4d34fb7a53a7a797485a99c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:16.465415 12061 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.479128 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:16.479291 12003 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:16.480677 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.481097 12012 tablet_service.cc:1511] Processing CreateTablet for tablet eba16e46f4d34fb7a53a7a797485a99c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:16.481294 12061 ts_tablet_manager.cc:1434] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:09:16.483043 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba16e46f4d34fb7a53a7a797485a99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.483305 12005 tablet_service.cc:1511] Processing CreateTablet for tablet c0a71dd6e2e74227b7e93c1026aa2e8d (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:16.483572 12010 tablet_service.cc:1511] Processing CreateTablet for tablet f31959fa0f994ee8a9587eb78cb124b3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:16.484664 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a71dd6e2e74227b7e93c1026aa2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.489928 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31959fa0f994ee8a9587eb78cb124b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.490202 12063 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:16.493742 12007 tablet_service.cc:1511] Processing CreateTablet for tablet b76f90dd7ad649d99cfdaddca2c38694 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:16.494359 12061 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:16.494449 12062 ts_tablet_manager.cc:1434] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 12:09:16.495162 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f90dd7ad649d99cfdaddca2c38694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.500728 11929 tablet_service.cc:1511] Processing CreateTablet for tablet a1d0a2103114406e9d43b045cd4acfe0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.501981 12004 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff67aad7c28488cbcaa11428b8d0954 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:16.503391 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:16.510164 11988 leader_election.cc:343] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.513057 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:16.510166 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff67aad7c28488cbcaa11428b8d0954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.515829 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.440135 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.517220 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.437621 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f845a1dd30e04dccb21da2a17ebf1415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.520372 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f11d66c6904b2bb34a6291c444fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.521000 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcc1200587447cb913298cc7ed8c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.523792 11929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d0a2103114406e9d43b045cd4acfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.525858 12061 tablet_bootstrap.cc:654] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.525516 11932 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361e6345864efa81f207f2a9dafda0 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:16.527082 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361e6345864efa81f207f2a9dafda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.530758 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:16.532140 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5cd0fe2cf34ab5817d4b21dcbec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.505029 11930 tablet_service.cc:1511] Processing CreateTablet for tablet eba16e46f4d34fb7a53a7a797485a99c (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:09:16.535523 11914 leader_election.cc:343] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.540493 12062 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:16.540936 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:16.541596 12008 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f6fbe75cb413188e56f5338fb4c05 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.541229 11862 tablet_service.cc:1511] Processing CreateTablet for tablet f31959fa0f994ee8a9587eb78cb124b3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:16.542263 12068 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.542850 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f6fbe75cb413188e56f5338fb4c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.543184 12012 tablet_service.cc:1511] Processing CreateTablet for tablet d10ddce6896a49a8a2a9ec09702f3ec1 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.544963 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10ddce6896a49a8a2a9ec09702f3ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.546123 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba16e46f4d34fb7a53a7a797485a99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.547808 11931 tablet_service.cc:1511] Processing CreateTablet for tablet c0a71dd6e2e74227b7e93c1026aa2e8d (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:16.549257 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a71dd6e2e74227b7e93c1026aa2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.538892 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a71dd6e2e74227b7e93c1026aa2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.551347 12006 tablet_service.cc:1511] Processing CreateTablet for tablet 246d42c8e70c46dca72a4d8848a218d7 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.551615 11934 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:16.552652 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246d42c8e70c46dca72a4d8848a218d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.544879 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff67aad7c28488cbcaa11428b8d0954 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:16.566255 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba16e46f4d34fb7a53a7a797485a99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.573724 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31959fa0f994ee8a9587eb78cb124b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.574119 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff67aad7c28488cbcaa11428b8d0954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.575126 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70a3c0cc664c8cb6b298c2c4ab5441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.579538 12063 tablet_bootstrap.cc:654] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.588028 12066 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.588605 12066 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.590816 12066 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:16.592834 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:16.595477 11988 leader_election.cc:343] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.607926 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff67aad7c28488cbcaa11428b8d0954 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:16.609836 11861 tablet_service.cc:1511] Processing CreateTablet for tablet b76f90dd7ad649d99cfdaddca2c38694 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:16.612342 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f6fbe75cb413188e56f5338fb4c05 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.627197 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb55752b27445c8dee19903f9e6d41 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.627602 12005 tablet_service.cc:1511] Processing CreateTablet for tablet f35e2d3e5b034ad6adcc494a92b92886 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:16.628582 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb55752b27445c8dee19903f9e6d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.630374 12010 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee46b14be8c4a1a99faf37e6697390a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.631631 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee46b14be8c4a1a99faf37e6697390a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.635862 11856 tablet_service.cc:1511] Processing CreateTablet for tablet d10ddce6896a49a8a2a9ec09702f3ec1 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.638257 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff67aad7c28488cbcaa11428b8d0954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.638520 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:16.639525 11873 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:16.642015 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:16.642131 12009 tablet_service.cc:1511] Processing CreateTablet for tablet d6df9d20345c49f0a6f00d9f5f660140 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:16.642452 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:16.643527 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6df9d20345c49f0a6f00d9f5f660140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.643754 12066 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.643955 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f90dd7ad649d99cfdaddca2c38694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.644210 12066 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.644575 12066 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.652860 12004 tablet_service.cc:1511] Processing CreateTablet for tablet efa456bf4db9474f84e2e5a51c919032 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.653779 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35e2d3e5b034ad6adcc494a92b92886. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:16.653388 11988 leader_election.cc:343] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.661878 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:16.656325 12062 tablet_bootstrap.cc:654] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.652957 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:16.666836 12003 tablet_service.cc:1511] Processing CreateTablet for tablet 0bace639158f425898b2859f751fc2cd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:16.668990 11934 tablet_service.cc:1511] Processing CreateTablet for tablet f31959fa0f994ee8a9587eb78cb124b3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:16.675395 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31959fa0f994ee8a9587eb78cb124b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.677136 12066 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.689735 12063 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:16.690300 12063 ts_tablet_manager.cc:1403] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.035s
I20260709 12:09:16.694808 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bace639158f425898b2859f751fc2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.698796 12066 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:16.699451 12066 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.705868 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa456bf4db9474f84e2e5a51c919032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.705663 11938 tablet_service.cc:1511] Processing CreateTablet for tablet b76f90dd7ad649d99cfdaddca2c38694 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:16.706988 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f90dd7ad649d99cfdaddca2c38694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.696099 12061 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:16.707926 12061 ts_tablet_manager.cc:1403] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.214s	user 0.001s	sys 0.018s
I20260709 12:09:16.712459 12061 raft_consensus.cc:359] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.712886 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4f6fbe75cb413188e56f5338fb4c05 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.713268 12061 raft_consensus.cc:385] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.701298 12066 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.693527 12063 raft_consensus.cc:359] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.731967 12061 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.732244 12063 raft_consensus.cc:385] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.732645 12063 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.732880 12061 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.733423 12063 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.734603 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 79900041d3b94f09a8d4b882957a37c3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:16.735206 12061 ts_tablet_manager.cc:1434] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:09:16.687976 11856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10ddce6896a49a8a2a9ec09702f3ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.724045 11858 tablet_service.cc:1511] Processing CreateTablet for tablet d6df9d20345c49f0a6f00d9f5f660140 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:16.741238 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f6fbe75cb413188e56f5338fb4c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.741671 11854 tablet_service.cc:1511] Processing CreateTablet for tablet 246d42c8e70c46dca72a4d8848a218d7 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.739109 12066 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.747784 12061 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:16.748111 12063 ts_tablet_manager.cc:1434] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 12:09:16.749224 12063 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:16.749483 12066 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:16.681833 12011 tablet_service.cc:1511] Processing CreateTablet for tablet b93a2cf326204d8e89e4fe76ead348c5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:16.757243 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:16.758021 11948 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
W20260709 12:09:16.752628 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 99278.1us
I20260709 12:09:16.765830 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:16.766929 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6df9d20345c49f0a6f00d9f5f660140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.781209 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79900041d3b94f09a8d4b882957a37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.785748 12061 tablet_bootstrap.cc:654] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.847638 12063 tablet_bootstrap.cc:654] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:16.777307 11839 leader_election.cc:343] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.776891 12070 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.812755 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 246d42c8e70c46dca72a4d8848a218d7 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.851019 11930 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb55752b27445c8dee19903f9e6d41 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.851826 12010 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8660209a034cd2a004c54e65aa0b9b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:16.853899 12062 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:16.854126 11934 tablet_service.cc:1511] Processing CreateTablet for tablet f35e2d3e5b034ad6adcc494a92b92886 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:09:16.868636 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 91356.2us
I20260709 12:09:16.854547 11932 tablet_service.cc:1511] Processing CreateTablet for tablet d6df9d20345c49f0a6f00d9f5f660140 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:16.869144 12062 ts_tablet_manager.cc:1403] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.027s
I20260709 12:09:16.851769 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f6fbe75cb413188e56f5338fb4c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.859344 11855 tablet_service.cc:1511] Processing CreateTablet for tablet efa456bf4db9474f84e2e5a51c919032 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.782781 12003 tablet_service.cc:1511] Processing CreateTablet for tablet 895f46e6dc144b38be8e04b5aac35a2e (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:16.874533 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:16.875108 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa456bf4db9474f84e2e5a51c919032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.859866 11857 tablet_service.cc:1511] Processing CreateTablet for tablet b93a2cf326204d8e89e4fe76ead348c5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:09:16.772473 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.799443 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb26c79d86d449786430b604fee9561 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:16.887738 12062 raft_consensus.cc:359] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.888662 12062 raft_consensus.cc:385] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.889012 12062 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.890143 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93a2cf326204d8e89e4fe76ead348c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.890713 11929 tablet_service.cc:1511] Processing CreateTablet for tablet efa456bf4db9474f84e2e5a51c919032 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.789130 11861 tablet_service.cc:1511] Processing CreateTablet for tablet f35e2d3e5b034ad6adcc494a92b92886 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:16.864090 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93a2cf326204d8e89e4fe76ead348c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.864264 12070 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.785068 11935 tablet_service.cc:1511] Processing CreateTablet for tablet d10ddce6896a49a8a2a9ec09702f3ec1 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.787117 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:16.790274 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:16.904260 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee46b14be8c4a1a99faf37e6697390a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.870597 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:16.905511 11873 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:16.905884 11988 leader_election.cc:343] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.906798 11931 tablet_service.cc:1511] Processing CreateTablet for tablet b93a2cf326204d8e89e4fe76ead348c5 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:09:16.907428 11988 leader_election.cc:343] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.908022 12070 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.908097 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35e2d3e5b034ad6adcc494a92b92886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.808892 12004 tablet_service.cc:1511] Processing CreateTablet for tablet b2c1fe07352d4472a01fce46f98ce1a6 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:16.877564 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee46b14be8c4a1a99faf37e6697390a (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.910519 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee46b14be8c4a1a99faf37e6697390a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.880287 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35e2d3e5b034ad6adcc494a92b92886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.780829 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 0feb55752b27445c8dee19903f9e6d41 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.914322 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb55752b27445c8dee19903f9e6d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.920329 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6df9d20345c49f0a6f00d9f5f660140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.921161 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246d42c8e70c46dca72a4d8848a218d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.923934 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10ddce6896a49a8a2a9ec09702f3ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.941256 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93a2cf326204d8e89e4fe76ead348c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.944309 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb55752b27445c8dee19903f9e6d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.950439 11854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246d42c8e70c46dca72a4d8848a218d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.957630 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 0bace639158f425898b2859f751fc2cd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:16.959528 12004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c1fe07352d4472a01fce46f98ce1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.962205 12062 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.963590 11872 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:16.970386 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb26c79d86d449786430b604fee9561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.972122 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8660209a034cd2a004c54e65aa0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.972908 12003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895f46e6dc144b38be8e04b5aac35a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.973930 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:16.975031 12087 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.977772 12087 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.978199 12087 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.979447 12068 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.979348 11873 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:16.980151 12068 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:16.982429 12068 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:16.984964 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:16.986083 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:16.987112 11914 leader_election.cc:343] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.987481 12066 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.987684 12063 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:16.990454 12063 ts_tablet_manager.cc:1403] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.006s
I20260709 12:09:16.990317 12066 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:16.975432 11929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa456bf4db9474f84e2e5a51c919032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.984947 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 0bace639158f425898b2859f751fc2cd (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.004109 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee46b14be8c4a1a99faf37e6697390a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.009948 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bace639158f425898b2859f751fc2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.010545 11862 tablet_service.cc:1511] Processing CreateTablet for tablet 79900041d3b94f09a8d4b882957a37c3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.017987 12066 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.000411 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:17.029264 11914 leader_election.cc:343] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.029909 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.031440 12068 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.031409 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 79900041d3b94f09a8d4b882957a37c3 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.034550 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79900041d3b94f09a8d4b882957a37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.043097 12087 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.013360 12063 raft_consensus.cc:359] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.046252 12063 raft_consensus.cc:385] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.046566 12063 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.047286 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.048570 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8660209a034cd2a004c54e65aa0b9b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:09:17.049445 11988 leader_election.cc:343] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.049997 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8660209a034cd2a004c54e65aa0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.050448 11930 tablet_service.cc:1511] Processing CreateTablet for tablet 895f46e6dc144b38be8e04b5aac35a2e (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.047355 12063 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.051697 11930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895f46e6dc144b38be8e04b5aac35a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.065812 12063 ts_tablet_manager.cc:1434] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 12:09:17.074205 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bace639158f425898b2859f751fc2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.076189 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79900041d3b94f09a8d4b882957a37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.075989 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb26c79d86d449786430b604fee9561 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.073987 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:17.078001 11873 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.970494 12070 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:17.085049 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb26c79d86d449786430b604fee9561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.090369 12063 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.094229 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:17.095348 11855 tablet_service.cc:1511] Processing CreateTablet for tablet 895f46e6dc144b38be8e04b5aac35a2e (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:09:17.095827 11839 leader_election.cc:343] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.096727 11855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895f46e6dc144b38be8e04b5aac35a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.098040 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.098640 11947 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.099606 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8660209a034cd2a004c54e65aa0b9b (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.104595 11937 tablet_service.cc:1511] Processing CreateTablet for tablet b2c1fe07352d4472a01fce46f98ce1a6 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.105645 12070 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.106029 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c1fe07352d4472a01fce46f98ce1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.110723 12061 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.111255 12061 ts_tablet_manager.cc:1403] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.364s	user 0.043s	sys 0.034s
I20260709 12:09:17.114096 12061 raft_consensus.cc:359] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.114799 12061 raft_consensus.cc:385] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.115067 12061 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.116072 12061 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.118862 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8660209a034cd2a004c54e65aa0b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.119290 12061 ts_tablet_manager.cc:1434] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:17.120354 12061 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.126317 12061 tablet_bootstrap.cc:654] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.132174 12063 tablet_bootstrap.cc:654] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.126463 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb26c79d86d449786430b604fee9561 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.133306 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb26c79d86d449786430b604fee9561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.134361 12086 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.136121 12086 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.138540 12086 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.141018 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.141814 12062 ts_tablet_manager.cc:1434] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.272s	user 0.036s	sys 0.089s
I20260709 12:09:17.142381 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.142928 12062 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
W20260709 12:09:17.144578 11988 leader_election.cc:343] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.045444 12087 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:17.151417 11988 leader_election.cc:343] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.157723 11988 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.157291 11771 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.144613 11873 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:17.162382 12087 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.174729 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.175669 12087 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.176390 12087 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:17.177279 12087 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.175272 11861 tablet_service.cc:1511] Processing CreateTablet for tablet b2c1fe07352d4472a01fce46f98ce1a6 (DEFAULT_TABLE table=test-workload [id=7e5721564cb04025b98a0a76e9250838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.190711 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c1fe07352d4472a01fce46f98ce1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.210016 11947 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:17.214516 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:17.217231 12091 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.217818 12091 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:17.215716 12062 tablet_bootstrap.cc:654] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.219825 12091 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:17.227625 12061 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.228123 12061 ts_tablet_manager.cc:1403] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.023s
I20260709 12:09:17.238785 12063 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.239485 12063 ts_tablet_manager.cc:1403] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.149s	user 0.024s	sys 0.008s
I20260709 12:09:17.242043 11770 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.244695 12063 raft_consensus.cc:359] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.245594 12063 raft_consensus.cc:385] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.245944 12063 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.246930 12063 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.249260 12063 ts_tablet_manager.cc:1434] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:17.242947 12061 raft_consensus.cc:359] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:17.250134 12061 raft_consensus.cc:385] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.250491 12061 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.251377 12061 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:17.264093 12061 ts_tablet_manager.cc:1434] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 12:09:17.265241 12061 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.268430 12062 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.269011 12062 ts_tablet_manager.cc:1403] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.012s
I20260709 12:09:17.272145 12063 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.274662 12062 raft_consensus.cc:359] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.276247 12062 raft_consensus.cc:385] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.276633 12062 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.277437 12062 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.279673 12062 ts_tablet_manager.cc:1434] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:09:17.280572 12062 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.288023 12061 tablet_bootstrap.cc:654] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.288542 12091 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.289081 12091 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.291476 12091 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.292301 12062 tablet_bootstrap.cc:654] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.292342 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.292778 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.293258 11947 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:17.294215 12063 tablet_bootstrap.cc:654] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.295114 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:17.296087 11839 leader_election.cc:343] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.296865 12091 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.297195 12091 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.297513 12091 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.300731 12063 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.301414 12063 ts_tablet_manager.cc:1403] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 12:09:17.305506 12091 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.308323 12061 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.308821 12061 ts_tablet_manager.cc:1403] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 12:09:17.309504 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.310393 11947 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.310710 12062 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.311323 12062 ts_tablet_manager.cc:1403] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.005s
I20260709 12:09:17.311726 12061 raft_consensus.cc:359] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.312515 12061 raft_consensus.cc:385] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.312813 12061 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.313817 12061 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.314594 12062 raft_consensus.cc:359] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.315404 12062 raft_consensus.cc:385] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.315744 12062 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.305330 12063 raft_consensus.cc:359] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.316543 12062 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.317350 12061 ts_tablet_manager.cc:1434] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:09:17.318341 12061 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.319242 12062 ts_tablet_manager.cc:1434] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:17.320235 12062 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.323347 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:17.324234 12022 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.324805 12061 tablet_bootstrap.cc:654] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.327023 12062 tablet_bootstrap.cc:654] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.317028 12063 raft_consensus.cc:385] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.327733 12063 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.328292 11947 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:17.328648 12063 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.330247 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.331022 12063 ts_tablet_manager.cc:1434] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:09:17.331563 12070 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.332556 12091 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.337594 12063 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.338784 12022 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:17.346549 12070 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:09:17.355448 11974 tablet.cc:2406] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:17.355726 12063 tablet_bootstrap.cc:654] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.356199 12070 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.359858 11769 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.364324 12062 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.364324 12061 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.365091 12061 ts_tablet_manager.cc:1403] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.009s
I20260709 12:09:17.365092 12062 ts_tablet_manager.cc:1403] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.009s
I20260709 12:09:17.368052 12061 raft_consensus.cc:359] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.368259 12062 raft_consensus.cc:359] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.369071 12062 raft_consensus.cc:385] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.368781 12061 raft_consensus.cc:385] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.369501 12062 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.370616 12062 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.369520 12061 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.373353 12062 ts_tablet_manager.cc:1434] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:17.374655 12062 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.380694 12061 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.381278 12062 tablet_bootstrap.cc:654] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.382535 11770 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.384375 12061 ts_tablet_manager.cc:1434] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:17.384519 12063 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.385150 12063 ts_tablet_manager.cc:1403] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.018s
I20260709 12:09:17.385838 12061 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.388204 12068 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.388269 12063 raft_consensus.cc:359] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.389362 12063 raft_consensus.cc:385] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.389108 12068 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.389736 12063 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.390625 12063 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.397796 12068 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.398113 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.398871 12022 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:17.399174 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.400309 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.401230 12068 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.401621 12068 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.401952 12068 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.403332 12061 tablet_bootstrap.cc:654] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:17.408046 11914 leader_election.cc:343] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.410385 12062 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.410851 12061 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.410985 12062 ts_tablet_manager.cc:1403] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.008s
I20260709 12:09:17.411321 12061 ts_tablet_manager.cc:1403] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:09:17.412292 12063 ts_tablet_manager.cc:1434] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 12:09:17.413484 12063 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.413275 12068 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.416711 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:17.418330 11914 leader_election.cc:343] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.420194 12068 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.420425 12063 tablet_bootstrap.cc:654] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.420449 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:17.421198 12022 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.422830 12061 raft_consensus.cc:359] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.422708 12062 raft_consensus.cc:359] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.426424 12061 raft_consensus.cc:385] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.426559 12062 raft_consensus.cc:385] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.426790 12061 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.427060 12062 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.427649 12061 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.429463 12022 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:17.430061 12061 ts_tablet_manager.cc:1434] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:09:17.428097 12062 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.430773 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.431594 12061 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.432024 12068 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.432518 12068 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:17.432943 12062 ts_tablet_manager.cc:1434] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.006s
I20260709 12:09:17.433341 12068 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.438386 12062 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.439046 12061 tablet_bootstrap.cc:654] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.449746 12062 tablet_bootstrap.cc:654] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.454134 11769 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.460110 12063 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.460839 12063 ts_tablet_manager.cc:1403] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.012s
I20260709 12:09:17.461360 12062 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.461637 12068 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.462028 12062 ts_tablet_manager.cc:1403] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:09:17.462092 12068 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.463438 12070 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.463889 12070 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.464382 12068 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.465936 12070 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.468020 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.468039 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.468865 12022 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:17.469515 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:17.469884 11914 leader_election.cc:343] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.469925 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.470592 12021 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:17.470805 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.463825 12063 raft_consensus.cc:359] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.471927 12063 raft_consensus.cc:385] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.472290 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.472317 12063 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.473069 12070 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.473578 12068 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.473929 12068 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.474442 12068 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.473937 12063 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.479202 12087 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.479715 12087 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } }
I20260709 12:09:17.481835 12087 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.482041 12063 ts_tablet_manager.cc:1434] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 12:09:17.483425 12063 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.484138 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.485423 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.486227 11947 raft_consensus.cc:2393] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:17.488124 11988 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.489312 12087 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.490090 12112 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.489948 12068 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.490649 12112 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.491773 12063 tablet_bootstrap.cc:654] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.492813 12112 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.493950 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.494992 11872 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:17.493983 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.496590 12068 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.495849 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:17.497922 12086 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.498202 12022 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.498456 12086 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.500568 12086 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.501562 11914 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.503305 12068 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.504041 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.504658 11947 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:17.506042 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.506079 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:17.507818 11914 leader_election.cc:343] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.508188 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.507818 12086 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.508719 12086 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.509050 12086 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.510039 11988 leader_election.cc:343] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.511178 12066 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.513710 12022 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:17.515808 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.516930 12112 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.517423 12061 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.518095 12061 ts_tablet_manager.cc:1403] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.031s
I20260709 12:09:17.518870 12062 raft_consensus.cc:359] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.522511 12086 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.524735 12061 raft_consensus.cc:359] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.525413 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:17.525753 12061 raft_consensus.cc:385] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.526177 12061 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
W20260709 12:09:17.527088 11988 leader_election.cc:343] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.527184 12061 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.528569 12070 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.529754 12068 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.531721 12062 raft_consensus.cc:385] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.532115 12062 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.520298 12087 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.533754 12061 ts_tablet_manager.cc:1434] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:17.535101 12061 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.534971 12062 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.537289 12062 ts_tablet_manager.cc:1434] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 12:09:17.538519 12062 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.538857 12112 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:17.539829 12112 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.542644 12061 tablet_bootstrap.cc:654] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.547535 12063 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.548689 12063 ts_tablet_manager.cc:1403] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.025s
I20260709 12:09:17.551856 12063 raft_consensus.cc:359] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.552610 12063 raft_consensus.cc:385] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.552882 12063 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.553711 12086 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.553583 12063 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.556236 12063 ts_tablet_manager.cc:1434] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:17.556321 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.557271 11947 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.557471 12063 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.558372 12061 tablet_bootstrap.cc:492] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.558905 12061 ts_tablet_manager.cc:1403] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 12:09:17.562039 12061 raft_consensus.cc:359] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.562861 12061 raft_consensus.cc:385] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.563160 12061 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.564178 12061 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.564924 12063 tablet_bootstrap.cc:654] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.547948 12062 tablet_bootstrap.cc:654] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.566547 12061 ts_tablet_manager.cc:1434] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:17.567642 12061 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.570523 11947 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:17.576470 12061 tablet_bootstrap.cc:654] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.576005 12066 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.577024 12062 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.586751 12062 ts_tablet_manager.cc:1403] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 12:09:17.589751 12062 raft_consensus.cc:359] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.590510 12062 raft_consensus.cc:385] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.590780 12062 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.592943 12063 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.593521 12063 ts_tablet_manager.cc:1403] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260709 12:09:17.595243 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:17.597012 12062 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.599153 12070 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.599737 12061 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.598938 12063 raft_consensus.cc:359] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.599737 12070 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.600271 12063 raft_consensus.cc:385] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.600847 12063 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.601771 12063 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.603972 12063 ts_tablet_manager.cc:1434] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:09:17.604934 12063 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.606382 12070 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.608311 12062 ts_tablet_manager.cc:1434] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:17.600356 12061 ts_tablet_manager.cc:1403] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.006s
I20260709 12:09:17.609999 12062 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.610426 12066 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.610941 12066 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:17.611896 12066 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.607746 11768 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.613945 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.614784 11947 raft_consensus.cc:2393] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:17.618120 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.622095 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.623587 12105 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.627676 12070 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:17.631318 12061 raft_consensus.cc:359] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.632092 12061 raft_consensus.cc:385] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.632477 12105 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.634879 12062 tablet_bootstrap.cc:654] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.635073 12063 tablet_bootstrap.cc:654] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.632352 12061 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.637826 12061 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.642107 12061 ts_tablet_manager.cc:1434] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:09:17.643740 12061 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.647279 11947 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.653282 12061 tablet_bootstrap.cc:654] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.653802 11770 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.669898 12066 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.673836 12062 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.674779 12062 ts_tablet_manager.cc:1403] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.006s
I20260709 12:09:17.680275 12062 raft_consensus.cc:359] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.681035 12062 raft_consensus.cc:385] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.681318 12062 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.682093 12062 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.685031 12062 ts_tablet_manager.cc:1434] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:09:17.686689 12062 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.692410 12063 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.692152 12070 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.692951 12063 ts_tablet_manager.cc:1403] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.088s	user 0.028s	sys 0.008s
I20260709 12:09:17.697496 12063 raft_consensus.cc:359] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.698302 12063 raft_consensus.cc:385] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.698588 12063 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.699769 12063 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.702522 12063 ts_tablet_manager.cc:1434] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.009s
I20260709 12:09:17.703395 12062 tablet_bootstrap.cc:654] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.705570 12061 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.706182 12061 ts_tablet_manager.cc:1403] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.007s
I20260709 12:09:17.708175 12070 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.711836 12070 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.713872 12070 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.716339 12063 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.721377 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.722244 11947 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:17.727361 12063 tablet_bootstrap.cc:654] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.726989 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.727931 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:17.728801 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.734903 12121 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.735231 12070 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.737959 12070 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.738394 12070 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.746381 12070 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.749279 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.749927 11947 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.733873 12061 raft_consensus.cc:359] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.752036 12061 raft_consensus.cc:385] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.766353 12062 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.769934 12061 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.770778 12061 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.767041 11947 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:17.766431 12070 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.767825 12105 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.770051 12062 ts_tablet_manager.cc:1403] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.023s
I20260709 12:09:17.766355 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:17.773874 12021 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.774605 12121 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.775295 12121 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.777676 12061 ts_tablet_manager.cc:1434] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 12:09:17.778649 12061 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.780105 12121 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.780870 12062 raft_consensus.cc:359] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.789964 12062 raft_consensus.cc:385] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.790293 12062 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.790653 12063 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.791129 12063 ts_tablet_manager.cc:1403] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.028s
I20260709 12:09:17.791008 12062 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.793226 12062 ts_tablet_manager.cc:1434] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.000s
I20260709 12:09:17.782619 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.785022 12061 tablet_bootstrap.cc:654] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.785641 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:17.794090 11947 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:17.793934 12063 raft_consensus.cc:359] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.794368 12062 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.794656 12063 raft_consensus.cc:385] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.794952 12063 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.795364 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.795802 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.795759 12063 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.796360 12121 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.796710 11872 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:17.796911 12121 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.797400 12121 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.797659 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.798444 12070 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.798938 12070 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:17.799782 12070 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.803153 12063 ts_tablet_manager.cc:1434] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:09:17.804214 12063 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.805768 12062 tablet_bootstrap.cc:654] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.808624 12121 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.812899 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.813669 11948 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.823076 12063 tablet_bootstrap.cc:654] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.815224 12105 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.828145 12086 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.821942 12112 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:17.822212 12121 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.834095 12086 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.836623 12086 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.832731 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:17.837702 11873 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.837961 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.838583 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:17.839865 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.840687 12105 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.843401 12086 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.843873 12086 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.844276 12086 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.848014 12121 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.848594 12121 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.851199 12105 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.852427 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:17.854235 11988 leader_election.cc:343] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.854833 12121 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.852039 12105 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.860505 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.863315 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.864218 11948 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:17.884958 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:17.886497 12121 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.887136 12121 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:17.888275 12121 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.895112 11873 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:17.899192 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.900362 12062 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:17.901098 12062 ts_tablet_manager.cc:1403] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.014s
W20260709 12:09:17.902768 11839 leader_election.cc:343] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.906275 11988 leader_election.cc:343] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.909368 12062 raft_consensus.cc:359] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.910383 12062 raft_consensus.cc:385] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.910753 12062 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
W20260709 12:09:17.906670 11839 leader_election.cc:343] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.914747 12062 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.918841 12086 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.916261 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.914393 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.922628 12087 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.923059 12061 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:17.923167 12062 ts_tablet_manager.cc:1434] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 12:09:17.923503 12061 ts_tablet_manager.cc:1403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.145s	user 0.019s	sys 0.055s
I20260709 12:09:17.924499 12062 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:17.924311 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:17.925601 12070 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:17.931237 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.933835 12063 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:17.934335 12063 ts_tablet_manager.cc:1403] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.130s	user 0.037s	sys 0.069s
I20260709 12:09:17.930361 12086 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.935516 12070 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.936187 12070 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.937815 12061 raft_consensus.cc:359] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.938530 12061 raft_consensus.cc:385] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.938905 12070 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.937193 11770 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.939877 12063 raft_consensus.cc:359] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.940620 12063 raft_consensus.cc:385] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.940896 12063 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.941591 12063 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.943154 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:17.943745 11947 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.943907 12063 ts_tablet_manager.cc:1434] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:09:17.944921 12063 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:17.944766 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:17.938921 12061 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.947533 12061 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.947899 12120 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:17.941624 11988 leader_election.cc:343] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.950242 11988 leader_election.cc:343] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.950567 12061 ts_tablet_manager.cc:1434] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:09:17.955292 12062 tablet_bootstrap.cc:654] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.952991 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.958472 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:17.959298 12061 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:17.967664 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:17.968258 12086 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.977725 12086 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.970575 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:17.981263 12068 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.981809 12068 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.984364 12068 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:17.974779 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:17.985700 12070 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.986281 12070 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.986708 12070 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.988150 12121 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.988655 12121 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:17.990007 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:17.990895 12121 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:17.991021 11948 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:17.991024 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:17.992280 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:17.999115 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.000339 12068 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.000788 12068 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.001195 12068 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.007561 12086 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.008508 12063 tablet_bootstrap.cc:654] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.017526 12061 tablet_bootstrap.cc:654] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.018728 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.019716 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.023285 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.023459 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:18.027261 11988 leader_election.cc:343] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.028251 11988 leader_election.cc:343] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.029191 12105 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.029138 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.029963 12105 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.015147 12070 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.030771 12061 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.031803 12061 ts_tablet_manager.cc:1403] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.013s
I20260709 12:09:18.031836 11872 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:18.033046 12105 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.033929 12070 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.034870 12086 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.035571 12086 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:18.036765 12086 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.039008 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.040165 12061 raft_consensus.cc:359] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.041790 12061 raft_consensus.cc:385] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.042629 12061 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
W20260709 12:09:18.043081 11839 leader_election.cc:343] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.041800 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.043941 12061 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.045939 12068 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.047043 11947 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:18.047155 12062 tablet_bootstrap.cc:492] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.047688 12062 ts_tablet_manager.cc:1403] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.005s
I20260709 12:09:18.050364 12062 raft_consensus.cc:359] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.052251 12062 raft_consensus.cc:385] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:18.050765 11988 leader_election.cc:343] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.051105 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.052878 12068 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.053401 11872 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:18.054096 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.052549 12062 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.053112 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.051913 12061 ts_tablet_manager.cc:1434] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:18.055085 12022 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.055368 11988 leader_election.cc:343] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.054322 12063 tablet_bootstrap.cc:492] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.055862 12061 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.056224 12063 ts_tablet_manager.cc:1403] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.112s	user 0.034s	sys 0.036s
I20260709 12:09:18.056607 12086 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.055847 11988 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.059019 12063 raft_consensus.cc:359] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.059353 12086 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.059715 12063 raft_consensus.cc:385] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.060037 12063 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.061141 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.055091 12062 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.061846 12021 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:18.063249 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.063189 11872 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.068984 12063 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.069635 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.070523 12070 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.070941 12070 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.071303 12070 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.071234 12063 ts_tablet_manager.cc:1434] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:18.077674 12063 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.078584 12062 ts_tablet_manager.cc:1434] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:09:18.079639 12062 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.082796 12022 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:18.083595 12063 tablet_bootstrap.cc:654] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.083998 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.085232 12120 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.086683 12120 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.085448 12061 tablet_bootstrap.cc:654] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.087165 12120 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:18.088151 12120 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.090777 12068 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.108747 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.109899 12105 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.109638 12070 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.111977 12070 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.103606 12061 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.113745 12061 ts_tablet_manager.cc:1403] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.001s
I20260709 12:09:18.115463 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.116237 11947 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.122831 12062 tablet_bootstrap.cc:654] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.128762 12061 raft_consensus.cc:359] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.129473 12063 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.129350 12061 raft_consensus.cc:385] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.129978 12061 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.130137 12063 ts_tablet_manager.cc:1403] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.019s
I20260709 12:09:18.130726 12061 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.132741 12061 ts_tablet_manager.cc:1434] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:09:18.133179 12063 raft_consensus.cc:359] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.133951 12063 raft_consensus.cc:385] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.134240 12063 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.134532 12070 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.135012 12070 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.135072 12063 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.136808 12063 ts_tablet_manager.cc:1434] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:18.137288 12061 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.138057 12063 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.137204 12070 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.144261 12061 tablet_bootstrap.cc:654] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.144904 12063 tablet_bootstrap.cc:654] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.145428 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.146180 11948 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:18.147511 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.149034 12070 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.148483 11769 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.149485 12070 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.150022 12070 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.150298 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.150985 12022 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.152532 12086 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.154075 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.154769 12020 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:18.129247 11947 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.159447 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.160346 12105 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.160833 12105 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:18.161593 12022 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.161689 12105 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.161953 12062 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.164146 12062 ts_tablet_manager.cc:1403] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.006s
I20260709 12:09:18.140347 11768 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.170463 12061 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.170970 12061 ts_tablet_manager.cc:1403] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.011s
I20260709 12:09:18.171330 12062 raft_consensus.cc:359] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.172109 12062 raft_consensus.cc:385] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.172392 12062 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.174578 12061 raft_consensus.cc:359] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.175421 12061 raft_consensus.cc:385] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.175701 12061 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.176434 12061 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.173044 12062 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.179104 12062 ts_tablet_manager.cc:1434] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:18.168874 11768 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.182351 12062 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.187687 12070 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.191339 12061 ts_tablet_manager.cc:1434] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:18.192229 12061 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.190912 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.194185 11947 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.197202 12062 tablet_bootstrap.cc:654] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.198385 12061 tablet_bootstrap.cc:654] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.204105 12070 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.207165 12112 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.207842 12112 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.209201 12063 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.209756 12063 ts_tablet_manager.cc:1403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.021s
I20260709 12:09:18.210253 12112 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.210942 11947 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.213800 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.212960 12063 raft_consensus.cc:359] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.214463 12063 raft_consensus.cc:385] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.214521 12022 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:18.214865 12061 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.214876 12063 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.215842 12061 ts_tablet_manager.cc:1403] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:09:18.216372 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.216714 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.217430 12112 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.217659 12070 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.217968 12112 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.218238 12070 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:18.218469 12112 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.219270 12070 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.219887 12061 raft_consensus.cc:359] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.220980 12061 raft_consensus.cc:385] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.221376 12061 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.212934 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.222752 11872 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:18.222846 12061 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.224984 12086 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.225306 12061 ts_tablet_manager.cc:1434] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:18.216344 12063 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.226817 12061 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.233704 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.234400 12022 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.235569 12061 tablet_bootstrap.cc:654] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.233379 12063 ts_tablet_manager.cc:1434] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 12:09:18.237202 12063 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.238370 12105 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.244846 12063 tablet_bootstrap.cc:654] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.247215 12112 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.256523 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.257318 11873 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.259358 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.260021 12020 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.256557 12112 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.270401 12020 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:18.269930 11770 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.271819 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.273281 12112 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.274833 12112 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:18.276288 12112 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.278673 11873 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:18.282871 12022 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.305258 12062 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.305840 12062 ts_tablet_manager.cc:1403] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.124s	user 0.056s	sys 0.027s
I20260709 12:09:18.305958 12061 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.306620 12061 ts_tablet_manager.cc:1403] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.017s
I20260709 12:09:18.309489 12062 raft_consensus.cc:359] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.309755 12061 raft_consensus.cc:359] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.310245 12062 raft_consensus.cc:385] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.310513 12061 raft_consensus.cc:385] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.310555 12062 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.310957 12061 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.311416 12062 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.312166 12063 tablet_bootstrap.cc:492] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.312641 12063 ts_tablet_manager.cc:1403] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.005s
I20260709 12:09:18.313889 12062 ts_tablet_manager.cc:1434] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:09:18.315204 12062 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.315449 12063 raft_consensus.cc:359] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.317585 12063 raft_consensus.cc:385] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.317910 12063 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.318747 12145 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.318768 12063 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.321193 12062 tablet_bootstrap.cc:654] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.321635 12063 ts_tablet_manager.cc:1434] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:09:18.323099 12063 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.325320 12061 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.328581 12061 ts_tablet_manager.cc:1434] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:09:18.327701 11771 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.329380 12063 tablet_bootstrap.cc:654] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.329599 12061 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.342392 12061 tablet_bootstrap.cc:654] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.346007 11770 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.356789 12070 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.357332 12070 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.359737 12070 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.362453 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:18.365175 11839 leader_election.cc:343] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.371074 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.371763 12022 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:18.375389 12066 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.378417 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.380236 12145 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.380613 12145 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.381033 12145 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.385710 12066 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.386445 12066 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.391713 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.392416 11948 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:18.392557 12063 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.393087 12063 ts_tablet_manager.cc:1403] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.026s
I20260709 12:09:18.393831 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.394660 12086 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.395020 12086 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.395346 12086 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.389518 12066 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.396852 12062 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.397311 12062 ts_tablet_manager.cc:1403] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.017s
I20260709 12:09:18.395663 12063 raft_consensus.cc:359] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.398893 12063 raft_consensus.cc:385] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.399155 12063 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.399453 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.399837 12063 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.400149 11873 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:18.402038 12063 ts_tablet_manager.cc:1434] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:09:18.402649 12062 raft_consensus.cc:359] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.403661 12062 raft_consensus.cc:385] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.404011 12062 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.404876 12062 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.406993 12061 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.406790 12086 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.407526 12061 ts_tablet_manager.cc:1403] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.006s
I20260709 12:09:18.407805 12062 ts_tablet_manager.cc:1434] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:18.405339 12145 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.408974 12062 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.411854 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.412453 11947 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.415055 12063 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.415967 12066 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.417917 12086 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.418113 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.418696 11873 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.419600 12145 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.422461 12061 raft_consensus.cc:359] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.423895 12061 raft_consensus.cc:385] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.424176 12061 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.425035 12061 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.427033 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.427645 12061 ts_tablet_manager.cc:1434] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:18.425972 11947 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:18.429059 12061 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.429946 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.430682 12022 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.431313 11839 leader_election.cc:343] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.433280 12063 tablet_bootstrap.cc:654] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.434293 11873 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:18.429927 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.436964 12086 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.437506 12086 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:18.438444 12086 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.444770 12145 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.445250 12145 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.448161 12063 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.449290 12063 ts_tablet_manager.cc:1403] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 12:09:18.449366 12145 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.451078 12062 tablet_bootstrap.cc:654] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.452276 12022 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.452196 12063 raft_consensus.cc:359] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.453047 12063 raft_consensus.cc:385] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.453346 12063 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.453768 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.454057 12063 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.454963 12145 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.455485 12145 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:18.456326 12145 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.456873 12063 ts_tablet_manager.cc:1434] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:18.457916 12063 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.463604 12061 tablet_bootstrap.cc:654] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.463538 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:18.465085 11839 leader_election.cc:343] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.466344 12063 tablet_bootstrap.cc:654] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.468335 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.469322 12022 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:18.471061 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.472222 12070 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.472604 12070 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.473786 12070 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.480801 11770 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.484826 12120 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.497874 12086 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.498560 12086 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.506132 12086 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.507054 12161 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.507198 12070 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.507680 12161 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.508112 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.510000 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.510685 11948 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:18.511600 12070 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:18.510687 11988 leader_election.cc:343] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.513811 12161 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.514202 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.514585 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.515264 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.515887 12022 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
W20260709 12:09:18.516111 11839 leader_election.cc:343] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.516795 12086 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.517565 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.518173 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.519441 12020 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.518940 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:18.521026 11914 leader_election.cc:343] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.521950 12161 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.522336 12161 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.522671 12161 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.518632 12086 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.524649 12086 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.529572 11771 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.532750 12062 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.533293 12062 ts_tablet_manager.cc:1403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.006s
I20260709 12:09:18.536477 12062 raft_consensus.cc:359] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.537040 12062 raft_consensus.cc:385] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.539023 12020 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:18.541815 12063 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.542378 12063 ts_tablet_manager.cc:1403] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.008s
I20260709 12:09:18.537313 12062 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.548353 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.552873 12063 raft_consensus.cc:359] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.554230 12063 raft_consensus.cc:385] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.554585 12063 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.556239 12145 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.555744 12062 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.557096 12145 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:18.558056 12145 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.561384 12062 ts_tablet_manager.cc:1434] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:09:18.562470 12062 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.569252 12061 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.569880 12061 ts_tablet_manager.cc:1403] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.032s
I20260709 12:09:18.570516 12120 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.570515 12063 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.569329 12086 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.572690 12061 raft_consensus.cc:359] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.573710 12061 raft_consensus.cc:385] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.573987 12061 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.574359 12063 ts_tablet_manager.cc:1434] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 12:09:18.574645 12061 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.576125 12086 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.579375 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.580682 12063 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.580614 12061 ts_tablet_manager.cc:1434] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:09:18.581724 12061 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.581569 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.583885 12112 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.584447 12112 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:18.588109 11988 leader_election.cc:343] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.588601 12063 tablet_bootstrap.cc:654] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.590215 12061 tablet_bootstrap.cc:654] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.590704 11771 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.593756 12105 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.600823 12112 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.606459 12063 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.606727 12061 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.606956 12063 ts_tablet_manager.cc:1403] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 12:09:18.607106 12061 ts_tablet_manager.cc:1403] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.002s
I20260709 12:09:18.607517 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.608260 11873 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:18.609592 12063 raft_consensus.cc:359] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.609822 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.609725 12061 raft_consensus.cc:359] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.610366 12063 raft_consensus.cc:385] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.610570 12061 raft_consensus.cc:385] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.610698 12063 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.610627 12021 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:18.611021 12061 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.611981 12063 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.612131 12061 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.614121 12061 ts_tablet_manager.cc:1434] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.614228 12063 ts_tablet_manager.cc:1434] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.615046 12061 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.615049 12063 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.616943 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.618933 12068 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.619419 12068 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.619771 12068 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.623344 12063 tablet_bootstrap.cc:654] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.625721 12061 tablet_bootstrap.cc:654] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.627019 12086 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:18.628429 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.641988 12070 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.658392 12066 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.658954 12066 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.661187 12066 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.664822 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:18.666901 11988 leader_election.cc:343] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.675067 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.675830 11947 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:18.678035 12120 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.678615 12120 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.678942 12161 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.680794 12120 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.681102 12161 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.681771 11948 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:18.683113 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.683933 12066 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.684402 12066 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.684747 12066 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.686089 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.687088 12063 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.687717 12063 ts_tablet_manager.cc:1403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.002s
I20260709 12:09:18.688475 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.690954 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.691378 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.692250 12020 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:18.693495 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.694322 12021 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:18.695188 12063 raft_consensus.cc:359] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.696188 12063 raft_consensus.cc:385] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.696506 12063 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.697384 12086 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.697449 12061 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.698305 12062 tablet_bootstrap.cc:654] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.698822 12061 ts_tablet_manager.cc:1403] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.021s
I20260709 12:09:18.697314 12063 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.705056 12066 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.706408 12063 ts_tablet_manager.cc:1434] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:18.683892 12068 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.709219 12068 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.709415 12063 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.703356 12061 raft_consensus.cc:359] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.709973 12061 raft_consensus.cc:385] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.710304 12061 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.710999 12061 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.711334 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.712013 11948 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.713961 12061 ts_tablet_manager.cc:1434] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:09:18.715011 12061 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.716312 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:18.718204 11988 leader_election.cc:343] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.720582 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.721031 11948 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:18.724344 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.725240 12086 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.725730 12086 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:18.726639 12086 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.730815 12066 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:18.721818 11914 leader_election.cc:343] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.734176 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.721983 12161 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.735361 12063 tablet_bootstrap.cc:654] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.722973 12062 tablet_bootstrap.cc:492] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.737665 12062 ts_tablet_manager.cc:1403] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.000s
I20260709 12:09:18.738834 12061 tablet_bootstrap.cc:654] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.740994 12062 raft_consensus.cc:359] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.741884 12062 raft_consensus.cc:385] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.742178 12062 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.744223 12062 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.745127 12068 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.751021 12161 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.752908 12062 ts_tablet_manager.cc:1434] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:09:18.753121 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.753842 11872 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.753962 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:18.754377 12063 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.754685 12021 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.754802 12063 ts_tablet_manager.cc:1403] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:09:18.757979 12063 raft_consensus.cc:359] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.758690 12063 raft_consensus.cc:385] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.758980 12063 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.759670 12063 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.761632 12061 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.762110 12061 ts_tablet_manager.cc:1403] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.006s
I20260709 12:09:18.762149 12021 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:18.765367 11872 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:18.765898 12062 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.769023 11768 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.773053 12062 tablet_bootstrap.cc:654] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.774765 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.776094 12068 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.776580 12068 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:18.777443 12068 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.769601 12061 raft_consensus.cc:359] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.785794 12061 raft_consensus.cc:385] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.786118 12061 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.786828 12061 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.788305 12061 ts_tablet_manager.cc:1434] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:09:18.789178 12061 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.797763 12063 ts_tablet_manager.cc:1434] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:09:18.798764 12063 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.804502 12070 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.804935 12202 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.805969 12202 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.804554 12063 tablet_bootstrap.cc:654] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.809755 12120 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.810449 12120 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.812678 12120 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.813046 12061 tablet_bootstrap.cc:654] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.813093 12202 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.815452 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.817509 12062 tablet_bootstrap.cc:492] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.818733 12062 ts_tablet_manager.cc:1403] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.006s
I20260709 12:09:18.820149 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.818363 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.820977 12021 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:18.820845 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.822541 12062 raft_consensus.cc:359] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.823082 12063 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.823341 12062 raft_consensus.cc:385] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.823556 12063 ts_tablet_manager.cc:1403] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:09:18.823699 12062 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.824558 12062 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.826726 12063 raft_consensus.cc:359] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.827258 12062 ts_tablet_manager.cc:1434] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:18.827399 12063 raft_consensus.cc:385] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.827766 12063 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.828557 12062 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.828469 12063 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.830791 12063 ts_tablet_manager.cc:1434] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:18.831696 12063 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.833052 12070 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.836342 12062 tablet_bootstrap.cc:654] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.813235 12120 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:18.841490 12061 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.842176 12061 ts_tablet_manager.cc:1403] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.014s
I20260709 12:09:18.846098 12061 raft_consensus.cc:359] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.846843 12066 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.847077 12061 raft_consensus.cc:385] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.847457 12066 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.851274 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.847506 12061 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.852596 12066 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.852758 12063 tablet_bootstrap.cc:654] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.854303 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:18.855844 11988 leader_election.cc:343] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.856885 11988 leader_election.cc:343] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.857344 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:18.857090 12061 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.859114 12066 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.860401 12061 ts_tablet_manager.cc:1434] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 12:09:18.861842 12061 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:18.862044 11914 leader_election.cc:343] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.868687 12087 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.875468 12063 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:18.876080 12063 ts_tablet_manager.cc:1403] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.001s
W20260709 12:09:18.862772 11914 leader_election.cc:343] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.876144 12087 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.876842 12087 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.878657 12087 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.879439 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.880553 12061 tablet_bootstrap.cc:654] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.879889 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.880360 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.881280 11948 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
W20260709 12:09:18.882086 11988 leader_election.cc:343] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.882923 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.884706 12086 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.885196 12086 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.885643 12086 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.879562 12063 raft_consensus.cc:359] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.888680 12063 raft_consensus.cc:385] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.889063 12063 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.889971 12063 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.893108 12063 ts_tablet_manager.cc:1434] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 12:09:18.894565 12063 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:18.897953 12086 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.900756 12086 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.903183 12063 tablet_bootstrap.cc:654] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.903264 12061 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.903975 12061 ts_tablet_manager.cc:1403] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.004s
I20260709 12:09:18.905143 12202 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.907754 12061 raft_consensus.cc:359] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.908736 12061 raft_consensus.cc:385] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.909092 12061 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.910097 12061 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.913082 12061 ts_tablet_manager.cc:1434] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:18.915710 12087 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.917934 12061 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.916443 12087 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.921079 12087 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.932797 12061 tablet_bootstrap.cc:654] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.926314 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 63572.5us
I20260709 12:09:18.938294 11914 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:18.939366 12202 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.949199 12120 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.949944 12120 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.952566 12120 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:18.954675 12061 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:18.955263 12061 ts_tablet_manager.cc:1403] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.000s
W20260709 12:09:18.962412 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.963140 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.964540 12061 raft_consensus.cc:359] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.965318 12061 raft_consensus.cc:385] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.965585 12061 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.966323 12061 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.967805 12087 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.968236 12061 ts_tablet_manager.cc:1434] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:18.968389 12087 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.969089 12061 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:18.970752 12087 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:18.960186 12202 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:18.974064 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 91216.6us
I20260709 12:09:18.976684 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:18.977386 12020 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:18.979022 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:18.980221 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:18.981999 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:18.983518 12062 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:18.984009 12062 ts_tablet_manager.cc:1403] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.156s	user 0.046s	sys 0.049s
I20260709 12:09:18.985903 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:18.986604 11947 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.987074 12062 raft_consensus.cc:359] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.987845 12062 raft_consensus.cc:385] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.988148 12062 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.986778 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:18.988896 12062 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:18.991211 12062 ts_tablet_manager.cc:1434] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.991698 12061 tablet_bootstrap.cc:654] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.992115 12062 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:18.998625 11947 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:18.999413 12063 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.000607 12145 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.001600 12161 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.002020 12161 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.002517 12161 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.002050 12145 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.003957 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.006065 12063 ts_tablet_manager.cc:1403] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.019s
I20260709 12:09:19.013087 12161 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.007150 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.005261 12145 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.015453 12161 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.018249 12105 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.021961 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.022595 12022 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.025282 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.025691 12063 raft_consensus.cc:359] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.027987 12063 raft_consensus.cc:385] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.028690 12063 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.029629 12022 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:19.029434 11771 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.029917 12063 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.032914 12161 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.033119 12063 ts_tablet_manager.cc:1434] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:19.035163 12063 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.036850 12202 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.037405 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.038097 12020 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.033481 12161 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.039865 12145 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:19.041360 11988 leader_election.cc:343] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.042062 11988 leader_election.cc:343] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.042845 12105 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.044456 12062 tablet_bootstrap.cc:654] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.046921 12161 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:19.036872 11914 leader_election.cc:343] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.047340 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:19.047871 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:19.048342 12105 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.048748 12086 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:19.048588 11914 leader_election.cc:343] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.050823 12061 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.051949 12213 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.049969 12105 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.051299 12061 ts_tablet_manager.cc:1403] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.082s	user 0.033s	sys 0.028s
I20260709 12:09:19.053592 12086 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:19.055516 12086 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.054111 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.057358 11947 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.053838 12105 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.062355 12063 tablet_bootstrap.cc:654] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.062273 12087 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.063635 12061 raft_consensus.cc:359] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.064606 12061 raft_consensus.cc:385] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.064965 12061 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.062958 12087 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.057883 11988 leader_election.cc:343] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.067269 12145 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.069083 12087 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.068800 12145 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.070287 12061 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.071058 12145 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.072325 12061 ts_tablet_manager.cc:1434] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:09:19.073784 12061 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:19.075776 11988 leader_election.cc:343] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.076236 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.076844 12086 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.077589 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.077894 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.079972 12161 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.080528 12161 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.080894 11988 leader_election.cc:343] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.081312 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.082058 12086 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.082536 12161 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.086769 12105 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.088867 12105 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.091131 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.095781 12062 tablet_bootstrap.cc:492] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.096334 12062 ts_tablet_manager.cc:1403] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.104s	user 0.005s	sys 0.004s
I20260709 12:09:19.098661 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.099375 12062 raft_consensus.cc:359] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.100358 12086 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.100976 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.100381 12062 raft_consensus.cc:385] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.101819 12062 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.101971 12161 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.102756 12161 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:19.102522 12062 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.103749 12161 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.105033 12062 ts_tablet_manager.cc:1434] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:09:19.106068 12062 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.100893 12086 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.108754 12086 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.110101 12061 tablet_bootstrap.cc:654] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.102432 11914 leader_election.cc:343] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.116777 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:19.117108 11914 leader_election.cc:343] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.117401 12091 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.117656 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.119704 12161 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.122246 12062 tablet_bootstrap.cc:654] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.124639 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.125412 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:19.126219 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.126595 11945 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.127048 11946 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:09:19.126223 11914 leader_election.cc:343] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.133513 12087 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.134053 12087 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.135250 12061 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.135776 12061 ts_tablet_manager.cc:1403] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.001s
I20260709 12:09:19.136083 12087 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.138267 12061 raft_consensus.cc:359] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.138868 12061 raft_consensus.cc:385] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.139101 12061 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.139668 12061 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.141175 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.141649 12061 ts_tablet_manager.cc:1434] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:19.142151 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.142795 12021 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.144382 11945 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:19.142544 12061 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:19.145581 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:19.148114 11914 leader_election.cc:343] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.148461 12105 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.148643 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.149659 12021 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:19.149125 12105 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:19.152582 12061 tablet_bootstrap.cc:654] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.153313 12105 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.156666 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.159814 11872 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.163759 12120 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.169723 12062 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.170517 12062 ts_tablet_manager.cc:1403] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.012s
I20260709 12:09:19.174278 12062 raft_consensus.cc:359] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.175271 12062 raft_consensus.cc:385] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.175591 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.175645 12062 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.178328 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.181746 12061 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.182247 12061 ts_tablet_manager.cc:1403] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.040s	user 0.001s	sys 0.014s
I20260709 12:09:19.183917 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.185149 12061 raft_consensus.cc:359] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.185890 12061 raft_consensus.cc:385] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.186185 12061 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.179670 12062 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.186983 12145 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.188596 12062 ts_tablet_manager.cc:1434] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:09:19.189301 12062 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.181955 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.189909 11945 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:19.190882 12061 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.193449 12061 ts_tablet_manager.cc:1434] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:09:19.194375 12061 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:19.194334 12145 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.195827 12062 tablet_bootstrap.cc:654] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.198927 11771 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.202512 12061 tablet_bootstrap.cc:654] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.186947 11988 leader_election.cc:343] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.206779 11988 leader_election.cc:343] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.207454 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:19.209185 12063 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.209694 12063 ts_tablet_manager.cc:1403] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.175s	user 0.017s	sys 0.010s
I20260709 12:09:19.212463 12213 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.212850 12213 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.213164 12213 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.214426 12062 tablet_bootstrap.cc:492] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.214931 12062 ts_tablet_manager.cc:1403] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
W20260709 12:09:19.219259 11988 leader_election.cc:343] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.227725 12070 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.228446 12070 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.232372 11770 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.269464 12063 raft_consensus.cc:359] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.270326 12063 raft_consensus.cc:385] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.270684 12063 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.271433 12063 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.219949 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.276868 12063 ts_tablet_manager.cc:1434] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:09:19.267649 12213 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.279692 12213 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.279830 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.282145 11946 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:19.280362 12063 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.280217 12062 raft_consensus.cc:359] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.285610 12062 raft_consensus.cc:385] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.285846 12062 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.284653 12070 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.289470 12061 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
W20260709 12:09:19.289644 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70439.6us
I20260709 12:09:19.290333 12061 ts_tablet_manager.cc:1403] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.043s
I20260709 12:09:19.294044 12202 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.293824 12061 raft_consensus.cc:359] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.286545 12213 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.294520 12202 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.295529 12062 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.296588 12202 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.294502 12061 raft_consensus.cc:385] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.297706 12061 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.298328 12061 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.290660 11988 leader_election.cc:343] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.299741 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.300441 12062 ts_tablet_manager.cc:1434] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 12:09:19.305325 12062 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.302064 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.308267 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.309013 12022 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:19.310966 12213 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.311304 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:19.312202 11988 leader_election.cc:343] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.312695 12161 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.313889 12061 ts_tablet_manager.cc:1434] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:09:19.314736 12061 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:19.321197 11914 leader_election.cc:343] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.317925 12202 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.321906 12202 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.326997 12161 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:19.324808 12202 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.339437 12061 tablet_bootstrap.cc:654] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.353236 12063 tablet_bootstrap.cc:654] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.361933 12062 tablet_bootstrap.cc:654] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.367674 12063 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.368351 12063 ts_tablet_manager.cc:1403] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.003s
I20260709 12:09:19.369901 12061 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.370360 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:19.370407 12061 ts_tablet_manager.cc:1403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 12:09:19.371073 11945 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.372372 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.372485 12063 raft_consensus.cc:359] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.374401 12061 raft_consensus.cc:359] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.375247 12061 raft_consensus.cc:385] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.375010 12063 raft_consensus.cc:385] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.375577 12061 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.375782 12063 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.376545 12061 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.376883 12063 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.380038 12063 ts_tablet_manager.cc:1434] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:19.384688 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.385363 12063 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.385466 12021 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:19.380476 11945 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:19.390414 12061 ts_tablet_manager.cc:1434] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:19.360586 11771 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.392520 12061 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:19.372972 12202 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.397735 12202 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.398442 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.399549 12063 tablet_bootstrap.cc:654] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.400058 11914 leader_election.cc:343] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.404794 12062 tablet_bootstrap.cc:492] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.405318 12062 ts_tablet_manager.cc:1403] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.008s
I20260709 12:09:19.398533 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.406478 12021 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.408075 12062 raft_consensus.cc:359] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.408800 12062 raft_consensus.cc:385] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.409065 12062 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.411649 12087 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:19.410125 11988 leader_election.cc:343] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.421118 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.422628 12147 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.426610 12087 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.427119 12087 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.426309 12062 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.435149 12021 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:19.435271 12147 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.437306 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.440569 12061 tablet_bootstrap.cc:654] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.441500 12112 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.445390 12112 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:19.446286 12112 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.441502 12062 ts_tablet_manager.cc:1434] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 12:09:19.442787 12087 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.450933 12105 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.451371 12062 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.451516 12105 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.451393 12087 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.453715 12105 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.454083 12087 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.455449 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.456678 12063 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.456651 11945 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.458180 12063 ts_tablet_manager.cc:1403] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.024s
I20260709 12:09:19.458559 12087 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.463896 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:19.468261 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.468581 12105 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.469067 12087 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.469286 12105 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.464697 12063 raft_consensus.cc:359] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.469841 12105 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.467509 12213 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.470263 12063 raft_consensus.cc:385] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.470607 12063 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.471246 12063 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.473325 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.473992 12022 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.473610 12063 ts_tablet_manager.cc:1434] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 12:09:19.475479 12063 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.475281 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.475936 11945 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:19.482358 12063 tablet_bootstrap.cc:654] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.467496 12062 tablet_bootstrap.cc:654] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.485860 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.489487 12087 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:19.490597 12087 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.490641 12105 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.494710 12105 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.495811 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:19.495924 11770 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.496956 11945 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.502444 12061 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.502969 12061 ts_tablet_manager.cc:1403] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.111s	user 0.003s	sys 0.010s
I20260709 12:09:19.505725 12061 raft_consensus.cc:359] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.507148 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.508136 11871 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:19.507819 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.510036 12062 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.510510 12062 ts_tablet_manager.cc:1403] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.001s
I20260709 12:09:19.512914 12062 raft_consensus.cc:359] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.513443 12062 raft_consensus.cc:385] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.513731 12062 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.514283 12062 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.516132 12062 ts_tablet_manager.cc:1434] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:19.516485 12061 raft_consensus.cc:385] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.516518 12244 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.516959 12061 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.517179 12244 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.517887 12061 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.519767 12244 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.524058 12061 ts_tablet_manager.cc:1434] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
W20260709 12:09:19.525920 11988 leader_election.cc:343] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.526090 12061 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:19.530262 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.531002 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.531584 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.532172 12022 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.534339 12062 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.532675 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.540068 12022 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:19.540359 12087 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.541038 12087 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.526522 11945 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:19.541492 12087 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.542896 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:19.544234 12105 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.545706 12062 tablet_bootstrap.cc:654] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.548267 12105 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:19.549482 12105 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.552299 12061 tablet_bootstrap.cc:654] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.561578 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.563009 12213 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.566838 11988 leader_election.cc:343] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.581686 11988 leader_election.cc:343] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.582526 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.583292 12213 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.584720 12063 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.592811 12061 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.594056 11771 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.599565 12087 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.607493 12087 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.609529 12063 ts_tablet_manager.cc:1403] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.134s	user 0.046s	sys 0.035s
I20260709 12:09:19.613592 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.609633 12061 ts_tablet_manager.cc:1403] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.012s
I20260709 12:09:19.618459 12061 raft_consensus.cc:359] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.618742 12063 raft_consensus.cc:359] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.619499 12063 raft_consensus.cc:385] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:19.619762 11988 leader_election.cc:343] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.620231 12061 raft_consensus.cc:385] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.620600 12061 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.621090 12086 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.621295 12061 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.619807 12063 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.623624 12063 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.625790 12063 ts_tablet_manager.cc:1434] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:09:19.626772 12063 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.626811 11871 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.619899 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:19.629057 11945 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.629639 12061 ts_tablet_manager.cc:1434] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:19.625339 11768 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.631125 12061 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:19.636354 11914 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.655728 12062 tablet_bootstrap.cc:492] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.656209 12062 ts_tablet_manager.cc:1403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.122s	user 0.040s	sys 0.028s
I20260709 12:09:19.663523 12087 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.665377 12063 tablet_bootstrap.cc:654] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.671147 12202 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:19.672384 11945 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:19.677578 12244 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.678344 12244 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.680873 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.686859 12213 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.694564 12213 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:19.695917 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.696352 12213 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.699216 11988 leader_election.cc:343] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.705753 12244 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.707263 12062 raft_consensus.cc:359] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.708125 12062 raft_consensus.cc:385] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.708447 12062 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.709141 12062 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.714979 12062 ts_tablet_manager.cc:1434] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.005s
I20260709 12:09:19.723807 12202 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.724403 12202 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.726583 12202 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.729374 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.730106 12021 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:19.731801 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:19.732664 12202 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.733052 12202 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.733731 12202 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.742470 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.732971 12062 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.745764 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.746243 12202 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.747267 11914 leader_election.cc:343] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.747906 12244 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.750803 12061 tablet_bootstrap.cc:654] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.760492 12068 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.761116 12068 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.748471 12244 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.765522 12068 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.768040 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.769977 12244 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.769898 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.762953 12202 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:19.771793 11914 leader_election.cc:343] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.772615 11914 leader_election.cc:343] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.777729 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.778348 12022 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.779533 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56345.6us
I20260709 12:09:19.781083 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.781756 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:19.782647 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.783456 12112 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:19.783520 11988 leader_election.cc:343] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.783885 12112 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.784058 11988 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.784516 12112 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.784785 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.786763 12259 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.787751 11988 leader_election.cc:343] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.790488 12063 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.787542 12105 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.792272 12063 ts_tablet_manager.cc:1403] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.166s	user 0.030s	sys 0.027s
I20260709 12:09:19.783908 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.793367 12112 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.795096 12063 raft_consensus.cc:359] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.795795 12063 raft_consensus.cc:385] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.795878 12112 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.796135 12063 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.797238 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:19.798035 11988 leader_election.cc:343] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.798448 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.799172 12244 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.799856 12063 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:19.801831 11914 leader_election.cc:343] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.802155 12063 ts_tablet_manager.cc:1434] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:19.803076 12063 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.805148 12105 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.801090 11768 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.810652 12061 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.811194 12061 ts_tablet_manager.cc:1403] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.003s
I20260709 12:09:19.812438 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.813038 12021 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.813676 12022 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:19.814152 12061 raft_consensus.cc:359] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.815140 12112 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.815605 12112 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.817701 12062 tablet_bootstrap.cc:654] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.821352 12063 tablet_bootstrap.cc:654] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.817730 12112 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.820708 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:19.823485 12061 raft_consensus.cc:385] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.823837 12061 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.830739 12260 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.830638 12202 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.831370 12202 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.831724 12061 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.831344 12260 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.836102 12260 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.838816 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.836215 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.839648 12202 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:19.841418 11988 leader_election.cc:343] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.838418 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.842177 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.843470 12022 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:19.845444 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:19.847973 11914 leader_election.cc:343] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.848924 11914 leader_election.cc:343] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.849856 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.850664 12202 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.850951 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.851392 12202 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:19.842121 12061 ts_tablet_manager.cc:1434] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.003s
I20260709 12:09:19.852698 12202 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.853889 12061 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:19.859920 11988 leader_election.cc:343] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.860862 12063 tablet_bootstrap.cc:492] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.862326 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.862959 12063 ts_tablet_manager.cc:1403] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.021s
I20260709 12:09:19.863306 12260 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.865162 12061 tablet_bootstrap.cc:654] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.866808 12063 raft_consensus.cc:359] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.867594 12063 raft_consensus.cc:385] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.867865 12063 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.868508 12063 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.870831 12062 tablet_bootstrap.cc:492] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:19.871276 12063 ts_tablet_manager.cc:1434] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:19.872277 12202 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.871299 12062 ts_tablet_manager.cc:1403] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.139s	user 0.004s	sys 0.016s
I20260709 12:09:19.872932 12063 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:19.876058 12062 raft_consensus.cc:359] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.876848 12062 raft_consensus.cc:385] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.877167 12062 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.879995 12202 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:19.880815 12063 tablet_bootstrap.cc:654] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.880995 12202 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.891127 12105 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.891710 12105 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.883076 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.892829 12112 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.893203 12112 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.893590 12112 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.894006 12105 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.903189 12112 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.906205 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.907698 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.877868 12062 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.908342 12022 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:19.910611 12062 ts_tablet_manager.cc:1434] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:09:19.912931 12260 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.913519 12260 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.915473 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.915720 12260 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:19.916486 11945 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:19.922725 12105 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.923269 12105 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.925401 12105 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.929467 12112 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.931308 12062 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:19.938005 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.939138 12147 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.940474 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:19.946978 12147 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.947906 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:19.948887 12021 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.950567 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.952963 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:19.954878 12202 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.955376 12202 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.955812 12202 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.947036 11988 leader_election.cc:343] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.974805 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:19.975777 12147 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.976207 12147 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.976545 12147 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.981890 11988 leader_election.cc:343] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.983234 12147 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.989019 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:19.989019 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:19.989117 11988 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:19.990128 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:19.990666 11947 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:19.990897 12021 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.990907 12260 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.991699 12063 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:19.992234 12063 ts_tablet_manager.cc:1403] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.120s	user 0.049s	sys 0.049s
I20260709 12:09:19.993088 12147 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.994017 12061 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:19.994468 12061 ts_tablet_manager.cc:1403] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.141s	user 0.042s	sys 0.023s
I20260709 12:09:19.995680 12063 raft_consensus.cc:359] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.996456 12063 raft_consensus.cc:385] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.996737 12063 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.005628 11914 leader_election.cc:343] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.005824 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:20.013319 11768 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.004101 12062 tablet_bootstrap.cc:654] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.035462 11768 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.037252 11872 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.998826 12202 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.007772 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:20.040269 12022 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.040444 12202 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:19.997440 12063 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:19.999544 12260 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:09:20.045380 12063 ts_tablet_manager.cc:1434] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:09:20.046427 12063 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.048902 12022 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:19.999468 12021 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:20.050040 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:20.050908 12105 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.051541 12105 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:20.052577 12105 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.054966 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.055234 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:20.056512 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.059095 12068 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.059654 12068 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:20.060570 12068 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.063959 12063 tablet_bootstrap.cc:654] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.034349 11947 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.067260 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:20.068039 12022 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.070483 12062 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.071630 12062 ts_tablet_manager.cc:1403] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.003s
I20260709 12:09:19.997347 12061 raft_consensus.cc:359] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.074875 12061 raft_consensus.cc:385] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.075214 12061 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.075965 12257 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.077008 12061 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.085405 11947 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:20.088384 12061 ts_tablet_manager.cc:1434] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.094s	user 0.013s	sys 0.009s
I20260709 12:09:20.089406 12061 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.090117 12022 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:20.091357 11914 leader_election.cc:343] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.093972 12112 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.096587 12112 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.096609 12147 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.097453 12147 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.097437 12112 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.098539 12061 tablet_bootstrap.cc:654] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.099807 12147 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.100688 12063 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.101137 12063 ts_tablet_manager.cc:1403] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.004s
I20260709 12:09:20.100447 12112 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.103924 12063 raft_consensus.cc:359] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.104604 12063 raft_consensus.cc:385] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.104857 12063 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.106074 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.108074 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.110558 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.111338 11947 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:20.105491 12063 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.116176 11871 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.117555 12063 ts_tablet_manager.cc:1434] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:09:20.118476 12063 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.093122 12062 raft_consensus.cc:359] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.123912 12062 raft_consensus.cc:385] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.124286 12062 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.123309 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.126188 12112 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.126807 12112 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:20.127818 12063 tablet_bootstrap.cc:654] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.127912 12112 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.129336 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:20.131038 11914 leader_election.cc:343] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.125113 12062 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.135807 12062 ts_tablet_manager.cc:1434] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:09:20.137753 12105 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:20.139803 11914 leader_election.cc:343] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.140321 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.142419 12273 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.143479 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.145383 12062 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.150008 12147 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.158675 11768 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.161192 12273 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.179944 12061 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:20.180570 12061 ts_tablet_manager.cc:1403] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.005s
I20260709 12:09:20.183966 12105 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.213351 12063 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.213269 12257 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.213888 12063 ts_tablet_manager.cc:1403] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.096s	user 0.031s	sys 0.045s
I20260709 12:09:20.216512 12063 raft_consensus.cc:359] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.217161 12063 raft_consensus.cc:385] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.217412 12063 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.217823 12062 tablet_bootstrap.cc:654] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.218261 12061 raft_consensus.cc:359] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.218165 12063 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.218915 12061 raft_consensus.cc:385] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.219211 12061 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.219856 12061 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.224268 12063 ts_tablet_manager.cc:1434] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:20.225211 12063 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.229195 12062 tablet_bootstrap.cc:492] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.229743 12062 ts_tablet_manager.cc:1403] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.000s
I20260709 12:09:20.231861 12061 ts_tablet_manager.cc:1434] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:09:20.233160 12061 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.237248 12063 tablet_bootstrap.cc:654] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.240088 11769 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.246637 12062 raft_consensus.cc:359] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.247677 12062 raft_consensus.cc:385] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.248029 12062 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.248566 12061 tablet_bootstrap.cc:654] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.248904 12062 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.252769 12062 ts_tablet_manager.cc:1434] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:09:20.253922 12062 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.260264 12062 tablet_bootstrap.cc:654] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.261060 12259 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.276230 12063 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.276700 12063 ts_tablet_manager.cc:1403] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.052s	user 0.001s	sys 0.020s
I20260709 12:09:20.277338 12062 tablet_bootstrap.cc:492] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.277778 12062 ts_tablet_manager.cc:1403] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 12:09:20.279697 12063 raft_consensus.cc:359] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.280025 12062 raft_consensus.cc:359] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.280365 12063 raft_consensus.cc:385] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.280627 12062 raft_consensus.cc:385] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.280656 12063 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.281383 12063 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.294113 12063 ts_tablet_manager.cc:1434] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:20.295022 12063 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.280974 12062 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.298142 12062 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.300208 12062 ts_tablet_manager.cc:1434] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:09:20.303233 12062 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.306407 12259 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.306954 12259 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.311182 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.311831 11873 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:20.312994 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:20.313771 12244 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:20.314188 12244 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.314371 12062 tablet_bootstrap.cc:654] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.314548 12244 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:20.315521 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.316157 11947 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:20.317648 12213 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.318104 12213 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.318737 12063 tablet_bootstrap.cc:654] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.320720 12213 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.321472 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.313797 12259 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.324747 12244 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.325258 12062 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.325785 12062 ts_tablet_manager.cc:1403] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.002s
I20260709 12:09:20.326462 12244 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.328306 12062 raft_consensus.cc:359] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.328971 12062 raft_consensus.cc:385] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.329248 12062 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.329571 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:20.330099 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:20.330266 11873 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:20.330152 12062 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.330763 11947 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:20.332404 12062 ts_tablet_manager.cc:1434] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:20.329169 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:20.333400 11988 leader_election.cc:343] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.335433 12062 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.336290 12061 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:20.336781 12061 ts_tablet_manager.cc:1403] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.011s
I20260709 12:09:20.340305 12061 raft_consensus.cc:359] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.341552 12061 raft_consensus.cc:385] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.341945 12061 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.342716 12061 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:20.343048 11988 leader_election.cc:343] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.343572 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.344262 12244 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.345817 12062 tablet_bootstrap.cc:654] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.348333 11771 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.349565 12061 ts_tablet_manager.cc:1434] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:20.341325 11947 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:20.350782 12061 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.351753 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:20.353772 11873 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:20.355307 12244 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:20.360823 12244 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:20.361685 12244 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.358589 12062 tablet_bootstrap.cc:492] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.354818 12273 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:20.360168 12061 tablet_bootstrap.cc:654] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.365968 12063 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.366554 12063 ts_tablet_manager.cc:1403] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.001s
W20260709 12:09:20.368432 11914 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.369643 12063 raft_consensus.cc:359] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.370430 12063 raft_consensus.cc:385] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.370761 12063 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.371484 12063 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.374195 12105 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.374886 12105 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.377281 12062 ts_tablet_manager.cc:1403] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.004s
I20260709 12:09:20.377615 12061 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:20.378160 12061 ts_tablet_manager.cc:1403] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 12:09:20.378746 12063 ts_tablet_manager.cc:1434] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:20.379778 12063 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.379935 12062 raft_consensus.cc:359] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.380645 12062 raft_consensus.cc:385] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.380920 12062 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.381595 12061 raft_consensus.cc:359] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.382086 12105 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.381976 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.382359 12061 raft_consensus.cc:385] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:20.383697 11839 leader_election.cc:343] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.384186 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.384843 12022 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:20.386189 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.387236 12063 tablet_bootstrap.cc:654] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.387355 12105 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.387861 12105 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.389372 12105 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.388055 12062 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.383224 12061 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.394819 12061 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.401090 12061 ts_tablet_manager.cc:1434] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:09:20.395476 12062 ts_tablet_manager.cc:1434] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:09:20.402477 12061 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.407066 12105 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.409583 12062 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.410763 12063 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.412272 12063 ts_tablet_manager.cc:1403] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 12:09:20.414798 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:20.415238 12063 raft_consensus.cc:359] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.415967 12062 tablet_bootstrap.cc:654] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.416050 12063 raft_consensus.cc:385] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.416496 12063 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.417135 12061 tablet_bootstrap.cc:654] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.417228 12063 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.417498 12105 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:20.418159 11839 leader_election.cc:343] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.420001 12063 ts_tablet_manager.cc:1434] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:20.421123 12063 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.426443 12244 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.426512 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:20.427212 12022 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.427030 12244 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.427884 12061 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:20.428443 12061 ts_tablet_manager.cc:1403] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.011s
I20260709 12:09:20.429242 12244 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.430972 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.432516 12062 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.433051 12062 ts_tablet_manager.cc:1403] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:09:20.433049 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.433930 11945 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:20.433761 12061 raft_consensus.cc:359] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.434556 12061 raft_consensus.cc:385] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.434844 12061 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.435539 12061 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.436465 12062 raft_consensus.cc:359] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.437336 12062 raft_consensus.cc:385] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.437719 12062 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.438432 12062 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.439600 12063 tablet_bootstrap.cc:654] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.440029 12062 ts_tablet_manager.cc:1434] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:20.441182 12062 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.441299 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:20.444188 12061 ts_tablet_manager.cc:1434] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 12:09:20.444644 11988 leader_election.cc:343] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.445176 12061 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.441144 11768 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 2, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 2 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.445940 12244 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.447225 12244 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.443630 12273 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:20.448204 12022 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:20.450672 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.452049 12147 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.452546 12147 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:20.447655 12244 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.453357 12147 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.460286 11873 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.473836 12105 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.474376 12105 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.476368 12105 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.477689 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.478081 12213 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.495253 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.478503 12213 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.498955 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.478741 12273 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.500069 12105 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.499500 12213 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.501482 12273 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.503968 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.504089 12273 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:20.505658 11914 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.507810 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.508309 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:20.509138 11988 leader_election.cc:343] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.509687 12021 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:20.509950 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.511305 12063 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:20.511154 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:20.511801 12063 ts_tablet_manager.cc:1403] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.016s
W20260709 12:09:20.512262 11914 leader_election.cc:343] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.512049 12112 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.513211 12273 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.513726 12273 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.514040 12273 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.514328 12063 raft_consensus.cc:359] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.514945 12063 raft_consensus.cc:385] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.515195 12063 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.515837 12063 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.517413 12063 ts_tablet_manager.cc:1434] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 12:09:20.509811 11988 leader_election.cc:343] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.504443 11771 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.518795 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.519517 12259 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.521646 12244 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.518338 12063 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:20.533866 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:20.542232 12062 tablet_bootstrap.cc:654] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.535643 11988 leader_election.cc:343] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.535351 12061 tablet_bootstrap.cc:654] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.533875 12105 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:20.543946 12273 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.546866 12112 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.551132 12112 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.556613 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:20.562541 11914 leader_election.cc:343] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.566609 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:20.567364 11945 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.558341 12112 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.576078 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.562541 12244 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:20.582952 11914 leader_election.cc:343] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.583500 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.584304 12147 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:20.592926 12273 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.585608 12068 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.602521 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:20.605737 12020 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.607903 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:20.626819 11914 leader_election.cc:343] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.613929 12273 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.634044 12273 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.640378 12061 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:20.641211 12061 ts_tablet_manager.cc:1403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.196s	user 0.020s	sys 0.009s
I20260709 12:09:20.647500 12063 tablet_bootstrap.cc:654] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.654006 11945 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:20.654536 12273 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.654649 12061 raft_consensus.cc:359] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.655421 12061 raft_consensus.cc:385] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.655676 11873 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.655689 12061 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.657189 12061 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.658318 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.662636 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.663350 12062 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.663841 12062 ts_tablet_manager.cc:1403] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.007s
I20260709 12:09:20.663587 12021 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:20.666711 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.670385 11872 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:20.668025 12202 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.668421 12020 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:20.669077 12062 raft_consensus.cc:359] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.669790 12244 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.687206 12062 raft_consensus.cc:385] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.687592 12062 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.688488 12244 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:20.691279 12244 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.695470 12062 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.679040 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:20.701314 12061 ts_tablet_manager.cc:1434] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 12:09:20.703696 12061 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:20.709468 12062 ts_tablet_manager.cc:1434] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.003s
I20260709 12:09:20.710752 12062 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:20.700300 12213 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.722523 12070 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.723138 12070 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.704072 12303 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.726531 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:20.728436 12303 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.735785 12303 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.722981 12213 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.742529 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.745922 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.757509 12063 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
W20260709 12:09:20.769224 11988 leader_election.cc:343] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.747465 12068 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:20.774133 11988 leader_election.cc:343] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.774559 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.775713 12068 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:20.777907 12062 tablet_bootstrap.cc:654] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.781812 12257 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.741422 12213 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:20.788407 12063 ts_tablet_manager.cc:1403] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.270s	user 0.034s	sys 0.036s
I20260709 12:09:20.777005 12068 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.792896 12273 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.798940 12070 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.796900 12112 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:20.800906 12273 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.823274 12070 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.823670 12070 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.822162 11872 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.827425 12070 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.836632 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.837574 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.838760 12021 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:20.840653 12061 tablet_bootstrap.cc:654] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.835275 12213 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.841220 12213 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.842242 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.851998 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:20.853364 12273 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:20.853526 11771 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.856588 12062 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:20.857156 12062 ts_tablet_manager.cc:1403] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.147s	user 0.007s	sys 0.014s
I20260709 12:09:20.859488 12303 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.860412 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:20.860715 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:20.859282 12063 raft_consensus.cc:359] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.861588 12063 raft_consensus.cc:385] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.861894 12063 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.862246 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.862779 12063 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:20.863377 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:20.864377 12070 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.871537 12020 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:20.882929 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:20.883771 11870 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.883036 11768 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.082485 12213 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:21.140791 12310 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:09:20.928125 12273 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.171202 12273 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.113211 12105 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:21.106916 12315 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:09:20.900610 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:20.889623 12303 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.176698 12062 raft_consensus.cc:359] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.181466 12062 raft_consensus.cc:385] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.181939 12062 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.182757 12062 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:20.988143 12311 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:09:21.192210 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 291724us
I20260709 12:09:20.980079 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:09:21.197429 11914 leader_election.cc:343] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.199064 12020 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.208392 12063 ts_tablet_manager.cc:1434] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.417s	user 0.009s	sys 0.000s
I20260709 12:09:21.211081 12062 ts_tablet_manager.cc:1434] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.354s	user 0.011s	sys 0.000s
I20260709 12:09:21.212230 12063 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:21.213203 12062 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:21.197671 12303 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.222251 12061 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
W20260709 12:09:21.222311 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 358962us
I20260709 12:09:21.223201 12061 ts_tablet_manager.cc:1403] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.520s	user 0.046s	sys 0.044s
I20260709 12:09:21.214978 12303 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.230510 11869 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:21.234654 12317 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:21.243240 12070 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.231611 12303 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.243808 12070 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:21.282209 11839 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.283010 12070 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.274292 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:21.312247 12312 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.312906 12312 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.315106 12312 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.320067 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:21.324066 12062 tablet_bootstrap.cc:654] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.316461 12061 raft_consensus.cc:359] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.327458 12061 raft_consensus.cc:385] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.327958 12061 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.328994 12061 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.317474 11870 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:21.338121 11872 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.339231 12063 tablet_bootstrap.cc:654] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.340272 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56954.6us
I20260709 12:09:21.342782 12061 ts_tablet_manager.cc:1434] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.119s	user 0.004s	sys 0.005s
I20260709 12:09:21.344103 12061 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:21.345842 11867 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.355489 11947 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:21.342984 12020 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:21.362105 12273 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.362907 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.369874 12322 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.369915 12147 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.368928 11988 leader_election.cc:343] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.371146 12147 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.373967 12147 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.367516 12303 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.379151 12303 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.410382 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:21.415904 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:21.417105 12022 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:21.432992 12105 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:21.436803 11988 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.437104 12062 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:21.437685 12062 ts_tablet_manager.cc:1403] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.225s	user 0.013s	sys 0.005s
I20260709 12:09:21.438002 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:21.465494 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:21.469750 11914 leader_election.cc:343] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.471550 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:21.474661 12062 raft_consensus.cc:359] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.475236 12062 raft_consensus.cc:385] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.475467 12062 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.476065 12062 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.477816 12328 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.479791 12328 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.480348 12328 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.477975 12326 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.498524 12326 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:21.499461 12326 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.493920 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.507977 12257 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.559491 12328 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:21.562453 12334 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:09:21.585009 12328 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.565214 12062 ts_tablet_manager.cc:1434] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.000s
I20260709 12:09:21.565464 12063 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:21.586191 12063 ts_tablet_manager.cc:1403] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.377s	user 0.033s	sys 0.047s
I20260709 12:09:21.600696 12062 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:21.568619 12061 tablet_bootstrap.cc:654] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.571174 11988 leader_election.cc:343] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.605748 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:21.607435 12332 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.610525 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:21.611219 12020 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.616113 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.620344 12020 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:21.622391 12062 tablet_bootstrap.cc:654] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.623576 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:21.579074 11867 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.580013 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:21.581768 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:21.582845 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:21.601493 12063 raft_consensus.cc:359] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.626906 12063 raft_consensus.cc:385] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.575326 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:21.627317 12063 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.624712 12330 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.632597 12021 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:21.632947 12017 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:21.633860 12330 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:21.634770 12330 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.638068 12063 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.639680 12063 ts_tablet_manager.cc:1434] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:09:21.640615 12063 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:21.642032 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:21.642839 11945 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:21.652279 12068 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:21.655282 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.661234 11946 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:21.657009 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:21.666720 12328 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.667341 12328 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.668711 12312 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.669157 12312 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.669505 12312 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.733937 12061 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:21.735054 12061 ts_tablet_manager.cc:1403] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.391s	user 0.009s	sys 0.015s
W20260709 12:09:21.736284 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 80271us
I20260709 12:09:21.742190 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:21.742972 12147 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.744186 12063 tablet_bootstrap.cc:654] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.677641 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:21.676476 12328 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.768978 11914 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:21.775190 12320 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.776387 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.748219 12312 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.790895 12061 raft_consensus.cc:359] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.792033 12061 raft_consensus.cc:385] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.792354 12061 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.793269 12061 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.808615 12213 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.811488 12312 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.808790 12323 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:09:21.818107 12061 ts_tablet_manager.cc:1434] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 12:09:21.819381 12061 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:21.828195 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:21.834307 12062 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:21.835809 12062 ts_tablet_manager.cc:1403] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.235s	user 0.027s	sys 0.025s
I20260709 12:09:21.841101 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:21.841866 12017 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.847409 11914 leader_election.cc:343] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.870684 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:21.873608 12244 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.874351 12244 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.892721 12061 tablet_bootstrap.cc:654] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.893126 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:21.896274 12327 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.898674 12303 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.901684 12244 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:21.904915 12017 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:21.906981 11943 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.908769 12062 raft_consensus.cc:359] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.909469 12062 raft_consensus.cc:385] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.909807 12062 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.897013 12327 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.907809 11771 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.915257 12062 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.919087 12313 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.919566 12062 ts_tablet_manager.cc:1434] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.014s
I20260709 12:09:21.918180 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:21.921608 12062 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:21.919603 12313 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.932576 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.933454 11947 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:21.941851 12320 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.950874 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:21.960384 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:21.960762 12070 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:21.961287 12213 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.964655 12213 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.965027 12213 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.967161 12313 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:21.957492 12320 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:21.970033 12320 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.986799 12063 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
W20260709 12:09:21.987262 11988 leader_election.cc:343] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.987377 12063 ts_tablet_manager.cc:1403] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.347s	user 0.005s	sys 0.019s
I20260709 12:09:21.989976 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:21.995285 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:21.995986 11947 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:21.999282 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.001178 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:21.992723 11771 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:22.002766 11988 leader_election.cc:343] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.001232 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.005795 12322 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.006222 12322 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.006554 12322 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.998644 12213 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.011838 12019 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:22.012495 12213 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.013986 12061 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.014460 12061 ts_tablet_manager.cc:1403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.195s	user 0.025s	sys 0.012s
W20260709 12:09:22.011278 11914 leader_election.cc:343] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.018878 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:22.019447 11947 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.020140 12063 raft_consensus.cc:359] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.020887 12063 raft_consensus.cc:385] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.021204 12063 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.022236 12063 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:21.982100 12327 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.017477 12061 raft_consensus.cc:359] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.026571 12061 raft_consensus.cc:385] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.029292 12061 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.027534 11947 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:22.029170 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:22.027258 12322 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.032444 12061 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.036062 12061 ts_tablet_manager.cc:1434] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:09:22.031563 12063 ts_tablet_manager.cc:1434] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 12:09:22.037354 12063 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:22.038956 12061 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.039098 12062 tablet_bootstrap.cc:654] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.039419 12322 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.046824 12061 tablet_bootstrap.cc:654] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.052232 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.017369 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:22.054008 12313 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.056615 12322 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.057199 12322 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:22.058213 12063 tablet_bootstrap.cc:654] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.058055 12322 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:22.067189 11988 leader_election.cc:343] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.070873 12061 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.071329 12061 ts_tablet_manager.cc:1403] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.005s
I20260709 12:09:22.071362 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:22.071990 11947 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.072450 12070 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.074018 12061 raft_consensus.cc:359] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.074733 12061 raft_consensus.cc:385] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.075006 12061 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.075657 12061 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.080076 11947 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:22.083184 12063 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:22.083241 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.086287 12063 ts_tablet_manager.cc:1403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.004s
I20260709 12:09:22.086719 12327 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.087282 12062 tablet_bootstrap.cc:492] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.087248 12327 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:22.087921 12062 ts_tablet_manager.cc:1403] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.002s
I20260709 12:09:22.084106 12061 ts_tablet_manager.cc:1434] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:22.088253 12327 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.089033 12061 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.089949 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:22.085429 11769 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.092746 12063 raft_consensus.cc:359] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.093516 12063 raft_consensus.cc:385] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:22.097477 11988 leader_election.cc:343] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.104348 12063 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.097487 12061 tablet_bootstrap.cc:654] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.104656 12320 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.118010 12320 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.120427 12320 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.105861 12325 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.122512 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.123693 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.124469 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.125480 12312 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.103775 12062 raft_consensus.cc:359] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.128506 12062 raft_consensus.cc:385] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.128849 12062 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.131996 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.132148 12312 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:22.136902 12312 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.137290 12312 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.137656 12312 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.130018 12063 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.145026 12062 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.145920 12061 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.146000 11867 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.146687 12061 ts_tablet_manager.cc:1403] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 12:09:22.150234 12061 raft_consensus.cc:359] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.150978 12061 raft_consensus.cc:385] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.151260 12061 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.152030 12061 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.153888 12063 ts_tablet_manager.cc:1434] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.005s
I20260709 12:09:22.155165 12063 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:22.114157 11769 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.159114 12061 ts_tablet_manager.cc:1434] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:09:22.160316 12062 ts_tablet_manager.cc:1434] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 12:09:22.161482 12322 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.162135 12322 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.162665 12062 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.164645 12322 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.166867 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.168058 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.162137 12312 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.160017 11769 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.160288 12061 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
W20260709 12:09:22.171012 11988 leader_election.cc:343] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.171927 11988 leader_election.cc:343] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.172757 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:22.173488 11867 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.180740 11867 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:22.182008 12062 tablet_bootstrap.cc:654] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.182147 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:22.183308 12327 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.184008 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.185348 12320 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.185930 12320 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:22.186421 12061 tablet_bootstrap.cc:654] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.186864 12320 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.187492 12063 tablet_bootstrap.cc:654] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.193490 11867 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.196264 12312 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.199630 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:22.200309 12017 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.243070 12063 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:22.243620 12063 ts_tablet_manager.cc:1403] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.008s
I20260709 12:09:22.244112 11771 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.246503 12061 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.247030 12061 ts_tablet_manager.cc:1403] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.027s
I20260709 12:09:22.247913 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:22.275867 12061 raft_consensus.cc:359] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.276674 12061 raft_consensus.cc:385] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.276995 12061 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.279356 12061 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.281687 12061 ts_tablet_manager.cc:1434] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 12:09:22.282713 12061 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.288100 12063 raft_consensus.cc:359] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.288882 12063 raft_consensus.cc:385] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.289153 12063 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.299602 12061 tablet_bootstrap.cc:654] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.306485 12063 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.308440 12062 tablet_bootstrap.cc:492] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.308995 12062 ts_tablet_manager.cc:1403] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.018s
I20260709 12:09:22.309424 12063 ts_tablet_manager.cc:1434] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 12:09:22.310556 12063 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:22.317026 12062 raft_consensus.cc:359] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.318045 12062 raft_consensus.cc:385] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.318409 12062 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.319478 12062 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.324863 12320 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.326114 12320 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.328285 12320 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.333606 12063 tablet_bootstrap.cc:654] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.332830 12062 ts_tablet_manager.cc:1434] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:09:22.335103 12062 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.335698 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.338441 12017 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.341377 12061 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.341991 12061 ts_tablet_manager.cc:1403] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.012s
I20260709 12:09:22.344552 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.346572 12062 tablet_bootstrap.cc:654] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.348141 12061 raft_consensus.cc:359] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.349637 12061 raft_consensus.cc:385] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.349942 12061 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.351704 11914 leader_election.cc:343] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.357371 12061 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.358846 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:22.364176 12313 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.364658 12313 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.365064 12313 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.366873 12061 ts_tablet_manager.cc:1434] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:22.368453 12061 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.375046 12062 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.377197 12061 tablet_bootstrap.cc:654] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.377831 12062 ts_tablet_manager.cc:1403] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.014s
I20260709 12:09:22.384644 12062 raft_consensus.cc:359] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.386004 12062 raft_consensus.cc:385] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.386659 12062 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.387710 12062 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.392328 12062 ts_tablet_manager.cc:1434] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:09:22.394873 12062 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.397717 12061 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.398741 12061 ts_tablet_manager.cc:1403] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.009s
I20260709 12:09:22.404409 12062 tablet_bootstrap.cc:654] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.410837 12330 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.412410 12330 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.413924 12326 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.414369 12061 raft_consensus.cc:359] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.415123 12061 raft_consensus.cc:385] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.415001 12326 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.415729 12061 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.416553 12061 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.417833 12330 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.417320 12326 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.418987 12061 ts_tablet_manager.cc:1434] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:22.420132 12061 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.426379 12061 tablet_bootstrap.cc:654] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.435529 12062 tablet_bootstrap.cc:492] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.436105 12062 ts_tablet_manager.cc:1403] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:09:22.444904 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.445152 12061 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.446107 12061 ts_tablet_manager.cc:1403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 12:09:22.449323 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.450219 11947 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:22.449837 12061 raft_consensus.cc:359] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.450728 12061 raft_consensus.cc:385] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.451113 12061 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.442833 12062 raft_consensus.cc:359] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.452435 12061 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.453387 12062 raft_consensus.cc:385] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.453768 12062 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.454478 12062 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.456161 12061 ts_tablet_manager.cc:1434] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:09:22.456782 12062 ts_tablet_manager.cc:1434] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:22.457466 12061 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.458384 12062 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.465327 12061 tablet_bootstrap.cc:654] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.472856 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.473596 12019 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.475242 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.475893 11867 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.477620 12062 tablet_bootstrap.cc:654] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.486311 12061 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.486939 12061 ts_tablet_manager.cc:1403] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 12:09:22.471364 12313 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.488854 12313 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.490214 12061 raft_consensus.cc:359] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.491227 12061 raft_consensus.cc:385] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.496268 12062 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.496923 12062 ts_tablet_manager.cc:1403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.010s
I20260709 12:09:22.500461 12062 raft_consensus.cc:359] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.501190 12062 raft_consensus.cc:385] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.501528 12062 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.491572 12061 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.503295 12062 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.505987 12061 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.508119 12061 ts_tablet_manager.cc:1434] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:09:22.509196 12061 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.509981 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:22.512074 12328 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.513527 12062 ts_tablet_manager.cc:1434] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 12:09:22.514480 12062 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.516477 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.517279 12320 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.517692 12320 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.518013 12320 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.518790 12327 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.520079 12328 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.521008 12062 tablet_bootstrap.cc:654] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.521083 12063 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:22.521675 12063 ts_tablet_manager.cc:1403] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.064s
I20260709 12:09:22.524348 12063 raft_consensus.cc:359] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.525007 12061 tablet_bootstrap.cc:654] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.525075 12063 raft_consensus.cc:385] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.525571 12063 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.527352 12320 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.547768 12213 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.548537 12213 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.551857 12213 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.526484 12063 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.552772 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:22.553572 11867 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.558197 12063 ts_tablet_manager.cc:1434] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:09:22.559649 12063 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:22.560285 12327 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.574810 11914 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.569591 11867 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:22.576727 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.580185 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:22.583053 12021 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.580862 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.581617 12062 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:22.584781 12062 ts_tablet_manager.cc:1403] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.007s
I20260709 12:09:22.581569 12326 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.565943 12327 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.602005 12213 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.613786 12312 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.614485 12312 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.614368 12213 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.593858 12326 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.620777 12213 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:22.631321 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56229.4us
I20260709 12:09:22.633303 12062 raft_consensus.cc:359] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.634121 12062 raft_consensus.cc:385] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.634433 12062 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.633386 11988 leader_election.cc:343] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.635044 12062 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.639298 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.648491 12021 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:22.656495 12326 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.657203 12312 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.658342 12320 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.659688 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.682005 12062 ts_tablet_manager.cc:1434] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.001s
I20260709 12:09:22.683588 12062 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:22.694250 12061 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:22.695317 12061 ts_tablet_manager.cc:1403] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.060s
I20260709 12:09:22.691253 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.706827 12386 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.707468 12386 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.709988 12327 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.706869 11871 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.709398 12386 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:22.716974 11988 consensus_peers.cc:597] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:22.717653 11988 leader_election.cc:343] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.718021 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:22.719107 11988 leader_election.cc:343] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.722031 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.724476 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.724812 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:22.725085 11988 leader_election.cc:343] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.725447 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:22.726687 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.727321 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:22.727912 11871 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.728176 12318 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.728260 12312 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.728703 12318 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:22.729768 12318 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.731186 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.732172 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:22.728754 12312 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.733618 12312 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.737993 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.721807 12386 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.743319 12061 raft_consensus.cc:359] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.744401 12061 raft_consensus.cc:385] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.744741 12061 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.740648 12389 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:22.746145 12061 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.750286 12061 ts_tablet_manager.cc:1434] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 12:09:22.751173 12213 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.755697 12063 tablet_bootstrap.cc:654] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.751696 12213 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:22.759912 11914 leader_election.cc:343] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.766073 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.766894 12019 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:22.767257 12062 tablet_bootstrap.cc:654] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.768497 11988 leader_election.cc:343] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.773185 11988 leader_election.cc:343] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.761164 12389 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.776255 11988 leader_election.cc:343] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.780440 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:22.777030 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:22.782351 12320 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.781199 12017 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
W20260709 12:09:22.788599 11988 leader_election.cc:343] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.789170 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:22.794543 12387 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.799125 12389 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.802629 12061 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:22.792706 12386 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.804665 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:22.797045 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:22.807821 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:22.808049 12020 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.811484 12326 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.811923 12326 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.812255 12326 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.813365 11871 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:22.814951 12213 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:22.818959 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:22.820294 11988 leader_election.cc:343] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.828562 12330 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.910826 12322 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.911375 12322 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:22.912953 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.866171 12330 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:22.913352 12322 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:22.973306 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58978.9us
I20260709 12:09:22.974058 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:22.991045 12330 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:22.948985 12312 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.077065 12063 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:23.077840 12063 ts_tablet_manager.cc:1403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.518s	user 0.019s	sys 0.041s
I20260709 12:09:23.062723 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:23.107693 12062 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.108528 12062 ts_tablet_manager.cc:1403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.425s	user 0.010s	sys 0.005s
I20260709 12:09:23.098788 12320 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:23.126082 12393 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:09:23.141145 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.123274 12020 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:23.133935 12320 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:09:23.145274 11988 leader_election.cc:343] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.188925 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43695.4us
I20260709 12:09:23.144757 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.203516 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.206709 12063 raft_consensus.cc:359] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.207811 12063 raft_consensus.cc:385] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.208202 12063 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.221414 12062 raft_consensus.cc:359] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.223456 12062 raft_consensus.cc:385] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.223670 12062 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.204813 12318 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:09:23.226616 12062 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.228581 12405 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.235702 12062 ts_tablet_manager.cc:1434] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.002s
I20260709 12:09:23.224303 12320 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.241681 12062 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:23.249922 12061 tablet_bootstrap.cc:654] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.268920 12326 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.271257 12326 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.278198 12062 tablet_bootstrap.cc:654] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.283212 12399 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.220s	user 0.003s	sys 0.000s
I20260709 12:09:23.290313 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:23.291675 12016 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.301178 12063 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.306663 12063 ts_tablet_manager.cc:1434] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.228s	user 0.010s	sys 0.000s
I20260709 12:09:23.308334 12063 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:23.308929 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:23.331364 12312 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.366034 11839 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.367223 12325 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:23.383970 11988 leader_election.cc:343] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.385998 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.386891 12409 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:23.387939 11988 leader_election.cc:343] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.388339 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.390208 12409 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.394843 12016 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:23.396014 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:23.396761 12063 tablet_bootstrap.cc:654] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.399158 12062 tablet_bootstrap.cc:492] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.399657 12062 ts_tablet_manager.cc:1403] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.002s
I20260709 12:09:23.397338 11872 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.401880 12414 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.402379 12062 raft_consensus.cc:359] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.403097 12062 raft_consensus.cc:385] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.403368 12062 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.404016 12062 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.410197 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:23.410812 11868 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.427620 12061 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.428138 12061 ts_tablet_manager.cc:1403] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.626s	user 0.013s	sys 0.019s
I20260709 12:09:23.437335 12062 ts_tablet_manager.cc:1434] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:09:23.438371 12062 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
W20260709 12:09:23.456549 11914 leader_election.cc:343] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.457468 11868 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:23.465232 12061 raft_consensus.cc:359] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.466230 12061 raft_consensus.cc:385] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.466612 12061 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.467489 12061 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.460391 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:23.476392 12062 tablet_bootstrap.cc:654] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.476725 12016 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.477607 12061 ts_tablet_manager.cc:1434] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.006s
I20260709 12:09:23.480775 12061 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.491055 12063 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:23.498260 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:23.501860 12405 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.510779 12405 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.511305 12405 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:23.512161 12405 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.515547 12016 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:23.515841 12061 tablet_bootstrap.cc:654] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.532516 12325 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.540313 12061 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.540858 12061 ts_tablet_manager.cc:1403] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 12:09:23.540825 12325 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.547451 12061 raft_consensus.cc:359] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.548237 12061 raft_consensus.cc:385] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.548504 12061 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.549166 12061 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.549526 12325 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.552722 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:23.552934 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:23.553460 12020 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:23.553913 12063 ts_tablet_manager.cc:1403] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.246s	user 0.049s	sys 0.024s
I20260709 12:09:23.533347 11768 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.556737 12061 ts_tablet_manager.cc:1434] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:09:23.557600 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:23.558769 12325 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.560526 12405 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.561072 12405 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:23.561995 12405 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.563441 12062 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.563973 12062 ts_tablet_manager.cc:1403] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.014s
I20260709 12:09:23.564682 12325 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.565258 12325 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.566627 12062 raft_consensus.cc:359] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.567476 12062 raft_consensus.cc:385] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.567826 12062 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.568337 12063 raft_consensus.cc:359] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.569190 12063 raft_consensus.cc:385] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.569483 12063 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.574601 12105 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.575155 12105 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.577068 12105 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.577615 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.578394 11944 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:23.580235 12061 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.581298 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.583148 12062 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.583487 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:23.586905 12063 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.596896 12062 ts_tablet_manager.cc:1434] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.007s
I20260709 12:09:23.597971 12062 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:23.601140 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.603358 12105 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.607832 12063 ts_tablet_manager.cc:1434] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 12:09:23.619724 12061 tablet_bootstrap.cc:654] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.628237 12063 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:23.611971 12325 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.630723 12325 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.633778 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:23.636451 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:23.637253 11946 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.636737 12019 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.661860 12063 tablet_bootstrap.cc:654] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.661867 12062 tablet_bootstrap.cc:654] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.670863 12061 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.671434 12061 ts_tablet_manager.cc:1403] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.023s
I20260709 12:09:23.670902 11946 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:23.677047 12019 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:23.679838 12061 raft_consensus.cc:359] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.680585 12061 raft_consensus.cc:385] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.680860 12061 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.681568 12063 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:23.681501 12061 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.682104 12063 ts_tablet_manager.cc:1403] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.000s
I20260709 12:09:23.681967 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:23.682888 12325 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.683384 12325 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:23.683719 12061 ts_tablet_manager.cc:1434] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 12:09:23.684281 12325 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.686471 12063 raft_consensus.cc:359] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.687206 12063 raft_consensus.cc:385] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.687937 12063 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.688027 12061 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.688640 12063 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.690925 12063 ts_tablet_manager.cc:1434] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:23.692063 12063 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:23.698184 11769 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.699370 12063 tablet_bootstrap.cc:654] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.700232 12061 tablet_bootstrap.cc:654] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.700316 11769 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.718837 12061 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.719305 12061 ts_tablet_manager.cc:1403] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 12:09:23.719446 12062 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.721899 12061 raft_consensus.cc:359] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.722626 12061 raft_consensus.cc:385] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.722889 12061 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.723515 12061 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.724464 12062 ts_tablet_manager.cc:1403] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.127s	user 0.006s	sys 0.014s
I20260709 12:09:23.728643 12062 raft_consensus.cc:359] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.730459 12062 raft_consensus.cc:385] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.731215 12062 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.732270 12062 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.732455 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.735741 12062 ts_tablet_manager.cc:1434] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:09:23.737941 12061 ts_tablet_manager.cc:1434] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:09:23.735904 11872 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.741333 12061 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.749001 12063 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:23.749657 12063 ts_tablet_manager.cc:1403] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.011s
I20260709 12:09:23.752739 12063 raft_consensus.cc:359] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.753472 12063 raft_consensus.cc:385] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.753818 12063 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.754644 12063 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.756510 12061 tablet_bootstrap.cc:654] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.757107 12063 ts_tablet_manager.cc:1434] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:09:23.760007 12062 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:23.766600 12063 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:23.767089 12062 tablet_bootstrap.cc:654] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.784371 12061 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.784929 12061 ts_tablet_manager.cc:1403] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.007s
I20260709 12:09:23.788476 12061 raft_consensus.cc:359] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.789220 12061 raft_consensus.cc:385] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.789494 12061 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.790458 12390 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.791086 12390 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.792663 12062 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.793223 12062 ts_tablet_manager.cc:1403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.009s
I20260709 12:09:23.793262 12390 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:23.794883 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:23.796432 11988 leader_election.cc:343] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.797689 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:23.790252 12061 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.798389 11872 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:23.800482 12062 raft_consensus.cc:359] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.805713 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.806078 12062 raft_consensus.cc:385] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.806353 12062 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.807032 12062 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.807768 12390 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.808147 12390 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.808501 12390 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.809401 12062 ts_tablet_manager.cc:1434] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:09:23.810336 12061 ts_tablet_manager.cc:1434] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:09:23.801885 12063 tablet_bootstrap.cc:654] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.811523 12061 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.819442 12061 tablet_bootstrap.cc:654] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.810496 12062 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:23.825477 12390 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.828027 12390 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:23.831533 12062 tablet_bootstrap.cc:654] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.833777 12403 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.835682 12063 tablet_bootstrap.cc:492] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:23.836329 12063 ts_tablet_manager.cc:1403] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.007s
I20260709 12:09:23.838699 12213 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.839267 12213 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.839673 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:23.842518 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:23.843171 11872 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.849352 12403 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.849879 12213 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:23.850543 12325 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.851351 12325 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.854553 12325 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.859633 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.851475 11872 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
W20260709 12:09:23.861516 11839 leader_election.cc:343] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.863130 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.863832 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:23.867010 12063 raft_consensus.cc:359] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.867744 12063 raft_consensus.cc:385] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.868022 12063 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.874585 11988 leader_election.cc:343] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.868860 12063 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.901074 12063 ts_tablet_manager.cc:1434] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
W20260709 12:09:23.901216 11988 leader_election.cc:343] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.909989 12063 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:23.912541 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.913437 12213 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.913962 12213 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:23.914810 12213 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.918841 12409 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.919363 12409 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.921448 12409 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:23.922015 11988 leader_election.cc:343] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.922525 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.923148 12063 tablet_bootstrap.cc:654] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.923264 12409 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.927625 12062 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.928128 12062 ts_tablet_manager.cc:1403] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.047s
I20260709 12:09:23.931427 12062 raft_consensus.cc:359] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.932086 12062 raft_consensus.cc:385] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.932333 12062 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.933071 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:23.935230 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:23.935854 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
I20260709 12:09:23.933719 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:23.936621 12019 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:23.937727 12061 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.937644 12062 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.938498 12061 ts_tablet_manager.cc:1403] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.127s	user 0.025s	sys 0.006s
I20260709 12:09:23.939992 12062 ts_tablet_manager.cc:1434] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:23.940938 12062 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
W20260709 12:09:23.943940 11988 leader_election.cc:343] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.950197 12061 raft_consensus.cc:359] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.951373 12061 raft_consensus.cc:385] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.951728 12061 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.952641 12061 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.955183 12061 ts_tablet_manager.cc:1434] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:23.956168 12061 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Bootstrap starting.
I20260709 12:09:23.956063 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:23.957476 12325 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.957904 12325 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.958274 12325 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.963825 12318 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.964895 12062 tablet_bootstrap.cc:654] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.964597 12318 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.965039 12061 tablet_bootstrap.cc:654] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.967473 12390 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.967535 12318 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:23.968082 12390 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.968971 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:23.970201 12390 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:23.973345 12390 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.973979 12390 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.976143 12390 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:23.975999 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:23.977223 11871 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:23.978924 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:23.980046 12388 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.976547 12062 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:23.982090 12062 ts_tablet_manager.cc:1403] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 12:09:23.985409 12062 raft_consensus.cc:359] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.986209 12062 raft_consensus.cc:385] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.986543 12062 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.988579 12062 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.991338 12062 ts_tablet_manager.cc:1434] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:09:23.992486 12061 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: No bootstrap required, opened a new log
I20260709 12:09:23.992982 12061 ts_tablet_manager.cc:1403] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.000s
I20260709 12:09:23.995643 12061 raft_consensus.cc:359] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.996438 12061 raft_consensus.cc:385] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.996747 12061 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.997341 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.998497 12062 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:23.999199 12325 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:23.997424 12061 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.002056 12318 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.004824 12061 ts_tablet_manager.cc:1434] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:24.006403 12062 tablet_bootstrap.cc:654] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.015612 12318 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.016275 12318 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.018213 12318 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.021107 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.022192 12015 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.022724 12388 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.024675 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.025509 11871 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.030011 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.026751 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.030903 12313 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.031276 12313 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.031602 12313 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.031677 12213 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.032330 12213 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.032759 12213 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.032018 12063 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.037340 12063 ts_tablet_manager.cc:1403] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.030s
I20260709 12:09:24.039745 12313 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.050060 12325 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.050835 12403 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.052446 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.052522 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.052697 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.057883 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.067221 12390 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.065378 12063 raft_consensus.cc:359] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.069069 12063 raft_consensus.cc:385] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.068828 12390 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.074915 12390 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:24.077461 12313 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.080084 12213 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.082934 12213 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:24.086511 11988 leader_election.cc:343] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.087901 11988 leader_election.cc:343] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.069335 12063 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.089135 12063 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.091208 12388 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.092267 12388 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.093500 12063 ts_tablet_manager.cc:1434] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:09:24.094586 12063 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.095201 12388 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.098104 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:09:24.100735 11988 leader_election.cc:343] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.101387 11770 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.101240 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:24.103645 11988 leader_election.cc:343] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.104043 12213 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.104626 12062 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.105144 12062 ts_tablet_manager.cc:1403] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.107s	user 0.034s	sys 0.056s
I20260709 12:09:24.107975 12062 raft_consensus.cc:359] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.108743 12062 raft_consensus.cc:385] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.109020 12062 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.109654 12062 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.111835 12062 ts_tablet_manager.cc:1434] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:24.112746 12062 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:24.113667 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.114253 11872 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.118477 12062 tablet_bootstrap.cc:654] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.104072 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.120666 11872 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.121798 12213 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.123754 12325 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.124316 12063 tablet_bootstrap.cc:654] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.124248 12325 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.125239 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.126233 12021 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.126571 12325 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.136483 12021 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.136797 12325 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.137456 12325 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.139592 12325 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.141626 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.142282 12020 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.145779 12213 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.146046 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.146414 12213 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.146857 12016 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.145949 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.147774 12015 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.148566 12213 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:24.148640 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:24.149677 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.150583 12062 tablet_bootstrap.cc:492] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.151068 12062 ts_tablet_manager.cc:1403] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.020s
I20260709 12:09:24.154412 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:24.154963 11839 leader_election.cc:343] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.155378 12313 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.155915 12313 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:24.156746 12313 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.159102 12062 raft_consensus.cc:359] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.159840 12062 raft_consensus.cc:385] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.155395 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.160166 12062 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.160540 12015 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.160856 12062 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:24.162534 11988 leader_election.cc:343] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.152931 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.162969 12062 ts_tablet_manager.cc:1434] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:09:24.163237 11988 leader_election.cc:343] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.167711 11914 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.164652 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.170787 12062 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
W20260709 12:09:24.171411 11988 leader_election.cc:343] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.172053 11871 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.177124 12062 tablet_bootstrap.cc:654] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.182160 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:24.183130 12328 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.183555 12328 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.183876 12328 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.190500 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.191479 11941 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.194124 12020 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:24.200227 12328 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.203367 12328 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.201426 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:24.206058 12455 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.206164 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.206581 12455 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.206990 12455 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.207158 12325 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.207705 12325 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:24.208554 12325 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.210664 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.211555 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.212117 11872 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.212877 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.213268 12063 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.213784 12063 ts_tablet_manager.cc:1403] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.011s
I20260709 12:09:24.214020 12455 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.216089 12455 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.216558 12063 raft_consensus.cc:359] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.217229 12063 raft_consensus.cc:385] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.217947 12063 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.220321 12063 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.220856 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:24.222424 12063 ts_tablet_manager.cc:1434] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:24.222677 12062 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.223217 12062 ts_tablet_manager.cc:1403] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.020s
I20260709 12:09:24.223698 12063 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.223784 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.225905 12062 raft_consensus.cc:359] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.226586 12062 raft_consensus.cc:385] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.226832 12062 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.219467 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.227916 12313 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.228310 12313 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.228668 12313 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.228608 12403 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.230710 12063 tablet_bootstrap.cc:654] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.232046 12403 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.232549 12403 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.234966 12403 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.242370 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.243113 11872 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.240958 12062 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.247421 12062 ts_tablet_manager.cc:1434] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:24.248349 12062 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:24.248462 12063 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.249037 12063 ts_tablet_manager.cc:1403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 12:09:24.251932 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.251894 12063 raft_consensus.cc:359] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.252765 12021 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
I20260709 12:09:24.256722 12313 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.257861 12062 tablet_bootstrap.cc:654] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.258925 12313 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.252856 12063 raft_consensus.cc:385] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.264102 12063 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.261564 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.261869 12391 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.265116 12063 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.266608 12391 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.267491 12405 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.267885 12405 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.268210 12405 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.268450 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.268922 12391 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:24.269308 11871 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:09:24.273172 11988 leader_election.cc:343] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.273627 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.274677 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:24.275571 11988 leader_election.cc:343] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.275921 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.276469 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.276782 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.277379 12021 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.277197 11941 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 0.
W20260709 12:09:24.279176 11839 leader_election.cc:343] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.281232 12213 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.281158 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.282051 12213 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.282495 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:24.282996 12062 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.283143 11946 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.283536 12062 ts_tablet_manager.cc:1403] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.003s
I20260709 12:09:24.283565 12390 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.286346 12405 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.286501 12062 raft_consensus.cc:359] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.287536 12062 raft_consensus.cc:385] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.287812 12062 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.288313 12405 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.290373 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.290879 12063 ts_tablet_manager.cc:1434] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:09:24.290977 12020 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.292465 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:24.293238 11947 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:24.293417 12063 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.298487 12021 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.303443 12063 tablet_bootstrap.cc:654] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.306217 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.309027 11872 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.310734 12325 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.303040 11769 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.313052 11770 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.318159 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:24.319563 12318 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.320271 12318 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:24.321141 12318 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.323068 11946 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:24.326275 12062 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.327428 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.328435 12457 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.328997 12457 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:24.329929 12457 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.334713 12213 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:24.335808 12213 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.338677 12062 ts_tablet_manager.cc:1434] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:09:24.339471 12020 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.339913 12062 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
W20260709 12:09:24.343070 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 60856.7us
I20260709 12:09:24.344035 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.345096 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.345726 12405 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.345927 12020 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:24.346247 12063 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.346462 12405 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:24.346693 12063 ts_tablet_manager.cc:1403] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.018s
I20260709 12:09:24.346839 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.347376 12021 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.347389 12405 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.352239 12063 raft_consensus.cc:359] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.352912 12063 raft_consensus.cc:385] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.353174 12063 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.353830 12063 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.356971 12063 ts_tablet_manager.cc:1434] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:24.357906 12063 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.360558 11872 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.363791 12063 tablet_bootstrap.cc:654] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.370591 12021 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:24.381299 12313 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.381978 12313 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.384092 12313 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.384308 12062 tablet_bootstrap.cc:654] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.374167 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.376734 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.378224 11770 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.387760 12390 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.388270 12105 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.388298 12390 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.388875 12390 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.389612 12105 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.392527 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:24.396363 11914 leader_election.cc:343] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.395524 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.402812 12021 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
W20260709 12:09:24.409009 11988 leader_election.cc:343] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.410094 12062 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.418658 12062 ts_tablet_manager.cc:1403] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.009s
I20260709 12:09:24.419997 12390 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.415395 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:24.416971 11770 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.424878 12390 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:24.426074 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:24.426844 11947 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.433733 12403 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.434242 12403 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.434624 12403 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.441522 11947 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:24.446318 12062 raft_consensus.cc:359] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.455188 12062 raft_consensus.cc:385] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.450199 11769 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.457505 12062 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.459600 12062 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.461829 12062 ts_tablet_manager.cc:1434] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:09:24.463184 12063 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.462556 11769 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.463644 12063 ts_tablet_manager.cc:1403] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.106s	user 0.045s	sys 0.033s
I20260709 12:09:24.443635 12403 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.452531 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.450398 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:24.456473 12457 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.465988 12213 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.465862 12457 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.466542 12213 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:24.466359 12063 raft_consensus.cc:359] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.467010 12063 raft_consensus.cc:385] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.467283 12063 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.467406 12213 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.468004 12457 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.467953 12063 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.472225 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.475406 12403 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.477200 12063 ts_tablet_manager.cc:1434] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:09:24.476963 12465 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.479599 11988 leader_election.cc:343] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.481938 12063 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.490801 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.491493 12015 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.494588 12062 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:24.495800 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:24.499408 11768 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.501930 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:24.499480 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.503400 12015 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.505884 12457 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.506444 12457 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.506819 12457 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.510723 11914 leader_election.cc:343] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.512187 12473 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.512900 12473 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.518272 12473 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.520521 12015 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:24.522169 12063 tablet_bootstrap.cc:654] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.531932 11839 leader_election.cc:343] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.534888 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.535243 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:24.535573 12015 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.537608 12403 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.538759 12403 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:24.540490 12062 tablet_bootstrap.cc:654] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.540998 12213 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.539844 12403 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.556447 12063 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.543144 12457 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.557011 12063 ts_tablet_manager.cc:1403] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.001s
I20260709 12:09:24.538610 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.558228 11946 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:24.559784 12457 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.560775 12063 raft_consensus.cc:359] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.561583 12063 raft_consensus.cc:385] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.561911 12063 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.562764 12063 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.565238 12063 ts_tablet_manager.cc:1434] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:24.566226 12063 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.571458 12062 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.572072 12062 ts_tablet_manager.cc:1403] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.004s
I20260709 12:09:24.543820 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:09:24.617102 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 73141.3us
I20260709 12:09:24.634756 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:24.640491 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.641429 12016 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.642457 11770 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.572642 12063 tablet_bootstrap.cc:654] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.671490 12318 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.651443 12484 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.691838 12484 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.692401 12484 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.672521 12318 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:24.693835 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46513.3us
I20260709 12:09:24.714504 12105 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.714241 12062 raft_consensus.cc:359] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.715629 12062 raft_consensus.cc:385] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.715463 12105 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.716064 12062 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.717903 12105 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.717007 12062 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.734210 12318 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.736240 12016 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:24.738739 12405 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.742339 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.744036 11872 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.742638 12062 ts_tablet_manager.cc:1434] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.170s	user 0.005s	sys 0.009s
I20260709 12:09:24.749089 12062 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:24.748968 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:24.750754 11868 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:24.754372 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:24.756033 12318 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.761686 11839 leader_election.cc:343] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.765003 12063 tablet_bootstrap.cc:492] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:24.769186 12063 ts_tablet_manager.cc:1403] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.203s	user 0.030s	sys 0.026s
I20260709 12:09:24.784873 12318 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.797791 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:24.801636 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:24.809604 12484 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.811043 12062 tablet_bootstrap.cc:654] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.819360 12063 raft_consensus.cc:359] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.823796 12063 raft_consensus.cc:385] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.820713 12403 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.825416 12063 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.828722 12484 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.831493 12313 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.832302 12063 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.836277 12063 ts_tablet_manager.cc:1434] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.067s	user 0.016s	sys 0.008s
I20260709 12:09:24.839247 12063 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:24.848143 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.870335 12105 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.874984 12485 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.875733 12485 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:24.877211 12485 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.896198 12464 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.924240 12062 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:24.924919 12062 ts_tablet_manager.cc:1403] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.026s
I20260709 12:09:24.934840 12063 tablet_bootstrap.cc:654] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.940068 12062 raft_consensus.cc:359] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.940815 12062 raft_consensus.cc:385] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.941043 12062 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.944391 12062 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.939495 12405 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.955911 12405 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.962450 12405 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:24.974584 12062 ts_tablet_manager.cc:1434] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:09:24.976917 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:24.983184 11839 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:24.985493 12021 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.995811 12462 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.996658 12462 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:24.999470 12388 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:09:25.003360 12491 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:09:25.005981 12483 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.021461 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:25.023797 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:25.024664 12019 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:25.030140 12021 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:25.053851 12062 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:25.049201 12483 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:09:25.087133 12495 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:09:25.126544 12462 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:25.182991 12473 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.190424 12328 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.192037 12328 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.202612 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:25.207161 12063 tablet_bootstrap.cc:492] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:25.207779 12063 ts_tablet_manager.cc:1403] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.369s	user 0.012s	sys 0.016s
I20260709 12:09:25.183606 12473 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.211717 12484 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.212936 12473 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:25.210052 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:25.210915 11947 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.192764 12313 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:25.197706 12465 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:25.223702 12328 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:25.224995 11946 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.234578 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:25.252882 11940 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:25.212966 12484 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:25.258279 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:25.261193 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:25.276383 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:25.287479 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:25.295338 12062 tablet_bootstrap.cc:654] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.300410 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 94235.8us
I20260709 12:09:25.302407 12484 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.297072 12313 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.333628 11866 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.344163 12063 raft_consensus.cc:359] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.348850 12063 raft_consensus.cc:385] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.349175 12063 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.305723 12473 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:09:25.370698 12063 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.373706 12497 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:09:25.366084 11946 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:25.398674 12496 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.399323 12496 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.401726 12062 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:25.401904 12496 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:25.402434 12062 ts_tablet_manager.cc:1403] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.349s	user 0.014s	sys 0.020s
W20260709 12:09:25.402518 11819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:09:25.405334 11914 consensus_peers.cc:597] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.409827 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:25.410864 12019 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:25.412532 11943 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:25.418074 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:25.430187 12457 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.432725 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:25.435148 12484 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.435698 12484 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.436196 12484 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.464404 12063 ts_tablet_manager.cc:1434] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.256s	user 0.015s	sys 0.014s
I20260709 12:09:25.468879 12063 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Bootstrap starting.
I20260709 12:09:25.466324 12062 raft_consensus.cc:359] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.470825 12062 raft_consensus.cc:385] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.471226 12062 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.471727 12511 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:09:25.471982 12062 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.474871 12062 ts_tablet_manager.cc:1434] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.002s
W20260709 12:09:25.489260 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61922.3us
I20260709 12:09:25.496546 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:25.500877 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:25.501856 12105 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.515360 12313 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.515452 12514 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:09:25.518865 12505 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 12:09:25.519948 12062 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Bootstrap starting.
I20260709 12:09:25.537204 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:25.551172 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49046.3us
I20260709 12:09:25.562678 12499 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260709 12:09:25.681612 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:25.695679 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 0.
W20260709 12:09:25.768734 12518 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:09:25.756649 12483 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:25.775400 12522 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:09:25.832505 12500 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.181s	user 0.005s	sys 0.010s
I20260709 12:09:25.773243 12483 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:25.846226 12522 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 12:09:25.860175 12503 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:25.889084 12063 tablet_bootstrap.cc:654] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.896721 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 47861.5us
W20260709 12:09:25.926592 12517 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.303s	user 0.006s	sys 0.010s
I20260709 12:09:25.966082 12483 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:25.968238 12484 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 12:09:25.968689 12484 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:25.973524 12062 tablet_bootstrap.cc:654] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.975936 11871 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:09:26.052202 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 153323us
I20260709 12:09:26.080457 12484 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:26.088197 12063 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: No bootstrap required, opened a new log
I20260709 12:09:26.088738 12063 ts_tablet_manager.cc:1403] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent bootstrapping tablet: real 0.620s	user 0.015s	sys 0.011s
I20260709 12:09:26.100230 12063 raft_consensus.cc:359] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.102314 12063 raft_consensus.cc:385] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.102674 12063 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.103981 12063 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.110071 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:26.109014 12405 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.114938 12497 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.115408 12497 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.115783 12497 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.120659 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:26.138463 12063 ts_tablet_manager.cc:1434] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.003s
I20260709 12:09:26.139802 12062 tablet_bootstrap.cc:492] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: No bootstrap required, opened a new log
I20260709 12:09:26.140323 12062 ts_tablet_manager.cc:1403] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent bootstrapping tablet: real 0.621s	user 0.019s	sys 0.022s
I20260709 12:09:26.128762 12013 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:26.163515 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:26.167383 12016 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.167040 12062 raft_consensus.cc:359] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.170331 12062 raft_consensus.cc:385] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.170696 12062 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.171630 12062 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.180964 12062 ts_tablet_manager.cc:1434] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.012s
I20260709 12:09:26.182112 12497 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.184945 12016 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:26.201510 12325 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.202396 12497 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:26.198937 11769 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.204813 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:26.205770 12325 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.206144 12325 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.206492 12325 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.209825 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.213749 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:26.218554 11866 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:26.216840 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:26.220335 11946 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 0.
I20260709 12:09:26.226454 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:26.227305 11943 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 1: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:26.230113 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:26.231007 12539 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.231496 12539 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:26.232405 12539 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.227418 12325 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.237058 12541 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.241359 12325 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:26.277956 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:26.278880 12016 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 1: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:26.285887 12325 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.294174 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:26.295136 11942 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.304394 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:26.305107 12016 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.306638 11942 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:26.312208 12016 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:26.331583 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:26.332343 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:26.333165 12524 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.333613 12540 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.333784 12524 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:26.334911 12524 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.357132 12498 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.357713 12498 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:26.360240 12498 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:26.368454 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:26.366391 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:26.379767 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:26.380421 12539 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.419935 11769 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.422240 11769 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.474831 11864 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.615381 12539 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.635644 12539 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.763028 12539 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.777441 12539 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.511057 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:27.536171 12568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:27.536171 12566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:27.536309 12565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:27.541002 10697 server_base.cc:1061] running on GCE node
I20260709 12:09:27.545228 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:27.545750 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:27.546109 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783598967546083 us; error 0 us; skew 500 ppm
I20260709 12:09:27.547102 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:27.550587 10697 webserver.cc:533] Webserver started at http://127.10.114.68:44679/ using document root <none> and password file <none>
I20260709 12:09:27.551091 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:27.551280 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:27.551868 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:27.553601 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-3-root/instance:
uuid: "189a165e6619406382914fe3075dd436"
format_stamp: "Formatted at 2026-07-09 12:09:27 on dist-test-slave-08l4"
I20260709 12:09:27.559130 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:27.563992 12573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.564937 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:27.565264 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
uuid: "189a165e6619406382914fe3075dd436"
format_stamp: "Formatted at 2026-07-09 12:09:27 on dist-test-slave-08l4"
I20260709 12:09:27.565585 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:27.584952 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:27.586663 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:27.588373 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:27.591763 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:27.592038 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.592382 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:27.592546 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.660202 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.68:39553
I20260709 12:09:27.660344 12635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.68:39553 every 8 connection(s)
I20260709 12:09:27.664430 10697 auto_leader_rebalancer-test.cc:439] add a tserver: 189a165e6619406382914fe3075dd436
I20260709 12:09:27.686596 12636 heartbeater.cc:344] Connected to a master server at 127.10.114.126:46571
I20260709 12:09:27.687178 12636 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:27.688279 12636 heartbeater.cc:507] Master 127.10.114.126:46571 requested a full tablet report, sending...
I20260709 12:09:27.690613 11770 ts_manager.cc:194] Registered new tserver with Master: 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:27.692286 11770 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34188
I20260709 12:09:28.619238 11864 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:28.627175 12016 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.629554 12539 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.635502 11943 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.637915 12644 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.659510 12498 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:28.660965 11837 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2c1fe07352d4472a01fce46f98ce1a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.661557 11943 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.669337 12016 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.692205 11770 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.695168 12636 heartbeater.cc:499] Master 127.10.114.126:46571 was elected leader, sending a full tablet report...
I20260709 12:09:28.698571 11943 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:28.707015 11864 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.708343 12019 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.708576 12640 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.710086 12496 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.768720 12496 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:28.785239 11912 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8bcc1200587447cb913298cc7ed8c931. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.777070 12019 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.796324 11864 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.803573 11942 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:28.821595 11912 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6dded4de56124928b0b4c23213e34af4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.825503 11871 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.826391 12016 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.827823 12640 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.841830 12640 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.842214 11769 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.869088 12496 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.871531 12016 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.895510 11867 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:28.907461 11871 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.905223 11770 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:28.925097 11837 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf27a0b964974f51bc07dec427f3a190. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.928231 11942 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.929071 12016 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.930962 12539 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.934660 12644 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.949659 12498 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.951795 11942 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.965868 12016 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:28.978323 11769 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.058784 12668 ts_tablet_manager.cc:933] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:29.063686 12668 tablet_copy_client.cc:323] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:29.077508 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet b2c1fe07352d4472a01fce46f98ce1a6 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:29.078158 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet b2c1fe07352d4472a01fce46f98ce1a6 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-b2c1fe07352d4472a01fce46f98ce1a6
I20260709 12:09:29.086306 11883 tablet_copy_source_session.cc:215] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:29.092039 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c1fe07352d4472a01fce46f98ce1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:29.105043 12668 tablet_copy_client.cc:806] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:29.105801 12668 tablet_copy_client.cc:670] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:29.114792 12668 tablet_copy_client.cc:538] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.124174 12668 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:29.144310 12668 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.145174 12668 tablet_bootstrap.cc:492] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:29.145957 12668 ts_tablet_manager.cc:1403] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 12:09:29.148536 12668 raft_consensus.cc:359] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.149266 12668 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:29.149809 12668 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.153635 12668 ts_tablet_manager.cc:1434] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:29.156113 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-b2c1fe07352d4472a01fce46f98ce1a6 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:29.156669 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-b2c1fe07352d4472a01fce46f98ce1a6 on tablet b2c1fe07352d4472a01fce46f98ce1a6 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:29.301519 12668 ts_tablet_manager.cc:933] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:29.303200 12668 tablet_copy_client.cc:323] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:29.319203 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet 6dded4de56124928b0b4c23213e34af4 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:29.319900 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet 6dded4de56124928b0b4c23213e34af4 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-6dded4de56124928b0b4c23213e34af4
I20260709 12:09:29.320147 12675 ts_tablet_manager.cc:933] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:29.326818 11958 tablet_copy_source_session.cc:215] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:29.332108 12675 tablet_copy_client.cc:323] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:29.336381 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dded4de56124928b0b4c23213e34af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:29.342382 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet 8bcc1200587447cb913298cc7ed8c931 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:29.356818 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet 8bcc1200587447cb913298cc7ed8c931 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-8bcc1200587447cb913298cc7ed8c931
I20260709 12:09:29.376426 12677 ts_tablet_manager.cc:933] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:29.380312 12668 tablet_copy_client.cc:806] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:29.384330 12668 tablet_copy_client.cc:670] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:29.383091 11958 tablet_copy_source_session.cc:215] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:29.389140 12675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcc1200587447cb913298cc7ed8c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:29.397655 12668 tablet_copy_client.cc:538] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.410554 12677 tablet_copy_client.cc:323] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:29.412968 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet bf27a0b964974f51bc07dec427f3a190 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:29.413921 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet bf27a0b964974f51bc07dec427f3a190 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-bf27a0b964974f51bc07dec427f3a190
I20260709 12:09:29.413342 12675 tablet_copy_client.cc:806] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:29.420791 12675 tablet_copy_client.cc:670] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:29.421471 12668 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:29.423152 11883 tablet_copy_source_session.cc:215] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:29.426443 12677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf27a0b964974f51bc07dec427f3a190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:29.428062 12675 tablet_copy_client.cc:538] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.442703 12675 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:29.454607 12677 tablet_copy_client.cc:806] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:29.455327 12677 tablet_copy_client.cc:670] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:29.459189 12668 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.460038 12677 tablet_copy_client.cc:538] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.460232 12668 tablet_bootstrap.cc:492] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:29.461017 12668 ts_tablet_manager.cc:1403] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.009s
I20260709 12:09:29.467592 12668 raft_consensus.cc:359] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.468621 12668 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:29.469283 12668 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.478804 12668 ts_tablet_manager.cc:1434] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:29.481033 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-6dded4de56124928b0b4c23213e34af4 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:29.482513 12611 raft_consensus.cc:1217] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.483060 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-6dded4de56124928b0b4c23213e34af4 on tablet 6dded4de56124928b0b4c23213e34af4 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:29.485625 12677 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:29.502005 12675 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.503054 12675 tablet_bootstrap.cc:492] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:29.503798 12675 ts_tablet_manager.cc:1403] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.011s
I20260709 12:09:29.506861 12675 raft_consensus.cc:359] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.509613 12675 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:29.510285 12675 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.513373 12675 ts_tablet_manager.cc:1434] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:29.522945 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-8bcc1200587447cb913298cc7ed8c931 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:29.523387 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-8bcc1200587447cb913298cc7ed8c931 on tablet 8bcc1200587447cb913298cc7ed8c931 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:29.525898 12677 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.526739 12677 tablet_bootstrap.cc:492] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:29.527351 12677 ts_tablet_manager.cc:1403] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.005s
I20260709 12:09:29.530280 12677 raft_consensus.cc:359] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.531049 12677 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:29.539572 12677 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:29.542258 12677 ts_tablet_manager.cc:1434] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:29.547344 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-bf27a0b964974f51bc07dec427f3a190 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:29.547773 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-bf27a0b964974f51bc07dec427f3a190 on tablet bf27a0b964974f51bc07dec427f3a190 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:29.720517 12611 raft_consensus.cc:1217] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.746317 12611 raft_consensus.cc:1217] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.858070 12539 raft_consensus.cc:1064] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:29.859344 12611 raft_consensus.cc:1217] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.861372 12539 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:29.880403 12611 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.882809 12684 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.914340 11946 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.918937 12013 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.919622 12684 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.926640 12686 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.933640 12684 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:29.936848 11942 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:29.978683 12611 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:29.981317 11770 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.011435 12016 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.056757 11864 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.063397 12611 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.065112 12644 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:30.065038 12016 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.068682 12686 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.080741 12684 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.082342 12611 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.091940 12016 raft_consensus.cc:2955] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.100518 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2c1fe07352d4472a01fce46f98ce1a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.118525 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.130410 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet b2c1fe07352d4472a01fce46f98ce1a6 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:30.144011 12694 tablet_replica.cc:333] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:30.145385 12694 raft_consensus.cc:2243] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.146258 12694 raft_consensus.cc:2272] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.149983 12694 ts_tablet_manager.cc:1916] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.164454 12694 ts_tablet_manager.cc:1929] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.164849 12694 log.cc:1199] T b2c1fe07352d4472a01fce46f98ce1a6 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/b2c1fe07352d4472a01fce46f98ce1a6
I20260709 12:09:30.166329 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet b2c1fe07352d4472a01fce46f98ce1a6 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:30.183019 12640 raft_consensus.cc:1064] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:30.186409 12640 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.195767 12611 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.196416 11864 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.197729 12016 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.198216 12647 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.199540 12683 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.202018 12658 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.227046 12683 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.228514 11864 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.245421 12611 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.248767 12013 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.256541 11769 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.295650 11942 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.300829 12016 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.301052 12611 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.303226 12683 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.304265 12496 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.316699 12016 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.316788 12496 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.322995 12611 raft_consensus.cc:2955] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.346645 12658 raft_consensus.cc:1064] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:30.345424 11769 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.351042 12658 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.367040 11855 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bcc1200587447cb913298cc7ed8c931 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:30.374166 12701 tablet_replica.cc:333] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:30.382723 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8bcc1200587447cb913298cc7ed8c931 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.389343 12701 raft_consensus.cc:2243] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.390367 12701 raft_consensus.cc:2272] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.391949 12686 raft_consensus.cc:1064] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:30.393618 12016 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.396250 12699 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:30.398005 12610 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.399780 12640 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.394914 12686 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.407917 11864 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.412994 12699 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.415403 12701 ts_tablet_manager.cc:1916] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.434437 12611 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.436182 12684 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:30.443574 12013 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.445526 12644 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.468521 12701 ts_tablet_manager.cc:1929] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.468993 12701 log.cc:1199] T 8bcc1200587447cb913298cc7ed8c931 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/8bcc1200587447cb913298cc7ed8c931
I20260709 12:09:30.470830 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet 8bcc1200587447cb913298cc7ed8c931 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:30.469832 12686 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.471882 12013 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.475219 11943 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.476698 12699 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.489765 12610 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.492409 12609 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.492998 11769 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.501233 12016 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.502626 12684 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.519953 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.520435 11871 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.530283 11940 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.586894 11940 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.587247 11871 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:30.594208 12609 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.595973 12684 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.604012 12016 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.607105 12667 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:30.610215 12609 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.607137 12686 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.615012 12013 raft_consensus.cc:2955] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.622622 12610 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.624099 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf27a0b964974f51bc07dec427f3a190 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.625278 12640 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:30.626353 11864 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.628787 12640 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.633476 11768 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.635928 12683 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.649260 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6dded4de56124928b0b4c23213e34af4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.650511 12609 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.653746 11864 raft_consensus.cc:2955] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.678421 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet bf27a0b964974f51bc07dec427f3a190 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:30.704416 12710 tablet_replica.cc:333] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:30.710040 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:30.723932 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dded4de56124928b0b4c23213e34af4 with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:30.738843 12712 tablet_replica.cc:333] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:30.739984 12712 raft_consensus.cc:2243] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.742872 12710 raft_consensus.cc:2243] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.743942 12710 raft_consensus.cc:2272] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.752319 12710 ts_tablet_manager.cc:1916] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.754776 12712 raft_consensus.cc:2272] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.759896 12712 ts_tablet_manager.cc:1916] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.769817 12710 ts_tablet_manager.cc:1929] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.770498 12710 log.cc:1199] T bf27a0b964974f51bc07dec427f3a190 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/bf27a0b964974f51bc07dec427f3a190
I20260709 12:09:30.772110 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet bf27a0b964974f51bc07dec427f3a190 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:30.776572 12712 ts_tablet_manager.cc:1929] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.777045 12712 log.cc:1199] T 6dded4de56124928b0b4c23213e34af4 P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/6dded4de56124928b0b4c23213e34af4
I20260709 12:09:30.778713 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet 6dded4de56124928b0b4c23213e34af4 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:31.798048 11946 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:31.806092 12013 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:31.806474 11912 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0a71dd6e2e74227b7e93c1026aa2e8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.807777 12699 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.808290 11867 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.809855 12699 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.816303 12658 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.818360 12013 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.846382 11771 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.848368 11864 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:31.846305 11871 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.859346 11946 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.861261 12686 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:31.867316 11837 consensus_peers.cc:597] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cd3b75a5fa040ba872559d73e67a565. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.872160 12013 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.883754 12709 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.896502 12723 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.908017 11940 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.935262 12013 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.936478 11940 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:31.941184 11769 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:31.947309 11912 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eba16e46f4d34fb7a53a7a797485a99c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.953943 12013 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.954164 11864 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.955518 12717 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.956943 12496 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.974110 12716 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.976356 12013 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.976054 11864 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:31.994747 11771 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:32.001904 11864 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.018754 12013 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:32.018777 11837 consensus_peers.cc:597] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b00e47b0acb44843a177246087e87ffd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.019534 11940 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.020260 12723 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:32.021997 12709 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.034138 12686 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:32.036571 12019 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:32.039258 11940 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:32.058038 11771 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.298056 12735 ts_tablet_manager.cc:933] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:32.300645 12735 tablet_copy_client.cc:323] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:32.302551 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet 3cd3b75a5fa040ba872559d73e67a565 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:32.303217 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet 3cd3b75a5fa040ba872559d73e67a565 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-3cd3b75a5fa040ba872559d73e67a565
I20260709 12:09:32.310715 11883 tablet_copy_source_session.cc:215] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.314184 12735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd3b75a5fa040ba872559d73e67a565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.335371 12735 tablet_copy_client.cc:806] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.335656 12737 ts_tablet_manager.cc:933] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:32.336005 12735 tablet_copy_client.cc:670] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.338601 12737 tablet_copy_client.cc:323] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:32.340483 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet c0a71dd6e2e74227b7e93c1026aa2e8d from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:32.341149 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet c0a71dd6e2e74227b7e93c1026aa2e8d from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-c0a71dd6e2e74227b7e93c1026aa2e8d
I20260709 12:09:32.348558 11958 tablet_copy_source_session.cc:215] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.352130 12735 tablet_copy_client.cc:538] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.358899 12737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a71dd6e2e74227b7e93c1026aa2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.365629 12735 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:32.420691 12737 tablet_copy_client.cc:806] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.421448 12737 tablet_copy_client.cc:670] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.426280 12735 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.428009 12735 tablet_bootstrap.cc:492] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:32.428176 12737 tablet_copy_client.cc:538] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.428865 12735 ts_tablet_manager.cc:1403] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.029s
I20260709 12:09:32.432206 12735 raft_consensus.cc:359] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.433225 12735 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:32.435210 12735 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.439611 12737 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:32.446502 12741 ts_tablet_manager.cc:933] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:32.462044 12741 tablet_copy_client.cc:323] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:32.463888 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet eba16e46f4d34fb7a53a7a797485a99c from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:32.464414 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet eba16e46f4d34fb7a53a7a797485a99c from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-eba16e46f4d34fb7a53a7a797485a99c
I20260709 12:09:32.470036 12742 ts_tablet_manager.cc:933] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:32.472184 11958 tablet_copy_source_session.cc:215] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.478667 12741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba16e46f4d34fb7a53a7a797485a99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.486524 12735 ts_tablet_manager.cc:1434] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.011s
I20260709 12:09:32.475026 12742 tablet_copy_client.cc:323] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:32.491484 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-3cd3b75a5fa040ba872559d73e67a565 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:32.491969 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-3cd3b75a5fa040ba872559d73e67a565 on tablet 3cd3b75a5fa040ba872559d73e67a565 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:32.495172 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet b00e47b0acb44843a177246087e87ffd from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:32.495781 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet b00e47b0acb44843a177246087e87ffd from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-b00e47b0acb44843a177246087e87ffd
I20260709 12:09:32.500190 12737 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.501547 12737 tablet_bootstrap.cc:492] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:32.502449 12737 ts_tablet_manager.cc:1403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.063s	user 0.038s	sys 0.008s
I20260709 12:09:32.506609 12737 raft_consensus.cc:359] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.507630 12737 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:32.508550 12737 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.512125 12737 ts_tablet_manager.cc:1434] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:32.514446 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-c0a71dd6e2e74227b7e93c1026aa2e8d received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:32.514906 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-c0a71dd6e2e74227b7e93c1026aa2e8d on tablet c0a71dd6e2e74227b7e93c1026aa2e8d with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:32.518790 11883 tablet_copy_source_session.cc:215] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.520933 12741 tablet_copy_client.cc:806] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.521476 12741 tablet_copy_client.cc:670] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.522514 12742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00e47b0acb44843a177246087e87ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.528542 12741 tablet_copy_client.cc:538] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.547508 12741 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:32.557757 12742 tablet_copy_client.cc:806] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.561959 12742 tablet_copy_client.cc:670] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.569304 12742 tablet_copy_client.cc:538] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.584549 12742 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:32.590387 12741 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.591450 12741 tablet_bootstrap.cc:492] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:32.592180 12741 ts_tablet_manager.cc:1403] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.014s
I20260709 12:09:32.595489 12741 raft_consensus.cc:359] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.598452 12741 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:32.599272 12741 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.609381 12741 ts_tablet_manager.cc:1434] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:32.616623 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-eba16e46f4d34fb7a53a7a797485a99c received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:32.617093 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-eba16e46f4d34fb7a53a7a797485a99c on tablet eba16e46f4d34fb7a53a7a797485a99c with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:32.629433 12742 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.631057 12742 tablet_bootstrap.cc:492] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:32.632005 12742 ts_tablet_manager.cc:1403] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.012s
I20260709 12:09:32.635433 12742 raft_consensus.cc:359] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.636406 12742 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:32.637318 12742 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:32.640026 12742 ts_tablet_manager.cc:1434] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:32.642550 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-b00e47b0acb44843a177246087e87ffd received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:32.643002 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-b00e47b0acb44843a177246087e87ffd on tablet b00e47b0acb44843a177246087e87ffd with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:32.816301 12610 raft_consensus.cc:1217] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.842469 12610 raft_consensus.cc:1217] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.854529 12610 raft_consensus.cc:1217] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.022058 12610 raft_consensus.cc:1217] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.368613 12658 raft_consensus.cc:1064] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:33.371531 12658 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:33.373909 12716 raft_consensus.cc:1064] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:33.376701 12716 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:33.395658 12610 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.396122 12019 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.397822 12716 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.400206 12717 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:33.412134 11864 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.413751 12716 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.428598 12609 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.431278 12016 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.431349 12658 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.434468 12751 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.436010 11871 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.437721 12754 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.481221 12725 raft_consensus.cc:1064] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:33.490940 12717 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.496891 12016 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.502156 12725 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:33.510803 12757 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.514707 11871 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.519170 12610 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.521991 11864 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.529655 12723 raft_consensus.cc:1064] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:33.532394 12723 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:33.562321 11769 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.571278 11771 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.600337 12609 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.601442 11946 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.600376 12610 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.606736 12749 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.612079 12750 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.620803 12016 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.640869 12611 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.641937 12019 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.642499 12750 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.648411 12725 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.663774 11943 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.666141 12013 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.669917 12723 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.671913 12725 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.676198 11943 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.682317 12749 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:33.696419 11942 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:33.699185 12609 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.719085 12019 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.735707 12013 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.742475 12751 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 12:09:33.853708 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115458us
I20260709 12:09:33.882961 12777 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:33.927251 11771 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:33.894234 12611 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:09:33.963563 12776 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 12:09:33.969506 12751 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:09:34.062696 11866 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:34.098470 11940 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:34.099841 12609 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.104040 11943 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.108690 12611 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.110808 12751 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.116464 12610 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.125599 12777 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.133037 12609 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.140343 12757 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.148439 12750 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.149523 12780 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.151854 12611 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.160426 12609 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.169965 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cd3b75a5fa040ba872559d73e67a565 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.170341 12019 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.194172 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.206492 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eba16e46f4d34fb7a53a7a797485a99c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.213529 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0a71dd6e2e74227b7e93c1026aa2e8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.221931 11771 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.223644 11771 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.225189 11771 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.240348 12751 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.245208 12014 raft_consensus.cc:2955] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.254843 12016 raft_consensus.cc:2955] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.264823 11855 tablet_service.cc:1558] Processing DeleteTablet for tablet c0a71dd6e2e74227b7e93c1026aa2e8d with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:34.266388 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cd3b75a5fa040ba872559d73e67a565 with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:34.268185 12789 tablet_replica.cc:333] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:34.269080 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet eba16e46f4d34fb7a53a7a797485a99c with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:34.269711 12789 raft_consensus.cc:2243] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.270756 12789 raft_consensus.cc:2272] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.276119 12789 ts_tablet_manager.cc:1916] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.279901 12790 tablet_replica.cc:333] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:34.287581 11940 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.292043 12019 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.307490 12789 ts_tablet_manager.cc:1929] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.308557 12789 log.cc:1199] T c0a71dd6e2e74227b7e93c1026aa2e8d P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/c0a71dd6e2e74227b7e93c1026aa2e8d
I20260709 12:09:34.312726 12789 tablet_replica.cc:333] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:34.313432 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet c0a71dd6e2e74227b7e93c1026aa2e8d (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:34.312325 11871 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:34.314303 12789 raft_consensus.cc:2243] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.315214 12789 raft_consensus.cc:2272] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.320188 12611 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.323544 12777 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.328612 12789 ts_tablet_manager.cc:1916] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.334257 12790 raft_consensus.cc:2243] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.335233 12790 raft_consensus.cc:2272] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.337833 12723 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.332242 12777 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.341883 12610 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.345135 12789 ts_tablet_manager.cc:1929] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.345729 12789 log.cc:1199] T eba16e46f4d34fb7a53a7a797485a99c P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/eba16e46f4d34fb7a53a7a797485a99c
I20260709 12:09:34.347536 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet eba16e46f4d34fb7a53a7a797485a99c (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:34.348889 12790 ts_tablet_manager.cc:1916] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.364080 11940 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.364960 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b00e47b0acb44843a177246087e87ffd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.372448 12790 ts_tablet_manager.cc:1929] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.373155 12790 log.cc:1199] T 3cd3b75a5fa040ba872559d73e67a565 P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/3cd3b75a5fa040ba872559d73e67a565
I20260709 12:09:34.375423 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet 3cd3b75a5fa040ba872559d73e67a565 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:34.377568 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.385612 12723 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.388289 11940 raft_consensus.cc:2955] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.390543 11942 raft_consensus.cc:2955] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:34.401289 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet b00e47b0acb44843a177246087e87ffd with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:34.402773 12790 tablet_replica.cc:333] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:34.403865 12790 raft_consensus.cc:2243] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.404692 12790 raft_consensus.cc:2272] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.410184 12790 ts_tablet_manager.cc:1916] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.423642 12790 ts_tablet_manager.cc:1929] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.424010 12790 log.cc:1199] T b00e47b0acb44843a177246087e87ffd P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/b00e47b0acb44843a177246087e87ffd
I20260709 12:09:34.426605 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet b00e47b0acb44843a177246087e87ffd (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:35.477918 11866 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:35.487015 12016 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:35.487569 11837 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1d0a2103114406e9d43b045cd4acfe0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.488713 11942 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.489148 12723 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.491591 12793 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.503970 12785 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.505764 11942 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.506385 12019 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.539136 11770 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.545308 11942 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:35.555119 11912 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 246d42c8e70c46dca72a4d8848a218d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.555966 12016 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.557020 11871 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.557915 12717 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.559598 12717 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.575178 12757 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.580778 11866 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.581928 12016 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.598650 11942 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:35.631178 11771 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:35.635644 11912 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f11d66c6904b2bb34a6291c444fbcd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.639781 12016 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.641268 11866 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.641494 12717 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.644989 12717 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.659996 12754 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.662223 12016 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.669669 11866 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.690157 11771 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.714200 12016 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:35.723343 11866 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.726409 11946 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.729365 12792 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.730660 12813 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:35.770951 11986 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be722abe8c2249e0862fd29352eed5da. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.777817 12810 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.780006 11864 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.782253 11940 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.800421 11769 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:35.993587 12818 ts_tablet_manager.cc:933] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:35.996016 12818 tablet_copy_client.cc:323] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:35.998572 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet a1d0a2103114406e9d43b045cd4acfe0 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:35.999236 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet a1d0a2103114406e9d43b045cd4acfe0 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-a1d0a2103114406e9d43b045cd4acfe0
I20260709 12:09:36.007627 11883 tablet_copy_source_session.cc:215] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.011456 12818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d0a2103114406e9d43b045cd4acfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.027311 12818 tablet_copy_client.cc:806] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.028036 12818 tablet_copy_client.cc:670] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.034552 12818 tablet_copy_client.cc:538] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.042259 12818 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:36.062266 12818 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.063226 12818 tablet_bootstrap.cc:492] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:36.063989 12818 ts_tablet_manager.cc:1403] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.005s
I20260709 12:09:36.067327 12818 raft_consensus.cc:359] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.068229 12818 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:36.069000 12818 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.073426 12818 ts_tablet_manager.cc:1434] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:36.077418 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-a1d0a2103114406e9d43b045cd4acfe0 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:36.078285 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-a1d0a2103114406e9d43b045cd4acfe0 on tablet a1d0a2103114406e9d43b045cd4acfe0 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:36.079676 12822 ts_tablet_manager.cc:933] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:36.083326 12822 tablet_copy_client.cc:323] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:36.085518 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet 246d42c8e70c46dca72a4d8848a218d7 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:36.086144 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet 246d42c8e70c46dca72a4d8848a218d7 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-246d42c8e70c46dca72a4d8848a218d7
I20260709 12:09:36.096027 11958 tablet_copy_source_session.cc:215] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.099563 12822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246d42c8e70c46dca72a4d8848a218d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.114063 12822 tablet_copy_client.cc:806] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.114696 12822 tablet_copy_client.cc:670] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.123270 12818 ts_tablet_manager.cc:933] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:36.125331 12818 tablet_copy_client.cc:323] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:36.126897 12822 tablet_copy_client.cc:538] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.127187 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet e4f11d66c6904b2bb34a6291c444fbcd from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:36.127903 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet e4f11d66c6904b2bb34a6291c444fbcd from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-e4f11d66c6904b2bb34a6291c444fbcd
I20260709 12:09:36.131938 12825 ts_tablet_manager.cc:933] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:36.137946 12822 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:36.151926 11958 tablet_copy_source_session.cc:215] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.158304 12825 tablet_copy_client.cc:323] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:09:36.160034 12818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f11d66c6904b2bb34a6291c444fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.189356 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet be722abe8c2249e0862fd29352eed5da from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:09:36.190164 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet be722abe8c2249e0862fd29352eed5da from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-be722abe8c2249e0862fd29352eed5da
I20260709 12:09:36.201161 12032 tablet_copy_source_session.cc:215] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.201504 12818 tablet_copy_client.cc:806] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.202679 12818 tablet_copy_client.cc:670] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.207561 12818 tablet_copy_client.cc:538] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.209897 12825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be722abe8c2249e0862fd29352eed5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.212322 12822 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.213382 12822 tablet_bootstrap.cc:492] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:36.214174 12822 ts_tablet_manager.cc:1403] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.010s
I20260709 12:09:36.217190 12822 raft_consensus.cc:359] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.218137 12822 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:36.218834 12822 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.221776 12822 ts_tablet_manager.cc:1434] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:09:36.229760 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-246d42c8e70c46dca72a4d8848a218d7 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:36.230235 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-246d42c8e70c46dca72a4d8848a218d7 on tablet 246d42c8e70c46dca72a4d8848a218d7 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:36.232441 12818 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:36.240782 12825 tablet_copy_client.cc:806] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.241590 12825 tablet_copy_client.cc:670] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.250129 12825 tablet_copy_client.cc:538] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.268112 12818 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.269335 12818 tablet_bootstrap.cc:492] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:36.271255 12818 ts_tablet_manager.cc:1403] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.012s
I20260709 12:09:36.274592 12825 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:36.276629 12818 raft_consensus.cc:359] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.277870 12818 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:36.286542 12818 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.289232 12818 ts_tablet_manager.cc:1434] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:36.291565 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-e4f11d66c6904b2bb34a6291c444fbcd received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:36.292004 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-e4f11d66c6904b2bb34a6291c444fbcd on tablet e4f11d66c6904b2bb34a6291c444fbcd with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:36.306439 12825 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.308876 12825 tablet_bootstrap.cc:492] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:36.309904 12825 ts_tablet_manager.cc:1403] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.037s	user 0.028s	sys 0.000s
I20260709 12:09:36.313723 12825 raft_consensus.cc:359] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.314891 12825 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:36.315659 12825 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:36.322619 12825 ts_tablet_manager.cc:1434] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:09:36.324699 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-be722abe8c2249e0862fd29352eed5da received from {username='slave'} at 127.0.0.1:58674
I20260709 12:09:36.325186 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-be722abe8c2249e0862fd29352eed5da on tablet be722abe8c2249e0862fd29352eed5da with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:36.511543 12610 raft_consensus.cc:1217] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.540180 12611 raft_consensus.cc:1217] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.540221 12610 raft_consensus.cc:1217] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:09:36.586802 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57882.1us
I20260709 12:09:36.705582 12611 raft_consensus.cc:1217] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.973802 12754 raft_consensus.cc:1064] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:36.976708 12754 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:36.984377 12611 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.986799 12817 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.009557 12014 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.014565 11866 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.017225 12754 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.026108 12754 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.028560 12717 raft_consensus.cc:1064] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:37.041980 12717 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.049180 12793 raft_consensus.cc:1064] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:37.052042 12793 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.066146 12757 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.075551 12611 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.078395 12833 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.085615 12019 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.089389 12792 raft_consensus.cc:1064] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:37.092082 12792 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.094594 12609 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.097564 12014 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.097759 11871 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.098498 12817 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.099068 11866 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.121332 11940 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.116855 12839 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.113631 12014 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.123795 12754 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.130961 11770 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.134709 12833 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.136986 12833 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:37.145128 12841 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:09:37.189616 12609 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.191890 12832 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.184836 12608 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.227690 11942 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.230134 11864 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.230736 12832 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.232867 12831 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:37.260593 12845 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.086s	user 0.004s	sys 0.000s
I20260709 12:09:37.284677 12839 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.291996 12019 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.309640 12607 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:09:37.337921 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 63814.1us
I20260709 12:09:37.358637 12851 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.375324 12833 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.398623 12609 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.418376 12608 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.433276 11940 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.448271 11942 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.456559 11943 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.465034 11768 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.466943 11768 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.467525 11864 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.468663 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.476843 12016 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.488090 11866 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.512023 12019 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.513262 12609 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.515060 12754 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.516096 12844 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.530053 12817 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.533697 12608 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.542400 12016 raft_consensus.cc:2955] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.548477 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 246d42c8e70c46dca72a4d8848a218d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.557891 11945 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.550453 11771 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.564814 12608 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.570555 11872 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.569478 12844 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:37.571596 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet 246d42c8e70c46dca72a4d8848a218d7 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:37.575081 11866 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.579267 12717 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.580412 12019 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:37.583237 12607 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.595139 12610 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.599555 12610 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.603245 12861 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.605839 12868 tablet_replica.cc:333] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:37.606766 12867 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.609246 12868 raft_consensus.cc:2243] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.610121 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4f11d66c6904b2bb34a6291c444fbcd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.615857 12868 raft_consensus.cc:2272] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.617668 12861 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.618203 12866 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.625197 12608 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.630016 11768 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.639325 12754 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.642695 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a1d0a2103114406e9d43b045cd4acfe0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.631951 12607 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.649425 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f11d66c6904b2bb34a6291c444fbcd with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:37.619848 12868 ts_tablet_manager.cc:1916] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.651955 12016 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.656265 11770 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:37.662854 11871 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.662878 12866 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.665954 12870 tablet_replica.cc:333] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:37.667171 12870 raft_consensus.cc:2243] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.656770 11866 raft_consensus.cc:2955] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.669726 12832 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.671167 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet a1d0a2103114406e9d43b045cd4acfe0 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:37.678326 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be722abe8c2249e0862fd29352eed5da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.678562 12870 raft_consensus.cc:2272] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.683105 12870 ts_tablet_manager.cc:1916] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.706804 11770 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:09:37.719252 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47846.5us
I20260709 12:09:37.721262 12871 tablet_replica.cc:333] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:37.730947 11866 raft_consensus.cc:2955] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.736243 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet be722abe8c2249e0862fd29352eed5da with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:37.738483 12868 ts_tablet_manager.cc:1929] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.739002 12868 log.cc:1199] T 246d42c8e70c46dca72a4d8848a218d7 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/246d42c8e70c46dca72a4d8848a218d7
I20260709 12:09:37.740854 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet 246d42c8e70c46dca72a4d8848a218d7 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:37.748450 12870 ts_tablet_manager.cc:1929] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.749038 12870 log.cc:1199] T e4f11d66c6904b2bb34a6291c444fbcd P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/e4f11d66c6904b2bb34a6291c444fbcd
I20260709 12:09:37.748643 12019 raft_consensus.cc:2955] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:37.751070 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet e4f11d66c6904b2bb34a6291c444fbcd (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:37.756037 12871 raft_consensus.cc:2243] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.757023 12871 raft_consensus.cc:2272] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.762673 12871 ts_tablet_manager.cc:1916] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.784157 12871 ts_tablet_manager.cc:1929] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.784643 12871 log.cc:1199] T a1d0a2103114406e9d43b045cd4acfe0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/a1d0a2103114406e9d43b045cd4acfe0
I20260709 12:09:37.786576 12871 tablet_replica.cc:333] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:37.786821 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet a1d0a2103114406e9d43b045cd4acfe0 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:37.787756 12871 raft_consensus.cc:2243] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.788645 12871 raft_consensus.cc:2272] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.792606 12871 ts_tablet_manager.cc:1916] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.808853 12871 ts_tablet_manager.cc:1929] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.809186 12871 log.cc:1199] T be722abe8c2249e0862fd29352eed5da P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/be722abe8c2249e0862fd29352eed5da
I20260709 12:09:37.810693 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet be722abe8c2249e0862fd29352eed5da (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:38.825134 12016 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:38.834232 11986 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb3e790dfc8a4be2938233d59465f7b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.837780 11943 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.838271 11866 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.840248 12873 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.841420 12792 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.849756 12873 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.852588 11943 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.856593 11866 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.870386 12016 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:38.872165 11770 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:38.886456 11986 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bace639158f425898b2859f751fc2cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.890281 11943 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.891700 12873 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.891904 11872 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.893944 12873 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.902070 12875 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.904249 11943 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.912684 11872 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.931028 11945 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:38.950739 11771 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:38.958551 11912 consensus_peers.cc:597] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a334a018a5045c29f59fb1e4e5119ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.965354 12016 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.968513 11871 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.969775 12817 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.970723 12754 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.986132 12887 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.990929 11872 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:38.996973 12014 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:39.005889 11871 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.008487 11768 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.053740 12014 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.055505 11945 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.056262 12879 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:39.057348 11837 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 005405ff7b534db6b4c6be122c445915. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.057667 12866 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.066478 12872 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:39.068632 11943 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:39.068521 12014 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:39.086509 11770 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.254686 12893 ts_tablet_manager.cc:933] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:39.256496 12893 tablet_copy_client.cc:323] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:09:39.258067 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet eb3e790dfc8a4be2938233d59465f7b8 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:09:39.258679 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet eb3e790dfc8a4be2938233d59465f7b8 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-eb3e790dfc8a4be2938233d59465f7b8
I20260709 12:09:39.268103 12032 tablet_copy_source_session.cc:215] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.271186 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3e790dfc8a4be2938233d59465f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.289506 12893 tablet_copy_client.cc:806] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.290170 12893 tablet_copy_client.cc:670] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.294484 12893 tablet_copy_client.cc:538] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.301488 12893 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:39.325289 12893 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.326268 12893 tablet_bootstrap.cc:492] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:39.326993 12893 ts_tablet_manager.cc:1403] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.008s
I20260709 12:09:39.330816 12893 raft_consensus.cc:359] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.331542 12893 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:39.332196 12893 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.335464 12893 ts_tablet_manager.cc:1434] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:09:39.342150 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-eb3e790dfc8a4be2938233d59465f7b8 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:09:39.342653 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-eb3e790dfc8a4be2938233d59465f7b8 on tablet eb3e790dfc8a4be2938233d59465f7b8 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:39.365435 12893 ts_tablet_manager.cc:933] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:39.370569 12893 tablet_copy_client.cc:323] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:09:39.372287 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 0bace639158f425898b2859f751fc2cd from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:09:39.372915 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 0bace639158f425898b2859f751fc2cd from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-0bace639158f425898b2859f751fc2cd
I20260709 12:09:39.382177 12032 tablet_copy_source_session.cc:215] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.385900 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bace639158f425898b2859f751fc2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.404212 12893 tablet_copy_client.cc:806] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.404850 12893 tablet_copy_client.cc:670] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.409684 12893 tablet_copy_client.cc:538] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.421139 12893 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:39.440001 12893 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.441053 12893 tablet_bootstrap.cc:492] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:39.441804 12893 ts_tablet_manager.cc:1403] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.008s
I20260709 12:09:39.444958 12893 raft_consensus.cc:359] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.445875 12893 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:39.446543 12893 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.449455 12893 ts_tablet_manager.cc:1434] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:39.451304 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-0bace639158f425898b2859f751fc2cd received from {username='slave'} at 127.0.0.1:58674
I20260709 12:09:39.451797 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-0bace639158f425898b2859f751fc2cd on tablet 0bace639158f425898b2859f751fc2cd with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:39.491688 12893 ts_tablet_manager.cc:933] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:39.493222 12893 tablet_copy_client.cc:323] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:39.494995 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet 6a334a018a5045c29f59fb1e4e5119ae from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:39.495545 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet 6a334a018a5045c29f59fb1e4e5119ae from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-6a334a018a5045c29f59fb1e4e5119ae
I20260709 12:09:39.502398 11958 tablet_copy_source_session.cc:215] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.506518 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a334a018a5045c29f59fb1e4e5119ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.518411 12893 tablet_copy_client.cc:806] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.518914 12893 tablet_copy_client.cc:670] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.522769 12893 tablet_copy_client.cc:538] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.530308 12893 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:39.549081 12893 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.549830 12893 tablet_bootstrap.cc:492] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:39.550331 12893 ts_tablet_manager.cc:1403] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 12:09:39.552326 12893 raft_consensus.cc:359] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.552903 12893 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:39.553422 12893 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.555138 12893 ts_tablet_manager.cc:1434] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:39.556973 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-6a334a018a5045c29f59fb1e4e5119ae received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:39.557365 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-6a334a018a5045c29f59fb1e4e5119ae on tablet 6a334a018a5045c29f59fb1e4e5119ae with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:39.602594 12893 ts_tablet_manager.cc:933] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:39.604292 12893 tablet_copy_client.cc:323] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:39.605978 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet 005405ff7b534db6b4c6be122c445915 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:39.606616 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet 005405ff7b534db6b4c6be122c445915 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-005405ff7b534db6b4c6be122c445915
I20260709 12:09:39.615314 11883 tablet_copy_source_session.cc:215] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.620956 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005405ff7b534db6b4c6be122c445915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.639549 12893 tablet_copy_client.cc:806] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.640178 12893 tablet_copy_client.cc:670] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.646984 12893 tablet_copy_client.cc:538] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.658205 12893 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:39.676473 12893 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.677425 12893 tablet_bootstrap.cc:492] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:39.678141 12893 ts_tablet_manager.cc:1403] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 12:09:39.681021 12893 raft_consensus.cc:359] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.681885 12893 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:39.682528 12893 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:39.685071 12893 ts_tablet_manager.cc:1434] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:39.688113 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-005405ff7b534db6b4c6be122c445915 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:39.688585 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-005405ff7b534db6b4c6be122c445915 on tablet 005405ff7b534db6b4c6be122c445915 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:39.804163 12607 raft_consensus.cc:1217] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.886744 12607 raft_consensus.cc:1217] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.951509 12607 raft_consensus.cc:1217] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.200928 12607 raft_consensus.cc:1217] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.392583 12899 raft_consensus.cc:1064] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:40.395557 12899 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.404347 12607 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.406685 11943 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.407102 12875 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.408773 12873 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.410944 11872 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.414865 12873 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.431419 12754 raft_consensus.cc:1064] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:40.437196 12754 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.444382 12873 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.448196 11946 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.454129 11872 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.480171 12607 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.484642 12875 raft_consensus.cc:1064] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:40.487951 12875 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.493216 11768 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.496500 12014 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.498056 11866 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.499500 12608 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.500903 12911 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.502115 12754 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.514731 12903 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.540313 12609 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.542801 12899 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.594591 11864 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.596743 11946 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.595901 12913 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.598253 12609 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.599697 12899 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.605764 12899 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.617504 11872 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.622880 12920 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.628692 12014 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.636976 11871 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.655054 12609 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.660092 11946 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.694427 12014 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.696518 11770 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.698333 11770 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.703722 12609 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.706000 12923 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.713145 11946 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.716434 12923 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.721724 12873 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.729846 12609 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.736575 11943 raft_consensus.cc:2955] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.740288 12866 raft_consensus.cc:1064] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:40.742731 12866 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.752120 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb3e790dfc8a4be2938233d59465f7b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.758639 12608 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.760458 12905 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.773769 11768 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.789345 11943 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.792106 12866 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.794404 12019 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.799230 12866 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:40.812130 12014 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.816226 11943 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:40.817963 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet eb3e790dfc8a4be2938233d59465f7b8 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:40.833230 12609 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.833452 12607 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.832892 12905 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.835675 12920 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.834937 12911 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.838217 11871 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.841665 11872 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.843441 12019 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.845146 12924 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.846510 12873 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.846978 12609 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.855651 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a334a018a5045c29f59fb1e4e5119ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.865013 11769 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.865980 12920 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.881124 12609 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.904337 12911 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.911942 11872 raft_consensus.cc:2955] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.926252 12609 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.939992 11946 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.956544 11872 raft_consensus.cc:2955] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:40.979952 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bace639158f425898b2859f751fc2cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:09:41.018183 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57517.4us
I20260709 12:09:41.031522 12936 tablet_replica.cc:333] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:41.032891 12936 raft_consensus.cc:2243] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.043007 11768 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.045154 12936 raft_consensus.cc:2272] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.056604 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a334a018a5045c29f59fb1e4e5119ae with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:41.092784 12936 ts_tablet_manager.cc:1916] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.108291 12943 tablet_replica.cc:333] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:41.120250 12943 raft_consensus.cc:2243] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.142004 12943 raft_consensus.cc:2272] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.438613 12943 ts_tablet_manager.cc:1916] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.453373 11769 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:41.466043 12936 ts_tablet_manager.cc:1929] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.466648 12936 log.cc:1199] T eb3e790dfc8a4be2938233d59465f7b8 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/eb3e790dfc8a4be2938233d59465f7b8
W20260709 12:09:41.471038 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 420431us
I20260709 12:09:41.477837 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet eb3e790dfc8a4be2938233d59465f7b8 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:41.531963 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bace639158f425898b2859f751fc2cd with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:41.548998 11864 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:41.569237 12609 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.580087 12948 tablet_replica.cc:333] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:41.581858 12938 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.602237 12948 raft_consensus.cc:2243] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.603334 12948 raft_consensus.cc:2272] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.603606 12939 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:41.606343 12608 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:41.624655 12948 ts_tablet_manager.cc:1916] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.631834 11940 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.633612 12946 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.638548 11940 raft_consensus.cc:2955] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:41.663641 11768 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 3 to 4, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:41.658315 12943 ts_tablet_manager.cc:1929] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.670305 12943 log.cc:1199] T 6a334a018a5045c29f59fb1e4e5119ae P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/6a334a018a5045c29f59fb1e4e5119ae
I20260709 12:09:41.672187 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet 6a334a018a5045c29f59fb1e4e5119ae (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:41.673188 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 005405ff7b534db6b4c6be122c445915 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.677464 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet 005405ff7b534db6b4c6be122c445915 with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56154
I20260709 12:09:41.678599 12943 tablet_replica.cc:333] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:09:41.679791 12943 raft_consensus.cc:2243] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.680966 12943 raft_consensus.cc:2272] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.685155 12943 ts_tablet_manager.cc:1916] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.695397 12948 ts_tablet_manager.cc:1929] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.695950 12948 log.cc:1199] T 0bace639158f425898b2859f751fc2cd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/0bace639158f425898b2859f751fc2cd
I20260709 12:09:41.698292 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet 0bace639158f425898b2859f751fc2cd (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:41.703060 12943 ts_tablet_manager.cc:1929] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.709604 12943 log.cc:1199] T 005405ff7b534db6b4c6be122c445915 P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/005405ff7b534db6b4c6be122c445915
I20260709 12:09:41.711449 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet 005405ff7b534db6b4c6be122c445915 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:09:42.139248 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800039f80 after lost signal to thread 10700
W20260709 12:09:42.140307 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800035620 after lost signal to thread 11805
W20260709 12:09:42.141376 11802 debug-util.cc:398] Leaking SignalData structure 0x7b080027c680 after lost signal to thread 11897
W20260709 12:09:42.142445 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800287c60 after lost signal to thread 11972
W20260709 12:09:42.143427 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800331fe0 after lost signal to thread 12046
W20260709 12:09:42.144402 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08002ece00 after lost signal to thread 12635
I20260709 12:09:42.762637 12015 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:42.775149 11986 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ae562d279c44236883cb0e50643fa9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.779006 11946 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.781795 11872 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.781819 12950 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.784420 12919 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.817762 12942 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.823020 11940 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.852185 11768 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.868984 11940 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:42.897179 11912 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4f2784828ee4269bb9bb741533de573. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.893492 11864 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.917488 12019 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.918202 11872 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.921288 12913 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.922616 12955 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.936918 12955 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.949774 11864 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:42.982163 12019 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.000281 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.000284 11872 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:43.037737 11837 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f35e2d3e5b034ad6adcc494a92b92886. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.042387 12018 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.043102 11940 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.044623 12906 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.048415 12938 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.062278 12906 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.088073 11940 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.102967 11946 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.105765 12019 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.133085 11769 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:09:43.171144 11912 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b76f90dd7ad649d99cfdaddca2c38694. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.175601 11872 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.176026 12018 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.177217 12964 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:43.180534 12913 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.199402 12913 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.203698 11872 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.203615 12018 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.244649 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:43.295737 12973 ts_tablet_manager.cc:933] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:43.302574 12973 tablet_copy_client.cc:323] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:43.304347 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet f4f2784828ee4269bb9bb741533de573 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:43.304912 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet f4f2784828ee4269bb9bb741533de573 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-f4f2784828ee4269bb9bb741533de573
I20260709 12:09:43.322854 11958 tablet_copy_source_session.cc:215] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.327586 12973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f2784828ee4269bb9bb741533de573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.346024 12973 tablet_copy_client.cc:806] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.346715 12973 tablet_copy_client.cc:670] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.380187 12975 ts_tablet_manager.cc:933] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:43.410207 12973 tablet_copy_client.cc:538] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.422254 12975 tablet_copy_client.cc:323] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:09:43.424412 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 1ae562d279c44236883cb0e50643fa9c from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:09:43.425068 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 1ae562d279c44236883cb0e50643fa9c from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-1ae562d279c44236883cb0e50643fa9c
I20260709 12:09:43.434484 12032 tablet_copy_source_session.cc:215] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.451670 12975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae562d279c44236883cb0e50643fa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.444875 12973 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:43.489681 12975 tablet_copy_client.cc:806] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.490487 12975 tablet_copy_client.cc:670] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.494637 12975 tablet_copy_client.cc:538] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.520272 12975 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:43.522456 12973 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.523530 12973 tablet_bootstrap.cc:492] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:43.524305 12973 ts_tablet_manager.cc:1403] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.012s
I20260709 12:09:43.527720 12973 raft_consensus.cc:359] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.528725 12973 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:43.529510 12973 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.553568 12973 ts_tablet_manager.cc:1434] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:09:43.555930 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-f4f2784828ee4269bb9bb741533de573 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:43.556435 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-f4f2784828ee4269bb9bb741533de573 on tablet f4f2784828ee4269bb9bb741533de573 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:43.573432 12973 ts_tablet_manager.cc:933] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:43.582455 12973 tablet_copy_client.cc:323] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:43.598033 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet f35e2d3e5b034ad6adcc494a92b92886 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:43.598698 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet f35e2d3e5b034ad6adcc494a92b92886 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-f35e2d3e5b034ad6adcc494a92b92886
I20260709 12:09:43.607971 11883 tablet_copy_source_session.cc:215] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.619576 12973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35e2d3e5b034ad6adcc494a92b92886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.627135 12975 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.628440 12975 tablet_bootstrap.cc:492] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:43.629325 12975 ts_tablet_manager.cc:1403] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.014s
I20260709 12:09:43.632920 12975 raft_consensus.cc:359] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.633955 12975 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:43.634754 12975 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.654585 12975 ts_tablet_manager.cc:1434] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:09:43.666700 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-1ae562d279c44236883cb0e50643fa9c received from {username='slave'} at 127.0.0.1:58674
I20260709 12:09:43.667172 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-1ae562d279c44236883cb0e50643fa9c on tablet 1ae562d279c44236883cb0e50643fa9c with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:43.676229 12608 raft_consensus.cc:1217] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.689138 12973 tablet_copy_client.cc:806] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.689913 12973 tablet_copy_client.cc:670] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.710059 12973 tablet_copy_client.cc:538] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.730765 12973 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:43.759153 12973 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.760406 12973 tablet_bootstrap.cc:492] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:43.761312 12973 ts_tablet_manager.cc:1403] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 12:09:43.764721 12973 raft_consensus.cc:359] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.765758 12973 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:43.766865 12973 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.776678 12973 ts_tablet_manager.cc:1434] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:09:43.778717 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-f35e2d3e5b034ad6adcc494a92b92886 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:43.779187 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-f35e2d3e5b034ad6adcc494a92b92886 on tablet f35e2d3e5b034ad6adcc494a92b92886 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:43.786953 12975 ts_tablet_manager.cc:933] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:43.792852 12608 raft_consensus.cc:1217] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.818631 12975 tablet_copy_client.cc:323] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:43.822450 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet b76f90dd7ad649d99cfdaddca2c38694 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:43.823122 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet b76f90dd7ad649d99cfdaddca2c38694 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-b76f90dd7ad649d99cfdaddca2c38694
W20260709 12:09:43.824752 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57495.5us
I20260709 12:09:43.837965 11958 tablet_copy_source_session.cc:215] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.847600 12975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f90dd7ad649d99cfdaddca2c38694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.873805 12975 tablet_copy_client.cc:806] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.876067 12975 tablet_copy_client.cc:670] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.881654 12975 tablet_copy_client.cc:538] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.894009 12975 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:43.922927 12975 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.923944 12975 tablet_bootstrap.cc:492] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:43.924705 12975 ts_tablet_manager.cc:1403] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.019s
I20260709 12:09:43.928063 12975 raft_consensus.cc:359] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.929036 12975 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:43.929729 12975 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:43.932725 12975 ts_tablet_manager.cc:1434] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:09:43.935300 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-b76f90dd7ad649d99cfdaddca2c38694 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:43.935801 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-b76f90dd7ad649d99cfdaddca2c38694 on tablet b76f90dd7ad649d99cfdaddca2c38694 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:44.168072 12608 raft_consensus.cc:1217] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.265347 12983 raft_consensus.cc:1064] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:44.288127 12983 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:44.317728 12608 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.323660 12964 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.324239 11872 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.328136 12955 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.329335 12019 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.347698 12983 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.363662 12608 raft_consensus.cc:1217] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.380100 12964 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.386224 12608 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.434707 12956 raft_consensus.cc:1064] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:44.437683 12956 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:44.438594 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.465631 11864 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.467510 11943 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.469097 11872 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.469120 12954 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.470909 12956 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:44.480235 12608 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.482332 12954 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:44.554522 12954 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.561599 11943 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.561795 11872 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.590776 12608 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.591894 11770 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.616613 12016 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:44.621351 12018 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.636389 11872 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.636878 12608 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.638104 12954 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.639319 12956 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.650632 12942 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.656767 12607 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.670593 11872 raft_consensus.cc:2955] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.672225 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ae562d279c44236883cb0e50643fa9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.690783 11943 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:44.699676 12608 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.701478 12983 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.710018 12019 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.716563 12955 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.730358 12607 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.732609 12986 raft_consensus.cc:1064] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:44.735810 12986 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:44.747081 11768 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.748652 12983 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.760679 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4f2784828ee4269bb9bb741533de573 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.778306 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ae562d279c44236883cb0e50643fa9c with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:44.783097 12019 raft_consensus.cc:2955] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.804082 13006 tablet_replica.cc:333] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:44.805356 13006 raft_consensus.cc:2243] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.806329 13006 raft_consensus.cc:2272] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.812184 13006 ts_tablet_manager.cc:1916] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.861850 11770 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:44.985085 13007 raft_consensus.cc:1064] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:44.987098 12608 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.005385 11942 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.007098 13007 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:45.023293 12015 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.045383 12968 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.047376 13006 ts_tablet_manager.cc:1929] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.048245 12968 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.053274 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet f4f2784828ee4269bb9bb741533de573 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:45.055971 13006 log.cc:1199] T 1ae562d279c44236883cb0e50643fa9c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/1ae562d279c44236883cb0e50643fa9c
I20260709 12:09:45.063694 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet 1ae562d279c44236883cb0e50643fa9c (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:45.065773 12938 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.144801 13016 tablet_replica.cc:333] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:45.147241 12609 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.150130 13013 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.153784 12983 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.149106 11872 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.159227 11941 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.172713 12018 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.175190 12983 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.179837 13016 raft_consensus.cc:2243] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.187937 13016 raft_consensus.cc:2272] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.201488 13016 ts_tablet_manager.cc:1916] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.215306 12607 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.223783 12019 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.230849 13011 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.238178 11770 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.251281 13016 ts_tablet_manager.cc:1929] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.251751 13016 log.cc:1199] T f4f2784828ee4269bb9bb741533de573 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/f4f2784828ee4269bb9bb741533de573
I20260709 12:09:45.256562 12983 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.264516 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet f4f2784828ee4269bb9bb741533de573 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:45.262887 11872 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.271068 11866 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:45.299057 12607 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.300984 12988 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.304566 12608 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.309504 13013 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.311273 12609 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.327200 12018 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.330406 12968 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.340994 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f35e2d3e5b034ad6adcc494a92b92886 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.347208 12018 raft_consensus.cc:2955] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.352288 12015 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.376245 11768 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 3 to 4, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.375684 11771 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.404603 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet f35e2d3e5b034ad6adcc494a92b92886 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49974
I20260709 12:09:45.405762 13006 tablet_replica.cc:333] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:09:45.407089 13006 raft_consensus.cc:2243] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.408921 13006 raft_consensus.cc:2272] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.412921 13006 ts_tablet_manager.cc:1916] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.475039 11943 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:45.486696 12609 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.487773 12019 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.488340 13011 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.490026 12983 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.500380 12964 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.503436 13006 ts_tablet_manager.cc:1929] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.503850 13006 log.cc:1199] T f35e2d3e5b034ad6adcc494a92b92886 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/f35e2d3e5b034ad6adcc494a92b92886
I20260709 12:09:45.502943 12609 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.510962 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet f35e2d3e5b034ad6adcc494a92b92886 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:45.519867 11768 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.525010 12019 raft_consensus.cc:2955] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:09:45.531767 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b76f90dd7ad649d99cfdaddca2c38694 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.536079 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet b76f90dd7ad649d99cfdaddca2c38694 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36502
I20260709 12:09:45.537319 13016 tablet_replica.cc:333] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:09:45.538568 13016 raft_consensus.cc:2243] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.539403 13016 raft_consensus.cc:2272] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.543658 13016 ts_tablet_manager.cc:1916] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.582647 13016 ts_tablet_manager.cc:1929] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.583130 13016 log.cc:1199] T b76f90dd7ad649d99cfdaddca2c38694 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/b76f90dd7ad649d99cfdaddca2c38694
I20260709 12:09:45.587642 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet b76f90dd7ad649d99cfdaddca2c38694 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:09:46.657284 11941 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:46.666687 11912 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b93a2cf326204d8e89e4fe76ead348c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.667066 12019 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.667454 11872 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.668629 12983 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.669757 13023 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.702491 13023 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.706667 11865 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.712965 12018 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.729628 11872 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:46.754559 11768 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.759974 12018 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.763684 12968 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.767215 11941 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:46.775657 11837 consensus_peers.cc:597] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f845a1dd30e04dccb21da2a17ebf1415. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.788774 12968 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.800061 13029 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.805081 12018 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.833237 11941 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.838194 11770 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.843029 12018 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:46.862651 11986 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e361e6345864efa81f207f2a9dafda0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.865160 11941 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.866851 13012 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.871416 11872 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.873821 13009 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:09:46.954612 13012 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.957324 11865 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.976500 11941 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:46.987047 11872 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:46.997123 11769 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:47.014050 11837 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3e68fbb001a46d6af7bd0fc3e94e9ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.015199 12018 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.021404 12968 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.029718 11941 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.042164 13029 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.069885 12968 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:47.081210 12015 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:47.101861 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 1 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.118546 11941 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:47.338255 13045 ts_tablet_manager.cc:933] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:47.339247 13043 ts_tablet_manager.cc:933] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:47.457319 13049 ts_tablet_manager.cc:933] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:47.524215 13045 tablet_copy_client.cc:323] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:47.525116 13049 tablet_copy_client.cc:323] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:09:47.528110 13043 tablet_copy_client.cc:323] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:09:47.530505 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet b93a2cf326204d8e89e4fe76ead348c5 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:09:47.531219 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet b93a2cf326204d8e89e4fe76ead348c5 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-b93a2cf326204d8e89e4fe76ead348c5
I20260709 12:09:47.531371 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 3e361e6345864efa81f207f2a9dafda0 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:09:47.532039 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 3e361e6345864efa81f207f2a9dafda0 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-3e361e6345864efa81f207f2a9dafda0
I20260709 12:09:47.536865 13051 ts_tablet_manager.cc:933] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
I20260709 12:09:47.540345 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet f845a1dd30e04dccb21da2a17ebf1415 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:47.540956 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet f845a1dd30e04dccb21da2a17ebf1415 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-f845a1dd30e04dccb21da2a17ebf1415
I20260709 12:09:47.542214 12032 tablet_copy_source_session.cc:215] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.584887 11958 tablet_copy_source_session.cc:215] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.148775 11883 tablet_copy_source_session.cc:215] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.389424 13045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f845a1dd30e04dccb21da2a17ebf1415. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:48.442361 12577 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.BeginTabletCopySession -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54705.5us
W20260709 12:09:48.444109 13051 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.004s	sys 0.013s
W20260709 12:09:48.444520 13051 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.004s	sys 0.013s
I20260709 12:09:48.445163 13051 tablet_copy_client.cc:323] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.65:39113
I20260709 12:09:48.462116 12968 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.462939 12968 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:48.513594 13062 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.513756 11883 tablet_copy_service.cc:140] P 4d7b7ec0a2604d808698037dbd6fa1ef: Received BeginTabletCopySession request for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:39778)
I20260709 12:09:48.514406 13062 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.518636 13062 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.557621 13060 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.558346 13060 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.559163 13063 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.559768 13063 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:48.562613 13067 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.563230 13067 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.568523 13063 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.536170 13062 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.561388 13052 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.582499 13052 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.585041 13052 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.605463 13013 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.606457 13070 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.607007 13070 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.606168 13013 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.573711 13060 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:48.572923 13067 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:48.598455 13052 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.663807 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:48.626031 13043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93a2cf326204d8e89e4fe76ead348c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.665114 13013 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.604399 13062 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.661113 13060 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.675815 13064 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.666769 13067 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.666646 13070 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.676412 13064 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.681802 13065 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.674607 13052 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.699414 13076 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.700279 13076 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.701784 13077 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.702297 13053 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.702481 13077 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.706064 13067 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.675205 13060 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.702896 13053 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:48.731978 13066 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.732736 13075 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.732746 13066 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.733764 13075 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.736176 13045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40986 (request call id 218) took 1457 ms. Trace:
I20260709 12:09:48.738356 13064 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:48.736821 13045 rpcz_store.cc:276] 0709 12:09:47.278666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.280418 (+  1752us) service_pool.cc:224] Handling call
0709 12:09:47.339667 (+ 59249us) ts_tablet_manager.cc:934] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
0709 12:09:48.387707 (+1048040us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:48.552927 (+165220us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:48.556834 (+  3907us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:48.710055 (+153221us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:48.735381 (+ 25326us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:48.735915 (+   534us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:48.736045 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":368,"tablet-copy.queue_time_us":55743,"thread_start_us":277265,"threads_started":2}
I20260709 12:09:48.736330 13059 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.752847 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:48.719434 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:48.710439 13065 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.751587 13068 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.827062 13013 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.786779 13062 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:48.836247 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 102143us
I20260709 12:09:48.837664 13013 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.839993 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:48.840830 12017 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:48.840962 13058 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.838200 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:48.765319 13059 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.823510 13074 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.826239 13070 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.849191 13052 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.831493 13068 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.850803 13081 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.855427 13013 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.853726 13053 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.857051 13070 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.872051 13059 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:48.869769 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 100550us
I20260709 12:09:48.854276 13074 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.867163 13067 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:09:48.878795 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 123357us
I20260709 12:09:48.841614 13058 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.880807 13079 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.898684 13065 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:48.900605 13074 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.865793 13081 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.926606 13081 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.880829 13070 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:48.933424 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:48.896574 13077 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.937927 13077 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.938495 13077 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.894374 13066 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:48.902263 13068 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:48.934744 13070 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:48.944384 13070 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.941193 13075 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:48.947793 12968 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.951411 13058 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.955816 11883 tablet_copy_service.cc:161] P 4d7b7ec0a2604d808698037dbd6fa1ef: Beginning new tablet copy session on tablet e3e68fbb001a46d6af7bd0fc3e94e9ec from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:39778: session id = 189a165e6619406382914fe3075dd436-e3e68fbb001a46d6af7bd0fc3e94e9ec
W20260709 12:09:48.958863 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 204663us
I20260709 12:09:48.968691 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.969141 13077 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.970324 13079 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.972447 13079 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:48.954986 13070 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.974382 13044 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.975108 13044 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.975610 13029 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.976187 13029 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:48.977991 13044 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.978272 13029 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.979308 13070 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:48.979889 13070 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:48.982128 13076 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:48.985343 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:48.994793 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:48.996301 13060 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:48.996513 13076 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.982728 13078 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:48.997092 13076 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:48.999307 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 246405us
I20260709 12:09:49.001204 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:48.997750 13078 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.005728 13066 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.007607 11883 tablet_copy_source_session.cc:215] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.011224 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.011411 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.010370 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.011960 13060 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.012729 13044 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.014806 13061 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.003059 13070 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.017879 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.009567 13079 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.028692 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.027004 13072 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.035683 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.036551 11866 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:49.036762 13074 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.037307 13074 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.038184 13075 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.038769 13075 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.039551 13074 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.040266 13043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41000 (request call id 266) took 1745 ms. Trace:
I20260709 12:09:49.040884 13075 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.041481 13090 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:49.025693 13068 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.061111 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.044835 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.047226 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.069645 13063 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.070276 13063 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:49.071100 13076 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.071219 13045 tablet_copy_client.cc:806] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.020413 13066 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.071923 13045 tablet_copy_client.cc:670] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.073302 13066 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.033867 13087 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.073918 13065 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.033886 13070 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.077133 13070 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.077582 13070 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.042659 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.042097 13090 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.084824 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.045806 13061 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.088374 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.089335 13061 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.031294 13044 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.033640 13060 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.036413 13079 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.040716 13043 rpcz_store.cc:276] 0709 12:09:47.294552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.294725 (+   173us) service_pool.cc:224] Handling call
0709 12:09:47.340922 (+ 46197us) ts_tablet_manager.cc:934] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
0709 12:09:48.503756 (+1162834us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:48.947230 (+443474us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:48.947372 (+   142us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:49.018155 (+ 70783us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:49.018493 (+   338us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:49.040129 (+ 21636us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:49.040204 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1986,"tablet-copy.queue_time_us":42795,"thread_start_us":263271,"threads_started":2}
I20260709 12:09:49.104260 13078 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.095396 13084 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.095410 13082 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:49.095844 13088 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.096421 13089 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.096848 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.078886 13068 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.080492 13087 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:49.106235 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 223599us
I20260709 12:09:49.112100 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.122125 12014 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:49.112676 13043 tablet_copy_client.cc:806] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.074959 13065 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.092957 13063 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.097205 13044 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.091281 11865 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:49.075413 13072 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.110857 13074 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.110913 13077 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.111093 13061 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.111223 13075 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.113842 13067 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.115190 13066 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.121438 13078 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.149086 13054 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.126253 13029 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.129647 13043 tablet_copy_client.cc:670] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.123595 12017 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
W20260709 12:09:49.151748 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 140411us
I20260709 12:09:49.121718 13082 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.148666 13063 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.144172 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.144019 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.144518 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.129206 13086 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.131963 13044 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.152397 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.148290 13058 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.149297 13078 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.148370 13062 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:49.171268 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080011bc20 after lost signal to thread 10700
I20260709 12:09:49.154758 13064 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.147668 13077 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.145179 13085 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.150883 13066 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.150758 13061 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.150996 13067 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.164636 13079 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.154367 13074 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.154939 13075 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.161971 13063 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.162442 13029 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.145406 13087 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.152815 13054 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.176141 13062 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.170018 13044 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.183730 13065 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.145172 13089 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.196090 11942 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:49.179097 13064 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.141916 13088 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.142256 13084 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.189414 13079 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.178859 13058 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:49.194672 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800117560 after lost signal to thread 11805
I20260709 12:09:49.215214 13087 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.216427 13051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.216922 13078 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.217458 13044 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.219007 13061 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.192921 13080 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.180778 13086 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.225131 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.226866 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.269018 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.270470 13054 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.271087 13066 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.223093 13090 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.199977 13072 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.222962 13064 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.283197 13089 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.287448 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.187644 13085 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.260772 13029 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.279102 13043 tablet_copy_client.cc:538] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.297140 13067 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.303470 13086 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.305166 13074 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:09:49.307256 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 203123us
I20260709 12:09:49.227770 13079 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:49.261466 13068 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:49.301419 11894 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd260 after lost signal to thread 11897
I20260709 12:09:49.318934 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.271859 13080 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.329813 13062 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.316177 13063 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.337649 13077 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.338012 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.341796 13049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361e6345864efa81f207f2a9dafda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.344789 13086 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.345526 13086 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:49.345979 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.347185 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.353645 13087 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.362394 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:09:49.358183 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800107000 after lost signal to thread 11972
I20260709 12:09:49.350325 13075 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.354460 13087 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:09:49.371383 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 214636us
I20260709 12:09:49.352262 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.375691 13067 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.422700 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.383531 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:49.383877 13087 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.405897 13058 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.427321 13069 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.427475 13086 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.428200 13088 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.375564 13070 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.425977 13064 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:09:49.422957 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800342f00 after lost signal to thread 12046
I20260709 12:09:49.383024 13089 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.423223 13085 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.449067 13070 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.449827 12611 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.443710 13045 tablet_copy_client.cc:538] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.449936 13064 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.425490 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.438876 13079 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.450158 13080 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.461658 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:49.470018 12014 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.458279 13084 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.454017 13086 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.475416 13086 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.478835 13086 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.481205 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:49.484921 13070 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.441398 13067 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.453040 13069 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.493225 12014 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
W20260709 12:09:49.497231 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800288120 after lost signal to thread 12635
I20260709 12:09:49.501490 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:49.479498 13064 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.456406 13089 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.513587 13043 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
W20260709 12:09:49.509124 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080022ea60 after lost signal to thread 12964
I20260709 12:09:49.517817 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:49.518596 13082 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.509485 13070 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.530957 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.527840 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:49.530102 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.541527 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.541303 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.543843 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.544596 12015 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:49.542371 12014 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:49.545433 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.546352 12018 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:49.527403 11894 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ac0 after lost signal to thread 13023
W20260709 12:09:49.542843 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 78252.9us
I20260709 12:09:49.527122 13060 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:49.550582 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.538362 13070 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:49.559813 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.561906 13069 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:49.548494 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080026a3a0 after lost signal to thread 13024
I20260709 12:09:49.562110 13070 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.567795 13067 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.568148 13045 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:49.548262 13092 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.571990 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:49.569312 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800231060 after lost signal to thread 13025
W20260709 12:09:49.576205 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48483.3us
I20260709 12:09:49.574856 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.577795 12017 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.572926 13081 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.573843 13092 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.584012 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.582852 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.588761 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.589298 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.590111 13073 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.590306 13069 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.590693 13073 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.591385 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.592633 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.593659 13069 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.594358 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.594269 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.595137 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:49.587076 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:49.592751 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.595803 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.580526 13091 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:49.581626 11894 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc0a0 after lost signal to thread 13026
I20260709 12:09:49.619277 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.575626 13080 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:49.613708 13069 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.587203 13092 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.587693 13081 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:49.601869 13065 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.637868 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.644953 12014 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:49.641440 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.646701 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:49.637488 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080030e120 after lost signal to thread 13027
I20260709 12:09:49.649639 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.653479 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.659703 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.664590 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.666419 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.673139 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.643636 13069 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:49.653003 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080033fb60 after lost signal to thread 13030
I20260709 12:09:49.678884 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.649230 13073 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.690353 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.691098 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.692168 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.692580 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.693845 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.642730 13080 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.698292 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.702980 12014 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:49.678628 11894 debug-util.cc:398] Leaking SignalData structure 0x7b080033fba0 after lost signal to thread 13031
I20260709 12:09:49.704272 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.654534 13091 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.706408 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.710747 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.714617 13091 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.678629 13069 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.715974 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.718788 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.678804 13089 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:49.727514 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.730392 13087 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.731693 12611 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.731746 11871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:09:49.732548 11871 raft_consensus.cc:606] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:09:49.706524 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800306e80 after lost signal to thread 13035
W20260709 12:09:49.734071 11894 debug-util.cc:398] Leaking SignalData structure 0x7b0800306d60 after lost signal to thread 13039
I20260709 12:09:49.720346 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.725035 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.743141 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.750779 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.751641 12022 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.755963 13071 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.759053 13081 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.763037 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.763327 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.763994 12018 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.764219 13071 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.764664 13071 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:49.765241 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.779075 12022 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.762949 13080 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.777361 13071 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.781493 13063 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.782058 13071 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.784569 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.786605 13051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40986 (request call id 221) took 2273 ms. Trace:
I20260709 12:09:49.787091 13051 rpcz_store.cc:276] 0709 12:09:47.513232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.515559 (+  2327us) service_pool.cc:224] Handling call
0709 12:09:47.537301 (+ 21742us) ts_tablet_manager.cc:934] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113)
0709 12:09:49.171285 (+1633984us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:49.507297 (+336012us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:49.507501 (+   204us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:49.735389 (+227888us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:49.735752 (+   363us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:49.786460 (+ 50708us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:49.786536 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":275,"tablet-copy.queue_time_us":7711,"thread_start_us":897186,"threads_started":2}
I20260709 12:09:49.788821 13051 tablet_copy_client.cc:806] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.791817 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.792309 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.793274 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.793597 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.794226 12018 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.794306 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.783035 13049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41008 (request call id 90) took 2333 ms. Trace:
I20260709 12:09:49.790940 13051 tablet_copy_client.cc:670] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.812294 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.862283 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.862614 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.863591 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:49.864176 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.864708 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.865183 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.867383 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.868122 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.869346 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.870532 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.872654 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:49.874547 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.782766 13063 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.885905 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.881402 12019 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.881608 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.882438 13049 rpcz_store.cc:276] 0709 12:09:47.442773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.442931 (+   158us) service_pool.cc:224] Handling call
0709 12:09:47.457671 (+ 14740us) ts_tablet_manager.cc:934] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
0709 12:09:49.165050 (+1707379us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:49.493249 (+328199us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:49.493351 (+   102us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:49.755947 (+262596us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:49.756324 (+   377us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:49.761030 (+  4706us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:49.776512 (+ 15482us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":266,"tablet-copy.queue_time_us":13737,"thread_start_us":76325,"threads_started":2}
I20260709 12:09:49.888367 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:49.890165 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.891007 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.893301 13070 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.896718 13051 tablet_copy_client.cc:538] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.897818 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.861335 13092 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.902024 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.902050 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.904515 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.907692 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.908453 12022 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.884467 13063 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:49.911175 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.911855 12014 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.894779 13049 tablet_copy_client.cc:806] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.891568 13087 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:49.920921 13063 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.926848 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.929381 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.930724 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.930553 12014 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:49.931807 12604 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.934031 13049 tablet_copy_client.cc:670] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.934219 13063 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.947492 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.949338 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:49.951563 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.954392 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.954754 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.959720 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:49.964143 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.955904 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:49.969043 13086 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:49.975688 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:49.972644 13084 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.980540 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.984581 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.986732 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.987659 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.969709 13086 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:49.993248 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:49.995862 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.010641 13091 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.011488 13091 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:49.978173 13073 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.020615 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.022223 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:50.024302 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.025060 12022 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:50.021377 12014 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:50.020764 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:49.991267 13071 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.036182 13073 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.036753 11944 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.036988 13084 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.037634 13084 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.038587 13073 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.039767 13084 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.040607 13085 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.040974 13085 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:50.041740 13087 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.045873 13091 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:50.045732 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.047729 12022 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.050261 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.051203 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.034119 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.057201 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.063227 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.065299 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.047287 13080 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.063189 13029 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.068374 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:50.068671 13029 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.063331 13082 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.070993 13051 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:50.074783 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.080051 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:50.063651 13084 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.085104 13049 tablet_copy_client.cc:538] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:50.054879 13087 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:09:50.077404 13092 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.072809 13080 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.088330 13080 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.094786 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:50.081480 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45841us
I20260709 12:09:50.094703 13029 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.073118 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:50.077886 13091 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.102308 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.103904 13081 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.106774 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.107609 13077 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.122426 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.126675 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.127900 13073 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.128731 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.065526 13085 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:50.132582 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.130542 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.135958 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:09:50.140491 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 73283.7us
I20260709 12:09:50.140664 13073 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.151984 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.153244 13085 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.155529 12014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:09:50.140053 13100 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.156172 12014 raft_consensus.cc:606] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Received request to transfer leadership to TS 189a165e6619406382914fe3075dd436
I20260709 12:09:50.113765 13091 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.149196 13073 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:50.163252 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.163985 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.166453 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.161456 13078 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.167865 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.161574 13100 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:50.171355 13100 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.172638 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.162731 13077 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.165381 13073 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.181468 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.167408 13076 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.170364 13081 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.169100 13078 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:50.190882 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:50.196082 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.191517 13078 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.190981 13077 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.191954 13089 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.195637 13060 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.205878 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.204093 13090 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.204823 13089 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.223994 13086 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:50.218008 13090 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.217005 13069 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.252110 12016 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.250891 13091 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.221720 13089 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:50.270511 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 89159.9us
I20260709 12:09:50.272107 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.274281 13064 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.277458 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.254473 13090 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.285903 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.252902 13069 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:50.287420 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.310472 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.324193 13073 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.327490 13073 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:50.337203 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 138579us
I20260709 12:09:50.340842 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:50.341663 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 173846us
I20260709 12:09:50.343711 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.344622 13115 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.345132 13115 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:50.346289 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.347173 13060 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.347704 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.348940 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.349321 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.330058 13069 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.308025 13117 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.352003 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.376377 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.379051 13108 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.380125 13076 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.353390 13117 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.381253 13117 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.336676 13110 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.345506 13115 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.382877 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.386966 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.353029 13091 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.355626 13060 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.383432 13122 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.351269 13080 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.386294 13073 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.390741 13076 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.400838 13060 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.397053 13089 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.421650 13122 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.451648 13122 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.435150 13076 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:50.444424 13060 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.421105 13120 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.455754 13111 raft_consensus.cc:993] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:09:50.458666 13076 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.476725 13111 raft_consensus.cc:1081] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:09:50.515228 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:50.516543 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:50.523874 11941 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.529870 13029 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.531831 13029 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.533879 13029 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.518453 13091 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.511693 13084 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.534700 13091 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:50.548686 13045 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:09:50.548493 13080 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.548048 13118 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.546149 13065 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:09:50.546841 13084 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.570302 13089 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:50.598690 13065 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.599079 13065 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:50.599864 13043 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:50.600088 13065 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.600951 13043 tablet_bootstrap.cc:492] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:50.603477 13106 raft_consensus.cc:993] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 189a165e6619406382914fe3075dd436 to start an election
I20260709 12:09:50.603960 13106 raft_consensus.cc:1081] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Signalling peer 189a165e6619406382914fe3075dd436 to start an election
I20260709 12:09:50.617062 13084 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.623314 12605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c"
dest_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:41008
I20260709 12:09:50.624082 12605 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.624480 12605 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.601352 13065 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.591180 13118 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.614837 13090 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.636142 13115 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:50.637018 13090 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.628659 13043 ts_tablet_manager.cc:1403] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.115s	user 0.042s	sys 0.044s
I20260709 12:09:50.660385 13084 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:50.661513 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 285226us
I20260709 12:09:50.667551 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.671096 13043 raft_consensus.cc:359] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:50.672838 13043 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:50.673849 13091 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.673712 13043 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:50.677404 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.679219 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.680896 11839 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:50.683151 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 249997us
I20260709 12:09:50.683478 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.684103 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.686919 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.690691 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.631738 13122 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:50.702344 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.700891 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.704483 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:50.698931 13029 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.709357 13049 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:09:50.705821 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.685658 13111 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.686010 13091 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.686012 13090 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.721738 13117 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.729561 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.730803 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.698547 13082 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.688498 13108 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.716264 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:50.711962 13029 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.734694 13058 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.734922 13111 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.735917 13111 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.736352 13111 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.736745 13111 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.740633 11865 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:50.741088 11868 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.735095 13029 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.743431 13029 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.709782 13081 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.743918 13029 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.714134 13118 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.745046 13118 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.745172 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.746417 11868 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:50.686084 13125 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.748428 13115 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.697705 13084 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.752754 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.712702 12605 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:50.753206 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:50.696885 13078 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.761011 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.761507 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.745486 13118 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.747509 13082 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.716144 13076 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.712815 13060 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.772423 12016 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.760854 13125 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:50.775084 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:50.775350 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:50.773977 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.786824 11872 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.786091 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:50.776901 11868 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:50.797662 11869 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.798527 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:50.799335 13084 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.779979 13118 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.778628 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:50.826069 13043 ts_tablet_manager.cc:1434] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.171s	user 0.009s	sys 0.001s
I20260709 12:09:50.839666 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:50.827498 13100 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
I20260709 12:09:50.840853 13100 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.842262 11947 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.843498 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-b93a2cf326204d8e89e4fe76ead348c5 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:09:50.844305 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-b93a2cf326204d8e89e4fe76ead348c5 on tablet b93a2cf326204d8e89e4fe76ead348c5 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:50.827622 13060 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.789426 13125 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.789410 13128 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.831069 13029 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.780228 13082 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.838366 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.849184 11872 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:50.859885 13134 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:50.866704 11867 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:50.868430 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:50.878925 11864 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:50.880466 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 337210us
W20260709 12:09:50.881318 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 88475.1us
I20260709 12:09:50.884541 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:50.874912 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:50.897815 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:50.878899 13051 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:50.862972 13122 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.877866 13091 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.910044 13083 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:09:50.911578 13083 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.912123 13083 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:09:50.938572 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 207819us
I20260709 12:09:50.940487 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.870082 13081 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:09:50.944697 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.916374 13045 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:50.946601 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:50.938803 13071 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:50.947904 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:50.914516 13076 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:50.957585 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59891.7us
I20260709 12:09:50.943204 13108 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.898108 13134 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.961727 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:50.948741 13122 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.951022 13085 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.958033 13071 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:50.979549 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.984273 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.913408 13083 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:50.970939 13051 tablet_bootstrap.cc:492] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:50.990353 12019 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:50.992624 11867 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.967628 13117 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:50.993614 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.995466 11867 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:50.985898 13071 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.997145 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.998636 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.000012 12605 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:50.972527 13136 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.002696 13136 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:51.003310 13136 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.003726 13029 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.005031 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.996083 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.007128 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:50.989212 13045 tablet_bootstrap.cc:492] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:50.991914 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.010877 13051 ts_tablet_manager.cc:1403] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.940s	user 0.045s	sys 0.028s
I20260709 12:09:51.050344 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.009686 13133 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.011219 13137 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:09:51.052114 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59245.7us
I20260709 12:09:51.053100 11868 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:51.052987 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.060984 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.063537 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.065800 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:51.064777 12017 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.070237 12017 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:51.070331 13081 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.071303 13081 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.069689 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.069442 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:51.071391 12017 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.074616 12017 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.078222 13078 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.080495 13100 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.082190 13123 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.083446 12017 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:51.085203 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:51.087282 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.090195 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.090608 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.092168 13134 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.092341 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.093169 11864 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:51.094456 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.095314 13051 raft_consensus.cc:359] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.096385 13051 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:51.096388 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.071779 13081 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.084522 13077 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.099653 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.100512 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.099048 13081 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.102133 13083 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.068470 13045 ts_tablet_manager.cc:1403] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.501s	user 0.026s	sys 0.028s
I20260709 12:09:51.113785 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.114462 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.065811 13133 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:51.097155 12604 raft_consensus.cc:1217] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.118789 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:51.128368 13128 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.109828 13077 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:51.147339 13077 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.128988 13123 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:09:51.136303 13081 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.123152 13076 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.137120 13070 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.148157 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.152325 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.152379 13070 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:51.155124 13070 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.155974 13123 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.156414 13123 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.139225 13045 raft_consensus.cc:359] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.159708 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.145900 13128 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.097225 13051 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.159116 13076 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:51.129719 13133 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.174453 13082 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.175994 11873 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.176882 13082 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.177989 13118 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.190834 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.163671 13092 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.196436 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.161993 13045 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:51.198565 12016 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.197196 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.199142 13092 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.178643 13076 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.157270 13123 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.200057 13115 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.202226 12609 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.213696 11870 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.214097 13123 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.215099 13029 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.215596 13029 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:51.205495 12017 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.216470 13029 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.217806 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.224315 13029 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.200839 13111 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.228824 13045 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.229357 11866 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.226382 13138 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.168097 13128 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.236227 13138 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.246481 11869 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.247483 13138 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.248374 12015 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.250169 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.229265 13111 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.257661 13128 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.263607 13091 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.264006 13136 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.268534 13078 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.259253 13092 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.273983 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.276661 12015 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:51.278138 13078 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.278828 13078 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.279158 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:51.280684 13092 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.280194 13078 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.281186 13092 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.288780 12016 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:51.282130 13045 ts_tablet_manager.cc:1434] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.160s	user 0.008s	sys 0.002s
I20260709 12:09:51.268697 13100 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.296850 13139 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:09:51.298525 13092 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.317708 13139 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.318117 13139 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.304973 11769 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.297428 13118 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.267035 13125 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.310406 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.298074 13120 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:09:51.325570 13073 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.325966 13073 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.326812 13073 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.328323 13073 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.304320 13080 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:09:51.332785 12609 raft_consensus.cc:1217] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.296985 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.284559 13076 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.338763 13097 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.339530 13051 ts_tablet_manager.cc:1434] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.280s	user 0.019s	sys 0.007s
I20260709 12:09:51.329121 13071 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.344091 11871 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.310458 13100 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.341957 13097 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.348838 11943 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.334592 13110 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.353039 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.358945 11943 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:51.361974 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:51.339567 13136 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.351408 13110 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:51.393852 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84570.5us
I20260709 12:09:51.461226 13139 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.475080 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.409328 12022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56174
I20260709 12:09:51.477129 12022 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.371905 11947 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.338034 13078 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.386571 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.388808 12015 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.459811 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:51.520937 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61264.8us
W20260709 12:09:51.502874 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:51.498363 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.411224 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:51.422303 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.410686 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:51.463467 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.524326 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.485513 11942 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.497579 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.527774 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:09:51.530078 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 119544us
I20260709 12:09:51.389111 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.459856 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.513078 12022 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.530634 11941 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.474939 13128 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:09:51.515476 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.386164 13106 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.394207 13115 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.534977 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.538987 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.539858 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.541456 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.411852 13141 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.545056 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.545221 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.545840 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.479643 13063 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.388756 12017 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:51.413050 13070 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.550689 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.561846 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.562723 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.564404 12021 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.565196 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.566202 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.567545 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.570605 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.572562 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.531478 13136 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.577399 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.371402 13086 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.185s
I20260709 12:09:51.550102 13139 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.359086 13097 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:51.549780 13115 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.610352 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.612155 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.619731 13077 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.621222 11944 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.624115 13115 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.625526 13115 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.559660 13106 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:51.628774 13076 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.578207 13070 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.594967 13063 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.634166 13070 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:51.633952 13063 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.636586 13070 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.642668 13143 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.643364 13143 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:51.644345 13143 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.578011 13141 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:51.645924 13141 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.658847 13110 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:51.602509 13125 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.609392 13137 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.710178 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:51.709712 11941 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:09:51.712554 13133 consensus_meta.cc:287] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:09:51.628774 13106 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:51.667237 13100 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:51.713786 11940 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.714656 12022 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:51.717247 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 165347us
I20260709 12:09:51.758648 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:51.759232 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.759936 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.720626 13077 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.761067 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.637166 13070 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.740298 11947 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.668314 13071 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.769667 13106 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.772301 12022 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:51.773161 13092 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:51.778765 12609 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:51.779932 13070 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:51.783126 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 258859us
I20260709 12:09:51.785861 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.791512 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.785637 11912 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:51.759835 13097 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:51.803609 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 55027.6us
I20260709 12:09:51.798715 13117 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.830389 12018 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.830403 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.758936 13133 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.811112 13071 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.837725 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-f845a1dd30e04dccb21da2a17ebf1415 received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:51.838388 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-f845a1dd30e04dccb21da2a17ebf1415 on tablet f845a1dd30e04dccb21da2a17ebf1415 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:51.812026 13132 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.837107 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.828788 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.846554 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.853483 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:51.837782 13071 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.858729 13071 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.849304 11868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:09:51.864950 11868 raft_consensus.cc:606] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:51.818948 13147 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:09:51.856312 12013 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:51.882771 11867 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.883355 11941 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.883991 11869 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.889495 11883 tablet_copy_service.cc:342] P 4d7b7ec0a2604d808698037dbd6fa1ef: Request end of tablet copy session 189a165e6619406382914fe3075dd436-e3e68fbb001a46d6af7bd0fc3e94e9ec received from {username='slave'} at 127.0.0.1:39778
I20260709 12:09:51.890102 11883 tablet_copy_service.cc:434] P 4d7b7ec0a2604d808698037dbd6fa1ef: ending tablet copy session 189a165e6619406382914fe3075dd436-e3e68fbb001a46d6af7bd0fc3e94e9ec on tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:51.891369 13133 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.892288 11942 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.892767 13145 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:09:51.893167 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 101747us
I20260709 12:09:51.889498 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.894558 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.897442 13092 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:51.893260 13145 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.902747 13145 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.903826 13147 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.904157 13145 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.904268 13147 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:51.905140 13147 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.906585 13147 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.913720 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.917641 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:51.921761 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.929848 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:51.930308 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.827096 13141 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.938048 12015 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:51.932427 13146 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 12:09:51.946327 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.940037 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.946744 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:51.947467 12015 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:51.932077 13135 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.954221 11864 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.935034 13097 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.950062 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.949769 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.952536 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.954692 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.931780 11869 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:51.960055 12018 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:51.961035 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:51.945142 13123 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.731s	user 0.015s	sys 0.008s
I20260709 12:09:51.941174 13106 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.964192 11873 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.964551 11871 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.940912 13154 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.974732 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:09:51.975406 12018 raft_consensus.cc:606] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Received request to transfer leadership to TS 189a165e6619406382914fe3075dd436
I20260709 12:09:51.962107 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.962862 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:51.965065 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.958951 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:51.966112 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:51.938870 13080 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:09:51.968896 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.984254 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.956564 13086 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.972033 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:51.985978 13150 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.986235 13080 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.956280 13138 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:09:51.965354 13110 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.003213 13080 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:51.988777 13123 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.004101 13123 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:52.004413 13080 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:51.992470 13141 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:52.006398 11946 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:51.989688 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.973721 13154 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.966166 12604 raft_consensus.cc:1217] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.978827 13089 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.013743 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:51.995975 13049 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:52.029197 13089 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:52.030501 13049 tablet_bootstrap.cc:492] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:09:52.030386 13089 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.031836 13089 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.993280 13069 raft_consensus.cc:993] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 189a165e6619406382914fe3075dd436 to start an election
I20260709 12:09:51.992139 13155 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.033147 13069 raft_consensus.cc:1081] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Signalling peer 189a165e6619406382914fe3075dd436 to start an election
I20260709 12:09:52.005273 13123 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.018217 13141 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.042997 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:52.044241 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.044744 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:52.034751 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 43509.5us
W20260709 12:09:52.035516 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 88187.5us
I20260709 12:09:52.047391 12021 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.048880 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.050483 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.051340 13097 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.052122 13135 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.054251 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.034242 13138 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.022302 13154 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.046816 13049 ts_tablet_manager.cc:1403] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.338s	user 0.030s	sys 0.023s
I20260709 12:09:52.042260 13080 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.046883 13086 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.060914 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.047777 13110 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.001225 13071 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.050601 13069 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.066417 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.067445 11942 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.053246 12605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8"
dest_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:41008
I20260709 12:09:52.067534 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.069692 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.081959 12605 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.082567 12605 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.086174 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.087642 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.073282 11943 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.064478 13141 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.062449 13138 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:52.092758 11940 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:52.053797 13092 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:09:52.091008 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.073400 13155 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.104943 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.090713 12604 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.087482 13097 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.058053 13134 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:09:52.114565 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 52775.4us
I20260709 12:09:52.095672 13083 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.116838 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.098345 13110 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.119686 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.080318 13091 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:52.111629 13139 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.114888 13063 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.128840 13111 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.132045 13111 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.121730 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.130545 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.135906 11870 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.111433 13078 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:09:52.136811 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.146835 13132 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.141044 13133 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.138383 11870 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.152693 11870 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.153780 13125 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.154441 13125 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.136179 13164 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.155512 13125 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.157613 13029 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.158090 13029 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.158581 13138 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.158967 13029 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.159332 12605 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.160244 13138 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.160516 13029 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.129347 13158 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:09:52.162685 13158 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.163040 13158 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.163812 13158 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.165984 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.166536 13071 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:52.168447 13065 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.153846 11870 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.175483 13133 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.175907 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.176795 13118 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.176697 13133 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.177186 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.177368 13118 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.178234 13136 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.178764 13136 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.178539 13118 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.179692 13136 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.180444 12605 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.180580 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:52.181320 12018 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.181653 12018 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:52.184911 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.185622 11941 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.190105 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:52.190804 12015 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:09:52.192319 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.192981 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:52.193284 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:52.182448 12018 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.205698 12018 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.208396 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.209218 11941 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:52.164929 13158 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.214388 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:52.215160 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:09:52.215603 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:52.218320 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.219691 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.221902 11940 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:52.221968 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.226577 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.227111 11941 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.233453 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.235788 11942 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.139873 13120 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:09:52.249828 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.243508 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.263582 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.264611 11941 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:52.224125 13143 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.230014 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:52.269393 12015 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:52.182901 13134 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:09:52.224713 13150 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.272702 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.225396 13092 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.133044 13111 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:52.267026 13029 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.232739 13089 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:09:52.216377 13155 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:09:52.295647 12021 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.274410 13143 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.271651 13164 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.283888 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:52.286286 13145 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.300762 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.337311 13143 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:52.338583 13149 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.338541 13143 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.339247 13149 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:52.340287 13149 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:52.347859 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.349233 13169 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.267050 13151 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:09:52.350363 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49668.8us
W20260709 12:09:52.361055 13160 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
W20260709 12:09:52.362178 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.364708 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101220us
I20260709 12:09:52.342707 13134 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:52.366035 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.347963 11868 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.291862 13049 raft_consensus.cc:359] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:52.350858 13029 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.372991 12018 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:52.334297 13082 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:09:52.354576 13149 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.356835 13097 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.367877 13129 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:52.386488 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.387189 13152 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:09:52.374806 11868 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.378584 13049 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:09:52.378329 13029 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.390365 13097 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:52.376767 13134 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.410903 13165 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.405514 13169 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.378818 13154 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.399978 13129 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.399003 11868 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.426142 13029 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.458976 11868 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.466836 12609 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:52.396391 13164 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.485477 13134 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.483973 11946 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:09:52.489777 13167 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:09:52.492936 13166 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:09:52.412575 13049 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:52.502442 13073 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.418457 13097 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.501225 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 110) took 1265 ms. Trace:
W20260709 12:09:52.512239 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 116891us
I20260709 12:09:52.505134 13073 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:52.486101 13129 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.543234 13106 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.550103 13049 ts_tablet_manager.cc:1434] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.483s	user 0.009s	sys 0.003s
I20260709 12:09:52.505677 11769 rpcz_store.cc:276] 0709 12:09:51.235534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.245709 (+ 10175us) service_pool.cc:224] Handling call
0709 12:09:52.500987 (+1255278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:51.837082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:51.860968 (+ 23886us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:51.861039 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:09:51.861068 (+    29us) tablet.cc:662] Decoding operations
0709 12:09:51.871155 (+ 10087us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:51.871251 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:51.871295 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:51.871589 (+   294us) tablet.cc:701] Row locks acquired
0709 12:09:51.871609 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:09:51.871825 (+   216us) write_op.cc:270] Start()
0709 12:09:51.871989 (+   164us) write_op.cc:276] Timestamp: P: 1783598991871768 usec, L: 0
0709 12:09:51.872031 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:09:51.889485 (+ 17454us) log.cc:844] Serialized 535 byte log entry
0709 12:09:52.107047 (+217562us) op_driver.cc:464] REPLICATION: finished
0709 12:09:52.367290 (+260243us) write_op.cc:301] APPLY: starting
0709 12:09:52.375180 (+  7890us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:52.379887 (+  4707us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:52.391388 (+ 11501us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:52.398785 (+  7397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:52.398956 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:52.399005 (+    49us) write_op.cc:312] APPLY: finished
0709 12:09:52.400533 (+  1528us) log.cc:844] Serialized 22 byte log entry
0709 12:09:52.400735 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:52.402560 (+  1825us) write_op.cc:454] Released schema lock
0709 12:09:52.403778 (+  1218us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:52.411618 (+  7840us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:52.414777 (+  3159us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":244437,"apply.run_cpu_time_us":3200,"apply.run_wall_time_us":50865,"num_ops":1,"prepare.queue_time_us":499944,"prepare.run_cpu_time_us":36372,"prepare.run_wall_time_us":143018,"raft.queue_time_us":72410,"raft.run_cpu_time_us":16757,"raft.run_wall_time_us":189843,"replication_time_us":234765,"thread_start_us":783495,"threads_started":4,"wal-append.queue_time_us":122588}]]}
I20260709 12:09:52.567224 13173 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.568001 13173 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.570986 13173 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.581982 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:52.583114 12018 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:52.585394 13154 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.564440 13145 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:09:52.590662 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.559615 13106 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.598212 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:52.608039 13145 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.594645 13133 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.563231 13073 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.600374 13134 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.616775 12018 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.611584 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-3e361e6345864efa81f207f2a9dafda0 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:09:52.642720 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-3e361e6345864efa81f207f2a9dafda0 on tablet 3e361e6345864efa81f207f2a9dafda0 with peer 189a165e6619406382914fe3075dd436
I20260709 12:09:52.636476 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:52.649873 13073 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.650686 13111 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:52.634646 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:52.645705 12022 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
W20260709 12:09:52.630661 13135 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.578s	user 0.015s	sys 0.000s
I20260709 12:09:52.664367 13111 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.620954 13133 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.633415 13134 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.687727 13106 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:52.692272 13133 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:52.693413 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 306953us
I20260709 12:09:52.694684 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.694921 11873 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:52.696254 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.697363 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.699056 13158 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.702741 13134 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.706172 11868 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:52.707227 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:09:52.707878 11948 raft_consensus.cc:606] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.698342 13148 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.690850 13135 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:52.714597 13177 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:09:52.723205 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.727484 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:52.728592 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:52.716884 13138 consensus_meta.cc:287] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 12:09:52.730479 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:52.727895 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.734639 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.737336 13148 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.739517 13171 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.732115 13154 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.742482 13171 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:52.742949 13155 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.743458 13155 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:52.754961 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.743144 13171 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.768277 13171 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:52.763862 13176 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.763468 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.775107 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:52.775897 12015 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:52.777066 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:52.781065 13101 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:52.790158 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.790129 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:52.791410 12022 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:52.759428 13134 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:09:52.774453 13141 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.803056 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:52.804481 12015 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:52.806114 13159 raft_consensus.cc:1064] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:09:52.810276 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.810844 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.811326 11948 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.811512 11942 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:52.779824 13171 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:52.815538 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.816520 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:52.817606 11942 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.818584 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.827966 11871 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.822046 13073 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.831373 13073 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.831823 13073 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.803777 13082 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.838886 12016 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.842403 13175 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:52.829355 13137 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.801201 13155 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.847821 13155 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.844913 13137 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.849494 11871 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.851558 11868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:09:52.852305 11868 raft_consensus.cc:606] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:52.852656 11868 raft_consensus.cc:614] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:52.857965 13169 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:52.859302 13125 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:52.839134 13082 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.823563 13171 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.867941 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:52.858557 13169 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.851178 13147 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:52.874840 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:52.876220 13136 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.881147 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:52.866196 13029 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.866482 13071 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.863968 13175 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:52.905488 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.864432 13134 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:52.931591 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51045.5us
W20260709 12:09:52.932543 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57791.9us
I20260709 12:09:52.863564 13125 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:52.872969 13129 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:09:52.901559 13158 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:52.936530 13120 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.961985 13148 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.937211 13082 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:52.938913 13133 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.942205 13071 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:52.975783 13189 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
I20260709 12:09:52.980554 13171 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:52.981420 13188 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.246s	user 0.004s	sys 0.000s
I20260709 12:09:52.982468 12604 raft_consensus.cc:1217] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.939332 13136 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.943380 13175 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:52.990367 13091 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.989044 11769 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.024780 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:52.947780 13134 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.013458 13148 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:52.940606 13147 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.033980 11769 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.035730 11769 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.019577 13133 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:53.039162 11769 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.024744 13137 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:09:53.045590 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 101075us
W20260709 12:09:53.042192 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 97206.7us
W20260709 12:09:53.043669 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.047796 11942 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.049692 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:53.052376 13175 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.054430 13073 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.056041 13071 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.056649 13073 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.058522 13136 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.059147 13082 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.031044 13173 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:53.064605 12014 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.066514 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.069903 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:53.076256 12018 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:53.077453 12014 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.078294 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.078912 12015 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.079262 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.078958 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:53.081176 12022 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.084568 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:53.084609 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:53.085376 11871 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:53.085675 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:53.087236 13143 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.087674 12018 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.089656 13106 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:53.090101 13106 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:53.090463 13106 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.094034 13169 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.057117 13148 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.094687 12018 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:53.084643 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:53.095538 13148 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.095340 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.100262 13134 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.101251 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:52.995560 13176 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:09:53.100346 12022 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.043969 13133 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.103704 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.087591 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.107352 12019 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:53.115732 12015 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.119267 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:53.119603 13073 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.120095 13073 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.120833 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:53.121665 11942 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:53.122149 13197 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:53.122490 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 75443.3us
I20260709 12:09:53.122711 13197 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.123227 13197 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.124840 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:53.125608 11865 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:53.125118 11946 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.126266 11941 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.126540 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:53.130059 13143 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.131290 13073 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.133661 13137 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.134188 13137 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:53.134614 13137 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.136034 11940 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.137923 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:53.112408 13145 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:53.112218 13065 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:53.176445 12019 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:53.146406 13169 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:53.276532 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.084110 13173 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.169106 12014 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.279063 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:53.281039 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:53.292215 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 111411us
I20260709 12:09:53.296483 12019 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:53.294688 13169 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.275513 13185 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.632390 13185 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:09:53.377064 13195 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:09:53.292721 13145 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:53.614274 13175 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.614930 11948 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.297170 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:53.279258 11944 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:53.626606 13155 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.013s
I20260709 12:09:53.617928 13147 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:53.623669 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 318508us
I20260709 12:09:53.349341 13134 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:09:53.621493 13065 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.709115 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 35) took 1153 ms. Trace:
I20260709 12:09:53.626904 13149 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.721602 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 424492us
I20260709 12:09:53.620954 13197 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.635723 13169 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.730019 13125 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:53.730736 13164 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:53.731945 13101 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.701761 13106 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.013s
W20260709 12:09:53.710484 13137 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.023s
I20260709 12:09:53.797049 13210 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.797570 13106 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.799844 13210 raft_consensus.cc:993] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:09:53.800258 13106 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:53.758154 13158 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:09:53.800940 12020 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:53.802707 12609 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:53.758102 13147 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:09:53.726449 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:53.770489 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:53.752552 13148 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.012s
I20260709 12:09:53.723181 13175 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:53.739985 12013 rpcz_store.cc:276] 0709 12:09:52.525925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.526121 (+   196us) service_pool.cc:224] Handling call
0709 12:09:52.526591 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.530195 (+  3604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.530221 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.542114 (+ 11893us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.828281 (+286167us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18003d3240. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:09:53.137710 (+309429us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:53.137751 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.137823 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.634589 (+496766us) raft_consensus.cc:1685] finished
0709 12:09:53.634608 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.679335 (+ 44727us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"raft.queue_time_us":3775,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6072,"spinlock_wait_cycles":2885888,"thread_start_us":309203,"threads_started":1,"wal-append.queue_time_us":1084157}
I20260709 12:09:53.805748 13137 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:53.829883 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 103525us
I20260709 12:09:53.780886 13185 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.831463 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:53.839334 13129 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.758334 13176 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:09:53.753960 13065 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.758486 13149 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.857651 13091 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.830446 13205 raft_consensus.cc:1081] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:09:53.875193 11913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.046s
W20260709 12:09:53.886241 11913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.024s	sys 0.047s
I20260709 12:09:53.873865 13129 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.867481 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:53.895510 11868 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
W20260709 12:09:53.895975 13133 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.792s	user 0.005s	sys 0.010s
I20260709 12:09:53.881234 13154 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:53.896430 13133 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.896692 13145 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:53.897324 13082 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.838s	user 0.020s	sys 0.006s
I20260709 12:09:53.792905 13101 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.837237 13120 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:09:53.898639 13133 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.898710 13065 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:53.899717 13120 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:53.900169 13137 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.900251 13120 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:53.901691 11864 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.888144 13091 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.904508 13091 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.893715 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:53.905485 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:53.905836 13065 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.894579 13129 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.896727 13154 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:53.906358 13065 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.907985 13154 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:53.879962 13185 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.926373 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:53.914480 13150 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.942268 12016 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:53.913810 13106 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.919759 13173 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:53.914891 13185 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.915333 13155 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:53.913204 13065 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:53.952869 13134 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:53.959685 12609 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.959501 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:09:53.961802 13207 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 12:09:53.979768 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:53.991540 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:53.965107 13101 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:53.985682 13185 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.004751 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:53.990566 13100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.017s	sys 0.083s
I20260709 12:09:53.983711 13135 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:53.911671 13175 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:53.998543 13141 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.971611 13150 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:54.012425 13100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.017s	sys 0.083s
I20260709 12:09:54.006493 13147 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:53.982035 13106 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.030231 13101 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.010092 13148 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:09:54.006826 13196 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:09:54.032119 13211 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.036681 13082 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.037950 13205 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.035318 13186 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.999866 13155 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.037969 13147 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.029824 13135 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.003023 13134 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:54.038066 13141 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:54.062561 13149 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.069646 13147 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.054037 13101 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.125376 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.126145 12016 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:54.129109 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:54.129913 11873 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.129967 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.130368 11871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:09:54.130605 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:54.131457 12021 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.132066 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:54.130924 11871 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.133630 11866 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:54.133745 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.133998 11871 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.135070 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:54.130153 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.137840 12016 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:54.138875 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.139803 11942 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:54.140250 11946 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.126022 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:54.141170 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.142645 11948 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:54.142985 12014 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:54.144790 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:54.145586 12607 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Advancing to term 2
I20260709 12:09:54.152110 12021 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:54.160403 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:54.160771 13216 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:54.161609 13216 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.162329 13173 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.162923 13173 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.166121 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:54.068174 13205 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.178246 11873 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:54.180364 12607 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 2 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.165165 13173 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.063865 13211 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.070067 13186 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.175930 11871 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:54.183207 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 178514us
I20260709 12:09:54.190155 11872 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.172466 13208 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.172289 13073 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.203002 11871 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.224529 13141 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.180109 13154 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.232554 13073 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:54.202582 12605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 342) took 1054 ms. Trace:
I20260709 12:09:54.220837 13208 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.180773 13213 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.250408 13141 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.282984 11865 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:54.280579 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 128691us
I20260709 12:09:54.202407 13176 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:09:54.203027 13196 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:09:54.256321 13149 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.286701 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:54.277348 13204 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:09:54.270337 13148 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.294229 13149 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.270804 13154 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.309418 13219 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.273936 12605 rpcz_store.cc:276] 0709 12:09:53.130222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.132059 (+  1837us) service_pool.cc:224] Handling call
0709 12:09:54.072316 (+940257us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:09:54.075162 (+  2846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.097518 (+ 22356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.120787 (+ 23269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.123879 (+  3092us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.154358 (+ 30479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.176744 (+ 22386us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.184167 (+  7423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7625600}
I20260709 12:09:54.289439 13141 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.282126 13213 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.310516 13216 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.424336 13155 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.292841 13133 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
W20260709 12:09:54.422572 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 128633us
I20260709 12:09:54.421207 13219 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:54.503691 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:54.504614 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49559.7us
I20260709 12:09:54.518452 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:54.520573 13218 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.516098 13216 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.504320 13224 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:54.515975 13148 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.482863 13219 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.515034 13155 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.529096 13224 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.535386 13148 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:54.558259 13193 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.470s	user 0.008s	sys 0.017s
I20260709 12:09:54.559299 13148 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.560102 13148 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.536689 13238 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.432559 13123 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 12:09:54.532996 13221 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.258s	user 0.003s	sys 0.008s
I20260709 12:09:54.551295 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.553112 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.553639 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.554165 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:54.554476 13205 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.528481 13216 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.579486 13141 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.501993 13215 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:54.539175 13226 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:54.565618 12022 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.578007 13227 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.563953 13211 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.566424 13134 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:54.579685 13159 raft_consensus.cc:1068] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:09:54.581462 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1336) took 1406 ms. Trace:
I20260709 12:09:54.513092 13175 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:54.565568 13101 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.530004 13143 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.582259 12016 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:09:54.566411 13169 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.798s	user 0.016s	sys 0.004s
I20260709 12:09:54.612391 13149 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:54.618189 13233 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:09:54.616940 12015 rpcz_store.cc:276] 0709 12:09:53.174715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.178918 (+  4203us) service_pool.cc:224] Handling call
0709 12:09:53.179356 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.620292 (+440936us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:53.887657 (+267365us) log.cc:844] Serialized 14 byte log entry
0709 12:09:53.887908 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.887962 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:53.888008 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.581189 (+693181us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540015c554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:09:54.581239 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.581378 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1949,"prepare.queue_time_us":381680,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3016,"raft.queue_time_us":121,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":3955,"spinlock_wait_cycles":441506560,"thread_start_us":266678,"threads_started":1}
W20260709 12:09:54.618696 13129 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.712s	user 0.024s	sys 0.007s
I20260709 12:09:54.561900 13238 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.603241 13141 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:54.604734 13231 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:54.580926 13216 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.613149 13224 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.580699 13215 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.627455 12606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 344) took 1494 ms. Trace:
I20260709 12:09:54.645080 13129 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.629649 13175 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.591184 13139 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.587250 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:54.630517 13143 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.638366 13169 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.564962 13155 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.608119 13226 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.620066 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:54.643512 13141 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.620321 13097 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:54.648589 12606 rpcz_store.cc:276] 0709 12:09:53.133493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.133670 (+   177us) service_pool.cc:224] Handling call
0709 12:09:54.626366 (+1492696us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:09:54.626666 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.626925 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.626982 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.627045 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.627097 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.627180 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.627366 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19703040}
W20260709 12:09:54.658855 13147 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.005s
I20260709 12:09:54.661768 13147 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.662998 13141 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.663158 13143 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.667254 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:54.663697 12020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 1333) took 1576 ms (client timeout 2100 ms). Trace:
I20260709 12:09:54.665904 13147 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.647418 13186 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.668675 12021 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.668812 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:54.666136 11869 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:54.644472 13231 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.649170 13213 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.656708 13129 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.660380 13097 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.657166 13154 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.677973 13154 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:54.678838 13169 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.679631 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:54.680433 12017 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:54.681047 13175 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:54.681144 12020 rpcz_store.cc:269] 0709 12:09:53.083175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.083339 (+   164us) service_pool.cc:224] Handling call
0709 12:09:54.659425 (+1576086us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54000776d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:09:54.659539 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619133184}
I20260709 12:09:54.657291 13238 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.683362 13215 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.641523 13227 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.678560 13154 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.651576 13139 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:54.645147 13208 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.687981 13129 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.696808 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:54.697739 12018 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.701058 13148 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.701388 13154 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.706534 13205 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:54.717430 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.719806 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.720618 11942 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
W20260709 12:09:54.709996 13185 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.004s
I20260709 12:09:54.718298 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.718811 13154 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:54.723834 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.703076 13129 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.762279 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:54.909497 13154 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:54.910526 11939 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:54.787048 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:09:54.912662 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 146237us
I20260709 12:09:54.765290 12022 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.715965 13173 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:54.933665 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:54.762373 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:54.819605 13120 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.935379 13154 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:54.908631 13236 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:09:54.941192 11943 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:54.913522 13149 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.821408 13197 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.945581 13101 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:54.933734 13206 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.119s	user 0.005s	sys 0.001s
I20260709 12:09:54.927445 13097 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.913712 13227 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.716301 13226 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:54.768846 13185 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.724761 13205 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.948884 13106 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:54.958640 13149 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.738361 13139 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:54.940734 13219 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:55.028455 13234 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:09:55.013792 13077 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.046079 13219 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:54.937908 13173 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.025170 13231 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.057762 11948 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:55.058525 13077 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.058881 13149 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.060138 13205 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.060885 13077 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.062036 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1077) took 1935 ms. Trace:
I20260709 12:09:55.062533 11947 rpcz_store.cc:276] 0709 12:09:53.126439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.127394 (+   955us) service_pool.cc:224] Handling call
0709 12:09:53.127718 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:53.137719 (+ 10001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.137746 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:53.148960 (+ 11214us) log.cc:844] Serialized 26 byte log entry
0709 12:09:53.547283 (+398323us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.547338 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.547436 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:54.910845 (+1363409us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:09:55.061588 (+150743us) raft_consensus.cc:1685] finished
0709 12:09:55.061622 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.061913 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17169,"raft.queue_time_us":27309,"raft.run_cpu_time_us":10779,"raft.run_wall_time_us":102493,"spinlock_wait_cycles":51633408,"thread_start_us":190237,"threads_started":1,"wal-append.queue_time_us":553524}
I20260709 12:09:55.066296 13150 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.058740 13185 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.087702 13155 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:55.093220 13139 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.099561 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:55.100441 13073 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.104616 13135 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.107354 13173 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.112393 13129 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:55.170109 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.172137 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1268) took 1043 ms. Trace:
I20260709 12:09:55.182998 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.182812 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.184593 11943 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:55.185206 11946 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:55.182688 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.194711 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.195860 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:55.173023 11872 rpcz_store.cc:276] 0709 12:09:54.128000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.128145 (+   145us) service_pool.cc:224] Handling call
0709 12:09:54.155171 (+ 27026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.190559 (+ 35388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.171028 (+980469us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b5400094cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:09:55.171701 (+   673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79978368}
W20260709 12:09:55.202565 11864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1260) took 2118 ms (client timeout 2011 ms). Trace:
I20260709 12:09:55.203919 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:55.206121 13129 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.246589 13139 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:55.246841 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:55.244649 11864 rpcz_store.cc:269] 0709 12:09:53.084022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.084278 (+   256us) service_pool.cc:224] Handling call
0709 12:09:55.201916 (+2117638us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400400954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:09:55.202228 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877630080}
I20260709 12:09:55.251158 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:55.253360 13071 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.253793 13173 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.253705 13139 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.254433 13071 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.254848 13173 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.256587 13143 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:55.256620 13129 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.258294 12604 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:55.258538 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:55.260291 13129 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.267509 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1266) took 1143 ms. Trace:
I20260709 12:09:55.267823 12022 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:55.268391 13173 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.268110 11869 rpcz_store.cc:276] 0709 12:09:54.123995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.165734 (+ 41739us) service_pool.cc:224] Handling call
0709 12:09:55.267006 (+1101272us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003552d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:09:55.267291 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135770880}
W20260709 12:09:55.284718 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 65877.3us
I20260709 12:09:55.260903 13143 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.275274 13083 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.303501 13071 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:55.313019 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.313328 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 48549.6us
I20260709 12:09:55.313663 13083 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.278082 13073 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:55.338778 11839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.008s	sys 0.014s
W20260709 12:09:55.339313 11839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.008s	sys 0.014s
I20260709 12:09:55.288887 13149 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.269070 11770 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:55.350209 11838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.005s	sys 0.016s
W20260709 12:09:55.350888 12019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.010s	sys 0.013s
I20260709 12:09:55.351282 12016 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:55.359388 11837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.016s	sys 0.037s
W20260709 12:09:55.360002 11837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.016s	sys 0.037s
I20260709 12:09:55.360263 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.378278 13154 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.379168 13154 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.379817 13154 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:55.350432 12575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.026s	sys 0.083s
W20260709 12:09:55.381968 12575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.026s	sys 0.083s
W20260709 12:09:55.379168 12019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.013s
W20260709 12:09:55.379257 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.005s	sys 0.016s
I20260709 12:09:55.350293 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:55.354359 11836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.044s	sys 0.109s
I20260709 12:09:55.397979 11770 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:55.398073 13221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.005s	sys 0.024s
W20260709 12:09:55.414345 13221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.005s	sys 0.024s
I20260709 12:09:55.416241 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.417352 11867 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
W20260709 12:09:55.408645 12015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.000s	sys 0.022s
I20260709 12:09:55.418503 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:55.419312 12015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.022s
I20260709 12:09:55.421303 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.422044 13073 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.422960 11864 raft_consensus.cc:2410] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:55.398813 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 84399.2us
I20260709 12:09:55.426573 13150 raft_consensus.cc:1064] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:55.426968 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:55.428193 12606 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:09:55.429708 13218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.026s	sys 0.039s
W20260709 12:09:55.430328 13218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.026s	sys 0.039s
I20260709 12:09:55.422281 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:09:55.361938 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72437us
W20260709 12:09:55.442114 11836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.045s	sys 0.109s
I20260709 12:09:55.426996 11912 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:09:55.412209 11914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.003s	sys 0.014s
I20260709 12:09:55.430541 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.425287 13073 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:55.464506 11914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.004s	sys 0.014s
I20260709 12:09:55.430454 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.452215 13143 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.430733 13218 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:55.425407 13149 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:55.514933 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 88161.1us
W20260709 12:09:55.502526 12014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.012s	sys 0.024s
I20260709 12:09:55.538097 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:55.497203 13100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.032s	sys 0.041s
W20260709 12:09:55.499562 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 979310us
I20260709 12:09:55.502666 13083 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.514649 13174 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:09:55.548141 12014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.015s	sys 0.028s
I20260709 12:09:55.567680 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:55.569942 13225 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.570890 13225 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.572652 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:55.573613 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71754us
I20260709 12:09:55.573843 13143 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.574200 13225 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.574646 13143 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.575426 13143 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.565029 13174 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.548826 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.520345 13080 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:55.515204 13073 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.518639 13082 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.520866 13176 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.521346 13243 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.586194 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:55.589753 13080 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.588721 13073 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.591028 13073 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.520219 13248 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:55.521497 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:55.521992 13247 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:55.515142 13158 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.595723 13080 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.575400 13225 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:55.595958 13158 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:09:55.596634 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 75391.5us
I20260709 12:09:55.563864 13242 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.596971 13225 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.597947 13242 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.597869 13176 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.599306 13225 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.599637 13136 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.600262 13136 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.600658 13242 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.556725 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:55.602020 13080 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.601841 13082 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.602579 13080 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.595970 13149 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.603286 13080 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.588677 13174 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.604749 13082 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.604787 13158 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:55.605969 13248 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:55.602545 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46111.9us
I20260709 12:09:55.582635 13150 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:09:55.586328 13100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.032s	sys 0.045s
I20260709 12:09:55.551067 13218 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.594779 13247 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.578413 13214 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.600713 13136 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.589937 13243 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.610075 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:09:55.512830 11868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.049s	sys 0.080s
I20260709 12:09:55.547195 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.577495 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:55.614277 11872 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:55.608945 13248 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.601279 13176 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:09:55.627446 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.631721 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54417.9us
W20260709 12:09:55.626331 11868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.049s	sys 0.088s
I20260709 12:09:55.640547 11867 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:55.646529 13241 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.647207 13139 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:55.632779 13149 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.648279 13149 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.653407 13135 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.653703 13123 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.654335 13135 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.654821 13123 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.657292 13135 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:55.657910 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.659192 13083 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.659644 13083 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.660007 13083 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.664170 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:55.664995 12013 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:09:55.642285 13242 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.668609 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:55.675971 13139 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.676712 13139 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.670462 13242 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.642040 13214 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.687924 13080 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:55.688519 13242 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:55.712399 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 102507us
I20260709 12:09:55.681027 13154 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:09:55.716320 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.043s	sys 0.061s
I20260709 12:09:55.716511 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:09:55.717051 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.043s	sys 0.061s
W20260709 12:09:55.717600 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 776388us
I20260709 12:09:55.719360 13149 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.720228 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:55.722254 13139 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.723246 13237 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.723838 13237 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.724327 13237 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.724732 13208 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.726048 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1114) took 1081 ms. Trace:
I20260709 12:09:55.725840 13208 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:55.726581 12015 rpcz_store.cc:276] 0709 12:09:54.645437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.645590 (+   153us) service_pool.cc:224] Handling call
0709 12:09:54.645984 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.646458 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.646500 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.650149 (+  3649us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.420152 (+770003us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:55.420269 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.420415 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.725632 (+305217us) raft_consensus.cc:1685] finished
0709 12:09:55.725659 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.725941 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1208,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":1318,"thread_start_us":762202,"threads_started":1,"wal-append.queue_time_us":1064384}
I20260709 12:09:55.731904 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1116) took 1064 ms. Trace:
I20260709 12:09:55.732328 12014 rpcz_store.cc:276] 0709 12:09:54.667487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.667710 (+   223us) service_pool.cc:224] Handling call
0709 12:09:54.668072 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.671550 (+  3478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.671597 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.672167 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.567029 (+894862us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:55.567169 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.567337 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.731596 (+164259us) raft_consensus.cc:1685] finished
0709 12:09:55.731614 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.731818 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3024,"raft.queue_time_us":5063,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":894071,"threads_started":1,"wal-append.queue_time_us":1008055}
I20260709 12:09:55.733578 13143 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.742228 13214 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.736371 13243 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.711542 13241 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.744658 13241 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.747331 13241 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.741768 13080 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.750309 13143 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.751298 13247 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.752879 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:55.753648 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:55.753770 13154 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:55.756187 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.761097 11943 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:55.761566 12610 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:55.756485 13065 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:55.758052 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.759853 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:55.767076 12014 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:55.767259 11939 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.769026 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:55.819363 13143 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.819978 13143 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:55.820446 13143 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.768710 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:09:55.827513 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57906.5us
W20260709 12:09:55.829689 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60770us
I20260709 12:09:55.830798 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:55.768975 13065 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.831540 13241 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.943773 13241 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:55.944314 13241 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.843542 13143 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.951802 13143 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.859907 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1115) took 1207 ms. Trace:
I20260709 12:09:55.860594 11939 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:55.953619 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:55.954517 12014 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:55.893307 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 63206.9us
I20260709 12:09:55.774647 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:55.785686 13123 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:55.729372 13208 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:55.932546 13073 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:55.952690 12019 rpcz_store.cc:276] 0709 12:09:54.653560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.664906 (+ 11346us) service_pool.cc:224] Handling call
0709 12:09:54.665317 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.669653 (+  4336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.669686 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.670347 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.409319 (+738972us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:55.409419 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.409574 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.859677 (+450103us) raft_consensus.cc:1685] finished
0709 12:09:55.859699 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.859835 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2997,"raft.queue_time_us":7359,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"thread_start_us":727546,"threads_started":1,"wal-append.queue_time_us":1013754}
W20260709 12:09:55.968156 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 369102us
I20260709 12:09:55.969643 11946 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:55.965179 12014 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:56.002363 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:55.917562 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:56.012156 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:56.014004 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.019807 13242 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.007351 13065 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:56.030957 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.010599 13143 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:56.024376 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 106971us
I20260709 12:09:56.019753 13154 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.022903 13073 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:56.025087 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.019021 13083 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.083513 13239 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.084197 13239 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.084823 13237 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.085371 13255 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:56.089007 13255 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.089501 13255 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.088536 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.087105 12610 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:56.082610 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:56.069198 13243 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.102047 13225 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.102210 13243 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.102866 13225 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.104725 13243 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.106074 13250 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.106842 13250 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.107535 13225 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.101176 13170 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:56.069527 13143 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:56.074383 13154 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:56.072208 13248 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:09:56.116961 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45410.8us
W20260709 12:09:56.121096 11947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.047s	sys 0.093s
I20260709 12:09:56.121271 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.124727 13239 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.125406 13248 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.126837 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.127689 13248 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.128350 13248 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.130065 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.130899 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.131079 11867 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:56.113440 13170 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.135426 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.138581 13149 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:56.139144 13149 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:56.139550 11947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.048s	sys 0.094s
I20260709 12:09:56.139636 13149 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:56.139304 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.060s	sys 0.079s
I20260709 12:09:56.140388 13242 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.141312 13154 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.142854 13243 raft_consensus.cc:1064] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:09:56.143535 13243 raft_consensus.cc:1068] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:56.148662 13237 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.138823 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.158631 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.159525 11869 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:56.160068 13170 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:09:56.140434 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.061s	sys 0.079s
I20260709 12:09:56.162083 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.162994 11872 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:56.163380 11988 leader_election.cc:400] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:56.163739 11988 leader_election.cc:403] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:56.165329 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.167065 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.168464 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.169122 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.169981 11873 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.171110 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:56.172730 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.173491 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 55409.8us
I20260709 12:09:56.121731 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.135607 13143 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.180154 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.181682 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.128993 13248 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:56.116050 13250 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:56.152772 13136 consensus_meta.cc:287] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.004s
I20260709 12:09:56.198330 13209 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.199939 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.201735 13266 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:09:56.202718 11866 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:56.196982 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.204396 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.227077 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.205440 13065 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:56.209161 13135 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.209471 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 38) took 1969 ms. Trace:
I20260709 12:09:56.216847 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 39) took 1988 ms. Trace:
I20260709 12:09:56.218691 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.205233 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.227958 11871 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.241264 11872 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.243842 11869 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.244477 13149 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.236860 13123 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:56.253893 13123 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:56.254958 13123 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.256299 13123 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.257718 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:09:56.258828 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.259575 11872 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.259634 11768 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.259050 12609 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:56.265133 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.265981 11939 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.266345 13248 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.267326 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.267783 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.267339 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.268013 11946 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:56.268612 11941 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.269484 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 111) took 3388 ms. Trace:
I20260709 12:09:56.274799 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.275609 11864 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.187629 13241 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.245406 13065 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.267877 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.278412 11768 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.282207 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.285044 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.287623 13170 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.288445 11942 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.289521 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.290114 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.295511 13241 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.296139 12604 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:56.296461 13083 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.257665 13209 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.299299 11866 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:56.301151 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.233639 13136 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.304260 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.304354 12609 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.308475 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:56.310992 11940 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.311968 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.312537 13210 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.270012 11770 rpcz_store.cc:276] 0709 12:09:52.880954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.930041 (+ 49087us) service_pool.cc:224] Handling call
0709 12:09:56.269331 (+3339290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:55.970580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:55.971266 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:55.971318 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:09:55.971352 (+    34us) tablet.cc:662] Decoding operations
0709 12:09:55.971857 (+   505us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:55.971967 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:55.971991 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:55.972531 (+   540us) tablet.cc:701] Row locks acquired
0709 12:09:55.972591 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:09:55.972786 (+   195us) write_op.cc:270] Start()
0709 12:09:55.972952 (+   166us) write_op.cc:276] Timestamp: P: 1783598995972705 usec, L: 0
0709 12:09:55.972973 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:09:56.104827 (+131854us) log.cc:844] Serialized 918 byte log entry
0709 12:09:56.107222 (+  2395us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2ee28 00007f1f1f469581 00007f1f1f468d58 00007f1f1f46d9f1 00007f1f1f46d9a9 00007f1f1f46d939 00007f1f1f46d901 00007f1f1f46cb2d 0000000000388634 0000000000388479
0709 12:09:56.162030 (+ 54808us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.194671 (+ 32641us) write_op.cc:301] APPLY: starting
0709 12:09:56.206695 (+ 12024us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.206871 (+   176us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.206904 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.207467 (+   563us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.207711 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:56.207780 (+    69us) write_op.cc:312] APPLY: finished
0709 12:09:56.208081 (+   301us) log.cc:844] Serialized 28 byte log entry
0709 12:09:56.208300 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.208401 (+   101us) write_op.cc:454] Released schema lock
0709 12:09:56.208459 (+    58us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":10204,"apply.run_cpu_time_us":2327,"apply.run_wall_time_us":18601,"num_ops":2,"prepare.queue_time_us":407303,"prepare.run_cpu_time_us":6946,"prepare.run_wall_time_us":136880,"replication_time_us":146093,"spinlock_wait_cycles":280231296,"thread_start_us":404155,"threads_started":2}]]}
I20260709 12:09:56.301430 13248 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.349790 13265 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:56.350380 13265 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:56.350761 13265 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.352718 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.350605 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:56.352687 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.354319 11942 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.354732 12610 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.363540 12607 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.352803 11768 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.370812 11867 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:56.305117 13170 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:56.374656 13154 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:56.371515 11948 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:56.378546 11871 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.390861 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:56.373719 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.867s (SENT) [suppressed 4 similar messages]
I20260709 12:09:56.393985 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.346180 11944 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:56.364450 13209 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.402333 12016 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.398801 13154 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:56.409061 11946 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.361500 13210 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.412580 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.419016 11873 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:56.419230 12015 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.421398 12014 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.412225 13154 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.423964 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.424778 12016 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.425762 11941 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:56.429940 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.235005 11868 rpcz_store.cc:276] 0709 12:09:54.206124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.215944 (+  9820us) service_pool.cc:224] Handling call
0709 12:09:54.279680 (+ 63736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:55.682624 (+1402944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.688150 (+  5526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:55.734083 (+ 45933us) log.cc:844] Serialized 26 byte log entry
0709 12:09:56.068211 (+334128us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:56.071289 (+  3078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.100982 (+ 29693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:56.112638 (+ 11656us) raft_consensus.cc:1685] finished
0709 12:09:56.112652 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.175033 (+ 62381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2365,"raft.queue_time_us":78125,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":41216,"thread_start_us":1618255,"threads_started":2,"wal-append.queue_time_us":366874}
I20260709 12:09:56.430797 11872 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.431576 13143 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.432196 13154 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.432377 13143 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.394472 13276 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.424131 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.392174 13248 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.408689 13149 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.476661 11869 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.476538 13276 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.477664 12018 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.479014 12016 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:09:56.409003 13277 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.482399 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.402021 13250 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:09:56.490191 11864 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.494311 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:09:56.510318 12610 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:56.511648 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.521184 11941 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:56.522089 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:56.523157 12607 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.493949 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.525091 13277 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.542848 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.524204 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.540828 11868 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.518357 13083 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:09:56.541716 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.542006 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.518960 13149 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:56.544549 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 170800us
I20260709 12:09:56.555514 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.556470 11941 raft_consensus.cc:2368] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:56.552611 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.531731 13242 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:56.566365 12019 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:56.568279 11942 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:56.571154 12015 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:09:56.532438 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.536507 13143 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.507411 13255 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.595168 12018 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.603216 12021 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.544548 13208 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.542038 13100 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:56.642412 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50279.9us
I20260709 12:09:56.600589 12014 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.637418 12021 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.604454 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.552173 13123 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:56.606614 13282 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:56.607800 13280 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:09:56.609699 13277 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.609676 13136 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:56.614622 13210 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.615249 11948 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:56.615725 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.617363 13149 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:56.619455 13276 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.621273 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.615172 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.622151 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.623214 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.237673 11870 rpcz_store.cc:276] 0709 12:09:54.206525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.215983 (+  9458us) service_pool.cc:224] Handling call
0709 12:09:55.166299 (+950316us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800002798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890ef8c 00007f1f1890eef6 000000000036eb39 00007f1f209821e0 00007f1f20a4b0c4 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:09:55.166899 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.167705 (+   806us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:09:55.470389 (+302684us) log.cc:844] Serialized 14 byte log entry
0709 12:09:56.161165 (+690776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:56.161242 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:56.161311 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.161409 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.194692 (+ 33283us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":469075,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":13451,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"spinlock_wait_cycles":4504192,"thread_start_us":943057,"threads_started":2,"wal-append.queue_time_us":647870}
I20260709 12:09:56.613204 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 188) took 3738 ms. Trace:
I20260709 12:09:56.621968 13218 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:09:56.669884 13150 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:09:56.680210 12018 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.681188 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.682348 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.682925 12018 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.683722 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.684909 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.630936 13154 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.593321 13083 consensus_queue.cc:1243] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:09:56.636040 13135 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:56.636914 12605 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.599819 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.527798 13250 consensus_queue.cc:1243] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:09:56.647766 12013 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:09:56.651067 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 138159us
I20260709 12:09:56.697512 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.674649 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:56.652514 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 102611us
I20260709 12:09:56.659991 13265 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.664179 12020 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:56.527323 13170 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.601155 13242 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:56.703303 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:56.675015 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.676756 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.678592 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.704684 11942 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:56.688647 11866 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.694514 11868 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.694954 13218 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.679775 13209 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.711613 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.698318 11872 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.697961 12014 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.666525 13208 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.686386 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.726114 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.669255 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.704712 12021 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.727195 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:56.689720 11914 connection.cc:256] RPC call timeout handler was delayed by -1.0659359770002084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:09:56.676288 13282 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.728818 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.685411 13123 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:56.678021 11769 rpcz_store.cc:276] 0709 12:09:52.874561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.874736 (+   175us) service_pool.cc:224] Handling call
0709 12:09:56.612967 (+3738231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:53.857348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:53.906340 (+ 48992us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:53.906374 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:09:53.906392 (+    18us) tablet.cc:662] Decoding operations
0709 12:09:53.907114 (+   722us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:53.907177 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:53.907205 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:09:53.907610 (+   405us) tablet.cc:701] Row locks acquired
0709 12:09:53.907624 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:09:53.907831 (+   207us) write_op.cc:270] Start()
0709 12:09:53.907954 (+   123us) write_op.cc:276] Timestamp: P: 1783598993907764 usec, L: 0
0709 12:09:53.907982 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:09:53.948764 (+ 40782us) log.cc:844] Serialized 1700 byte log entry
0709 12:09:55.749851 (+1801087us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.164857 (+415006us) write_op.cc:301] APPLY: starting
0709 12:09:56.165065 (+   208us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.165311 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.165480 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.169373 (+  3893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.169690 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:09:56.169753 (+    63us) write_op.cc:312] APPLY: finished
0709 12:09:56.170107 (+   354us) log.cc:844] Serialized 40 byte log entry
0709 12:09:56.170313 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.170424 (+   111us) write_op.cc:454] Released schema lock
0709 12:09:56.170498 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:56.172047 (+  1549us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.172082 (+    35us) write_op.cc:454] Released schema lock
0709 12:09:56.345608 (+173526us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.347414 (+  1806us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":14080,"child_traces":[["op",{"apply.queue_time_us":414573,"apply.run_cpu_time_us":3059,"apply.run_wall_time_us":7185,"num_ops":4,"prepare.queue_time_us":682088,"prepare.run_cpu_time_us":21382,"prepare.run_wall_time_us":348977,"raft.queue_time_us":1064345,"raft.run_cpu_time_us":51998,"raft.run_wall_time_us":651272,"replication_time_us":1806209,"spinlock_wait_cycles":178432,"thread_start_us":1473899,"threads_started":4,"wal-append.queue_time_us":254308}]]}
I20260709 12:09:56.703923 13285 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.709937 13170 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.734061 12019 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:56.735061 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.735872 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.736159 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.736696 12017 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:56.736765 12019 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.697925 13083 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:56.737804 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.737886 13083 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.738931 13208 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.740739 12016 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:56.673460 13100 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.742971 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.743220 13100 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.710016 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.728787 12013 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.752612 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.710475 12610 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.711257 11948 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.732429 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.711997 13255 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.757164 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.757513 12014 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.729910 13073 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.758488 13136 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.759320 13266 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.706616 11869 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.718266 13248 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.762845 11870 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.763137 13243 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.763645 13243 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:56.750381 13285 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.764634 13243 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.766131 13285 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:56.767043 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.767573 13281 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:56.768266 13281 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.769923 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.770021 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.771008 13208 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.771570 13208 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.773500 13281 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:56.738447 11872 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:56.773813 13208 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.773880 12604 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.769220 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 219) took 2560 ms. Trace:
I20260709 12:09:56.777954 12017 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.779028 13123 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:56.779222 13282 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:56.706578 13218 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:56.780136 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.780918 12016 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:56.685473 12018 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.758805 13073 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:56.712132 13241 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.710426 13275 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.745203 13149 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.798363 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.804167 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.753336 13083 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:56.812248 12015 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:56.812402 12021 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:56.816334 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.817095 12018 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:56.767584 13265 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:56.821602 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61661.8us
I20260709 12:09:56.710188 13242 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.826412 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.825429 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.780570 13218 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.830444 12020 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:56.819296 13243 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.840794 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:56.846125 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.846174 13208 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:56.847337 13208 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.820297 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.777240 11768 rpcz_store.cc:276] 0709 12:09:54.209057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.209261 (+   204us) service_pool.cc:224] Handling call
0709 12:09:56.769036 (+2559775us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:56.508398 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:56.637417 (+129019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:56.637468 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:09:56.637494 (+    26us) tablet.cc:662] Decoding operations
0709 12:09:56.638247 (+   753us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:56.638324 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:56.638363 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:56.638781 (+   418us) tablet.cc:701] Row locks acquired
0709 12:09:56.638806 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:09:56.639005 (+   199us) write_op.cc:270] Start()
0709 12:09:56.639135 (+   130us) write_op.cc:276] Timestamp: P: 1783598996638942 usec, L: 0
0709 12:09:56.639163 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:09:56.639977 (+   814us) log.cc:844] Serialized 1374 byte log entry
0709 12:09:56.642299 (+  2322us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.642797 (+   498us) write_op.cc:301] APPLY: starting
0709 12:09:56.642871 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.643007 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.675063 (+ 32056us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.761777 (+ 86714us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.761991 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:56.762043 (+    52us) write_op.cc:312] APPLY: finished
0709 12:09:56.762270 (+   227us) log.cc:844] Serialized 34 byte log entry
0709 12:09:56.762473 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.762589 (+   116us) write_op.cc:454] Released schema lock
0709 12:09:56.762645 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:56.763082 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.763114 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5638,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":259,"apply.run_cpu_time_us":3258,"apply.run_wall_time_us":120228,"num_ops":3,"prepare.queue_time_us":10264,"prepare.run_cpu_time_us":4200,"prepare.run_wall_time_us":154715,"replication_time_us":2987}]]}
I20260709 12:09:56.864295 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.864840 12019 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.865177 11943 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:56.868009 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.870230 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:56.871078 12020 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:56.877595 11948 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.881062 11948 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:56.880813 13073 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.881249 11939 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.882189 11948 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.882124 13073 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.856241 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.892256 11944 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
W20260709 12:09:56.895190 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.899742 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.884809 13218 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:56.911868 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 128366us
I20260709 12:09:56.820727 13275 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:56.918520 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:56.899521 11948 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.921175 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:56.927464 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.908938 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.930622 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:56.931459 13275 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:56.931855 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:56.932271 12018 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.907223 13241 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:56.941681 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:09:56.942976 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.944065 12015 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:56.948642 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.951773 13136 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.953770 12021 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.955171 11943 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:56.955544 13250 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:56.948990 13291 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:09:56.956750 13250 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.957149 13250 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:56.946622 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:56.958508 11943 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.959178 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.959656 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.959861 11940 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:56.960772 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.938608 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.965245 13266 raft_consensus.cc:1064] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:56.965703 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.966161 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.966460 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.981065 12017 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:56.966163 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.984162 12018 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:56.984833 12014 raft_consensus.cc:2368] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:56.982270 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.989880 13143 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:56.990129 13083 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.990453 13143 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:56.991633 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.991423 13143 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.992991 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.995555 11942 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:56.988766 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47236.5us
I20260709 12:09:56.997031 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:56.997939 13300 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.997699 13250 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:56.999934 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:56.987679 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.991787 13083 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.000574 11940 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:56.984261 12019 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:57.006897 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:56.920827 13214 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:09:56.965749 13266 raft_consensus.cc:1068] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:57.018187 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.010988 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:57.024085 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.024823 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:57.025120 11946 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:57.033030 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.034088 11941 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:57.034978 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.036087 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.036638 11941 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:57.039819 13214 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.028152 13174 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:57.040309 13214 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.040768 13214 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:57.041806 13298 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:09:57.044351 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.037403 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.047187 11941 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:09:57.047330 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.048355 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:57.045457 11947 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:57.050952 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.051950 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.054118 12021 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.004907 13083 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:57.059324 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:57.019806 13250 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.061321 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.061998 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:57.065343 11941 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:57.058332 11948 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:57.076575 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.078949 13083 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.080070 13083 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.058526 13265 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.087263 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.092904 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:57.118251 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.131194 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.132423 11872 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:57.133870 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.133994 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.134747 11868 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:57.092514 13242 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.135545 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.136725 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.138234 11946 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.139420 12607 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.139271 11941 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:09:57.151671 11867 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:57.144279 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.153934 11868 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:09:57.154160 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:57.155543 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 85904.3us
W20260709 12:09:57.155900 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.155681 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:57.156517 11939 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.157004 11914 leader_election.cc:400] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:57.157353 11914 leader_election.cc:403] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:09:57.161099 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.162388 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.162662 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:57.163203 11872 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:57.178694 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:09:57.140122 13299 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:09:57.179702 12018 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:57.188963 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.193933 12020 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.193641 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.196979 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:57.197672 12014 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:57.136284 11869 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:57.201920 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:57.202788 12017 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:57.084271 13241 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:09:57.213853 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57033.9us
I20260709 12:09:57.214931 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.200776 13285 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:57.206171 11870 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.222460 13073 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.203553 13214 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.232709 13300 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.232788 11939 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:57.234145 13073 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.261878 13073 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.257230 13210 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.258076 13294 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:57.260434 13303 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:09:57.269963 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 69876.4us
I20260709 12:09:57.271812 13310 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:09:57.271864 13295 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.272547 13310 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.272662 13295 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.275003 13310 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:57.280882 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:57.253985 13136 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.295557 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:57.302410 13214 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.303282 13208 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.275254 13295 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:57.291560 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:57.291595 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:57.290478 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.316741 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:57.323057 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.327648 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:57.329627 13293 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.330248 13293 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.327630 13302 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.330745 13293 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.315851 13214 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.327556 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:57.339097 12607 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.319693 13285 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:57.323657 13208 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.312461 13136 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.349026 11869 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.320736 13303 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:09:57.351961 13208 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:57.372205 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.395052 13136 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.397738 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:57.397828 11943 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:57.398797 13285 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:57.400671 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:57.392733 13073 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.382099 13208 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.414414 11869 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:57.406081 13285 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.423895 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:57.431758 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:57.386415 13154 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:09:57.354764 13248 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:09:57.420547 13285 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.464716 13303 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.476086 12020 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:57.470575 13275 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.473071 13285 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.485194 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:57.492859 11871 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:57.502966 13136 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.503582 13136 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:09:57.503923 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.504593 13136 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.506901 13073 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:57.513763 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:57.550201 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 230893us
W20260709 12:09:57.554744 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:57.572495 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 63068us
I20260709 12:09:57.570815 13275 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.583788 13303 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:57.611560 11940 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:09:57.584462 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 116814us
I20260709 12:09:57.618781 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.567795 13316 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:09:57.593918 13275 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.593492 13136 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.577401 13154 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:09:57.623835 13319 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:09:57.635555 13325 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:09:57.642462 13322 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:09:57.611399 13293 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.632856 13275 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:57.668361 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 117002us
I20260709 12:09:57.692477 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.672192 13320 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:57.714979 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.734848 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.714496 13320 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:57.715832 13073 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.757934 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.759341 12020 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:57.762458 13301 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.771660 13275 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.774497 13275 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:57.775272 13285 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:09:57.783782 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45008.2us
I20260709 12:09:57.742954 13218 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.743476 13073 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.743335 13320 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.716351 13303 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.795416 13073 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.787201 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.788506 13210 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.788944 13218 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.813297 13083 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.813977 13083 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:57.817211 13210 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:57.818392 13210 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:57.819114 13309 raft_consensus.cc:1064] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:09:57.822243 13309 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:57.811106 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.827814 13294 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.828421 13294 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.828896 13294 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.834403 13293 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.785338 13208 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.811264 13218 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.814949 13083 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.856585 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.861377 11869 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.868906 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:57.879330 13208 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.865669 13285 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:57.865206 13320 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.899423 13293 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.906363 13293 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:57.906808 13293 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:57.913082 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.921039 11939 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.921365 13316 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.895315 13218 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:57.929834 13218 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:57.931542 13328 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:57.935096 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.991715 13342 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.887789 13320 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.008970 12609 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 2 LEARNER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:09:58.010376 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 141592us
I20260709 12:09:58.014901 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:58.016625 13208 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.016821 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.017122 13208 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.017609 13208 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.018668 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:58.020903 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 402812us
I20260709 12:09:58.023795 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:58.013813 13342 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:58.027709 13342 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.029752 13210 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.030297 13210 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:58.037268 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.030673 13210 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.037909 13329 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.044265 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:58.046941 13329 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.056233 13329 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.064391 13275 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.043192 13320 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:58.070650 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52051.6us
I20260709 12:09:58.054910 13136 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:09:58.078317 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:58.079355 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.080775 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:58.081501 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.064944 13275 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.085273 13275 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:58.146154 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.148976 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.144944 13348 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.157843 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:58.161002 13348 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:58.151276 13073 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.178596 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.179301 11864 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.181210 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.181816 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.181833 12018 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:58.161135 13083 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.204439 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.207482 11871 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:58.187290 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.210278 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.271942 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.185400 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:58.299464 13350 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.052s	user 0.007s	sys 0.003s
I20260709 12:09:58.183604 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.209489 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:09:58.231207 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 68816.8us
W20260709 12:09:58.316072 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.316290 12016 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:58.197734 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 133085us
I20260709 12:09:58.290036 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.155290 13250 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.296754 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.297052 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.297649 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:58.298105 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.319092 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:58.320778 11867 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:09:58.206570 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.175594 13348 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.296957 11768 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.323470 11768 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.210649 13073 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.231658 13309 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:58.301501 13340 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.148s	user 0.004s	sys 0.000s
I20260709 12:09:58.312794 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.355298 12014 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:58.359004 13351 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:09:58.307116 13347 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.122s	user 0.004s	sys 0.000s
I20260709 12:09:58.209861 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:58.325405 11768 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.379153 11768 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 3 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.329846 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:58.330570 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:58.382344 12013 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.331943 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:58.332939 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:58.218212 13294 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.273402 13083 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:58.326516 13349 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:09:58.399718 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.400492 11865 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.396319 11768 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:58.422634 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.208509 12021 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:58.370046 13351 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.376950 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.383702 12016 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.385126 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:09:58.426815 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62266.4us
I20260709 12:09:58.426707 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.435258 11867 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.434140 11864 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.442546 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.324715 13293 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.328884 13250 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.436918 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.453109 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:58.471204 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.472671 13294 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.468001 13331 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:58.474442 13331 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.397886 12017 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.398975 13083 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.359606 13309 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:58.514463 13293 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:58.579756 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.599946 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:58.601032 11943 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:58.614336 11940 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:58.618497 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.618222 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 165175us
W20260709 12:09:58.623644 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 314673us
I20260709 12:09:58.628015 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.634244 11945 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.634920 13250 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.635740 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.636704 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.637471 11941 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:58.638585 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.616055 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:58.639519 11940 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:58.673807 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:58.695004 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.702948 13331 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:58.634320 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:58.710055 12020 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.723881 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.724813 11947 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:58.714811 12020 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:58.731132 13214 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:58.704969 11939 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.734452 11948 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.734277 12020 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:58.735699 12020 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.707381 13351 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:58.745172 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 128371us
I20260709 12:09:58.745302 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.746502 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:09:58.747989 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 121623us
I20260709 12:09:58.749583 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:58.750027 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:58.751819 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:58.736563 13309 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:58.752059 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:58.750494 13136 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.752425 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:58.769671 11947 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:58.768946 13136 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:09:58.770959 13329 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.017s
I20260709 12:09:58.771050 13136 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.771575 13329 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.776573 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:09:58.778928 13210 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.025s
I20260709 12:09:58.779480 13210 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.780826 13136 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.734334 13214 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:58.783188 13136 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:09:58.783793 13275 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.012s
I20260709 12:09:58.783983 13214 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.785401 11947 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:58.786482 11867 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.787528 12016 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.786556 12013 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.791417 12020 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.792810 12019 raft_consensus.cc:2368] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:58.750448 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.750144 13358 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.784373 13275 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.798086 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.767014 13363 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.767323 13285 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.808926 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:58.810619 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.813552 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.816855 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:58.817507 12609 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:58.801805 13366 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:09:58.801385 13358 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:58.826253 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:58.822679 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.821171 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:58.806891 11944 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:09:58.805373 13363 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:58.830941 13363 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.812536 13353 raft_consensus.cc:2764] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:09:58.809893 11868 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
W20260709 12:09:58.834631 13208 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.024s
I20260709 12:09:58.812261 13237 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:09:58.835120 13208 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.837219 13208 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.812404 13342 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.839330 13348 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.021s
I20260709 12:09:58.841926 13250 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.815210 13294 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.844969 11939 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:58.850035 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:58.852468 11865 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.861755 13293 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.863243 13285 raft_consensus.cc:2764] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:09:58.819634 13210 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:58.865128 11868 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.890199 13351 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.869078 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 55623.4us
I20260709 12:09:58.870834 13275 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:58.815054 13329 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:58.896317 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:58.882582 11947 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:58.896776 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:58.897308 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 76230.2us
W20260709 12:09:58.892091 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 75310.8us
I20260709 12:09:58.884366 13366 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.853121 13358 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.916514 11867 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:09:58.884585 13356 raft_consensus.cc:2764] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:09:58.884774 13294 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:58.923691 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.883368 12017 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:58.904309 13366 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:58.944317 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.882604 13348 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.932021 13294 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.926359 13208 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.909777 13210 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:09:58.930436 13329 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.967011 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:58.877025 13363 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.968952 13353 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:58.969604 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46010.9us
I20260709 12:09:58.952715 13250 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:58.978394 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.980121 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85748.5us
I20260709 12:09:58.982235 11948 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:58.964984 13208 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:58.990793 11839 leader_election.cc:400] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:58.991818 11839 leader_election.cc:403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:58.988225 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.992022 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.990851 13366 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:58.994298 13366 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.994599 13363 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.000666 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:58.981143 13353 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:58.986791 13250 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.001652 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:58.989310 13073 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.008582 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:59.010479 11988 leader_election.cc:400] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:59.006047 13208 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:59.012172 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.006543 13351 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.991564 13329 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.014748 12609 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:59.002645 13293 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.001086 13362 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.018381 11865 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.006837 13353 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.015169 11988 leader_election.cc:403] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:59.021078 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:59.022694 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:58.983292 13083 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.020370 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.004446 13363 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.016005 13309 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.028576 11865 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.007066 11870 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:09:59.031309 13342 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.033377 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.018690 13351 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.023989 13293 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.037783 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.038410 11865 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.033303 13367 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.031517 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.038623 11943 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.039757 13293 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.030500 13208 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.029668 13363 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.030876 13309 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.038031 13351 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.032004 13329 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3.
I20260709 12:09:59.047259 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.045095 13320 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.060603 13348 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.048693 13331 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.066023 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.047127 13208 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.081717 13208 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.084326 13083 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.085228 13136 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.051365 13363 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.069912 13329 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.076275 13073 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.081004 13367 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.053102 13309 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.054215 13285 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.102754 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62101.2us
I20260709 12:09:59.058552 13320 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.111382 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:59.085865 13136 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.113178 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:59.114351 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48428.6us
I20260709 12:09:59.115180 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:59.117292 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.109985 13367 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.119134 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.113286 13379 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.112668 13320 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.118324 13342 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:09:59.133369 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.134436 13338 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.135128 13338 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.109716 13073 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.121323 13210 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.138800 13073 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.135656 13342 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:59.142690 13210 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.143257 13210 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.146083 13136 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:59.146324 13275 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:59.148227 13285 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.148644 13285 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:59.149580 13285 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.150417 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:59.150841 13285 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.137398 13338 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.151183 12609 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.155498 13331 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.118541 13329 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.162070 13329 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:09:59.162623 13329 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.155596 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.163707 13338 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.172281 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:59.169080 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.175779 13302 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.176179 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.176786 11870 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.178694 13214 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.179157 13214 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:09:59.179519 13214 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.190071 13250 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.213518 13250 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.193274 13214 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.201215 13378 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.230515 13214 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.194962 13353 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.222453 13210 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.202579 13338 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.203743 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.238477 11873 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.204871 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.239477 11866 raft_consensus.cc:2410] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:59.205799 13379 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:59.206367 13377 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.210961 13293 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.218186 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.219841 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.192786 13294 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.260005 13293 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.224274 13208 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.201439 11871 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.263710 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:09:59.264354 12609 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.227591 13329 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.230726 13378 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.198410 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.241444 13377 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:59.203089 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.242479 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.277278 11948 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.279086 11871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:09:59.280128 11871 raft_consensus.cc:606] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:59.280508 11871 raft_consensus.cc:614] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:59.282153 11869 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:09:59.286566 13377 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.290143 13378 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.245599 13338 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.295545 13338 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.246381 13367 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.248581 13320 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.298085 13320 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.249661 13353 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.240808 13358 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.300824 13358 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.300916 13355 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.250742 11873 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:59.250191 13309 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.301494 13355 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.302927 13367 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:59.303295 13309 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.303689 13355 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.251538 13362 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:59.252033 13351 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.253484 13210 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.304960 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:09:59.305732 13351 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.308143 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.308893 11864 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.312430 12611 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.255529 13363 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.319235 13363 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:09:59.239639 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71175.4us
I20260709 12:09:59.320307 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.257766 11870 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:09:59.268224 13208 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:59.323575 13353 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.324079 13353 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.324400 13294 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.324473 13353 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.322570 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.330436 11867 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:09:59.342271 12611 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:59.346776 11864 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
W20260709 12:09:59.347599 11839 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.583s (SENT)
I20260709 12:09:59.327627 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:59.364545 11839 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.583s (SENT)
I20260709 12:09:59.351738 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:09:59.354664 11870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:09:59.365011 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.365475 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.362881 12609 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:59.371148 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.377806 13285 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.378520 13285 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:59.380045 11870 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:09:59.383411 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.595s (SENT)
W20260709 12:09:59.402871 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.595s (SENT)
I20260709 12:09:59.404734 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:59.398686 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.358142 13338 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:59.416501 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 256821us
I20260709 12:09:59.380877 13294 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.401055 13355 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.381251 13275 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:09:59.426412 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 307304us
W20260709 12:09:59.420239 11839 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.667s (SENT)
I20260709 12:09:59.411877 13309 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.413698 13241 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.414296 13338 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.379592 13285 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:09:59.430864 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:09:59.430896 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48590us
I20260709 12:09:59.427990 13136 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:59.436261 11839 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.667s (SENT)
I20260709 12:09:59.442664 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.445041 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.447955 12016 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.450024 11914 leader_election.cc:400] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:59.450547 11914 leader_election.cc:403] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:59.451363 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.452131 12016 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.435396 13275 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:59.455044 13275 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.460286 13377 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.467471 13377 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:09:59.467730 11948 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:59.437418 13355 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:09:59.470786 13355 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.452359 13208 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.474138 13208 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:59.474359 13329 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.475291 13208 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.453644 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.434156 13294 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:59.491762 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.482538 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.492758 12016 raft_consensus.cc:2368] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:59.483610 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.492952 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.485873 12013 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:59.486979 12014 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.494642 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.494951 11942 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.495060 11945 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.493666 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.438519 13338 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.484305 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.495321 11948 raft_consensus.cc:2368] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:59.502210 12020 raft_consensus.cc:2376] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2. Re-sending same reply.
I20260709 12:09:59.499396 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.499447 11940 raft_consensus.cc:2393] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:09:59.499956 11946 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.502871 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.489439 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.435875 13363 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:09:59.507581 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.509862 13367 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.515877 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:09:59.516943 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 80844.1us
W20260709 12:09:59.519493 11839 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.867s (SENT)
I20260709 12:09:59.522681 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:09:59.520488 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.527200 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.529273 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.517640 11948 raft_consensus.cc:2368] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:59.530256 11940 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.511698 13377 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.438115 13241 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.538916 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.543686 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.544521 11940 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.545295 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.546267 11940 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.546888 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.547610 11948 raft_consensus.cc:2368] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
W20260709 12:09:59.548349 11839 leader_election.cc:336] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.869s (SENT)
I20260709 12:09:59.549521 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.513123 13385 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:09:59.534066 13136 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.559338 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.564344 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.549250 13302 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.541828 11939 raft_consensus.cc:2368] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:09:59.561167 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.567461 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.567376 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.570297 11942 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.570694 11940 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.571414 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:59.572343 11839 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.879s (SENT)
I20260709 12:09:59.569618 12014 raft_consensus.cc:2376] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3. Re-sending same reply.
I20260709 12:09:59.573155 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.573948 12019 raft_consensus.cc:2368] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:09:59.574090 12015 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:09:59.575506 11839 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.879s (SENT)
I20260709 12:09:59.575580 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.576400 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.559443 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.579420 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.580147 12014 raft_consensus.cc:2368] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:09:59.560127 13385 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.571524 13353 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.589198 12020 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.589313 13136 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.557626 13377 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:09:59.595212 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.596671 13302 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:09:59.596796 12013 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.605957 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:09:59.614660 11839 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.881s (SENT)
I20260709 12:09:59.622471 11943 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.606855 11946 raft_consensus.cc:2376] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3. Re-sending same reply.
I20260709 12:09:59.618494 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.619450 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.633810 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:09:59.635882 11839 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.881s (SENT)
I20260709 12:09:59.637728 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.638646 13136 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.630813 11941 raft_consensus.cc:2376] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2. Re-sending same reply.
I20260709 12:09:59.640507 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:59.641212 11839 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.889s (SENT)
I20260709 12:09:59.641952 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:09:59.646448 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.647209 12016 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.650416 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.651561 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.652562 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.597883 13302 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.653505 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.655444 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.656217 12019 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.657047 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.660445 12019 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.660497 13241 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.661616 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.562489 13294 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:09:59.639976 13378 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.664651 13378 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:09:59.665982 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.666592 12019 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.667428 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.668526 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.669451 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.669883 11944 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.670379 12019 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.671159 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.671877 12019 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.672639 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.673280 12019 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:59.674484 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.675827 12019 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.679351 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.680145 12019 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.685359 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:09:59.690687 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49497.3us
W20260709 12:09:59.691383 11839 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.889s (SENT)
I20260709 12:09:59.691787 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.685832 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.689862 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.687628 12013 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.698010 11947 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.678016 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.686358 12017 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
W20260709 12:09:59.700623 11839 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.941s (SENT)
W20260709 12:09:59.702912 11839 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.941s (SENT)
I20260709 12:09:59.703029 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.703388 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.701978 13375 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.712261 11939 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.712575 13389 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.712937 13389 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:09:59.713641 11944 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:59.713891 13389 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.714975 13389 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.685483 13377 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.723752 13353 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:09:59.727303 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.728061 11944 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:09:59.733223 13385 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:09:59.709108 13338 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:09:59.738241 12022 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:59.739044 11839 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.946s (SENT)
W20260709 12:09:59.742136 11839 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.946s (SENT)
I20260709 12:09:59.742728 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.745946 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.746621 12013 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.752024 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:09:59.754215 11939 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:59.761994 11839 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.969s (SENT)
W20260709 12:09:59.762692 11839 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.969s (SENT)
I20260709 12:09:59.763118 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.737465 13375 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.764797 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.768268 12014 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:09:59.765578 12018 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.757393 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.775604 13250 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.778983 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 112) took 1702 ms. Trace:
I20260709 12:09:59.783471 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.783850 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.772249 12013 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:09:59.785351 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.787376 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.782935 11769 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.792002 11943 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.792129 12609 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:09:59.792906 12609 pending_rounds.cc:85] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 2
I20260709 12:09:59.796110 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.789057 11769 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.766305 13362 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.790711 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.800716 11942 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.802640 11948 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.779469 11768 rpcz_store.cc:276] 0709 12:09:58.077119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.077302 (+   183us) service_pool.cc:224] Handling call
0709 12:09:59.778876 (+1701574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:58.804384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:58.839208 (+ 34824us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:58.839245 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:09:58.839267 (+    22us) tablet.cc:662] Decoding operations
0709 12:09:58.840200 (+   933us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:58.840287 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:58.840322 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:09:58.840841 (+   519us) tablet.cc:701] Row locks acquired
0709 12:09:58.840861 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:09:58.841030 (+   169us) write_op.cc:270] Start()
0709 12:09:58.841159 (+   129us) write_op.cc:276] Timestamp: P: 1783598998840980 usec, L: 0
0709 12:09:58.841183 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:09:58.925646 (+ 84463us) log.cc:844] Serialized 2447 byte log entry
0709 12:09:59.157958 (+232312us) op_driver.cc:464] REPLICATION: finished
0709 12:09:59.377980 (+220022us) write_op.cc:301] APPLY: starting
0709 12:09:59.378088 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:59.378337 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:59.378486 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:59.379665 (+  1179us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:59.379925 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:09:59.379992 (+    67us) write_op.cc:312] APPLY: finished
0709 12:09:59.380331 (+   339us) log.cc:844] Serialized 52 byte log entry
0709 12:09:59.413979 (+ 33648us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.418919 (+  4940us) write_op.cc:454] Released schema lock
0709 12:09:59.427108 (+  8189us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:59.478585 (+ 51477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.481000 (+  2415us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":263,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":219713,"apply.run_cpu_time_us":3642,"apply.run_wall_time_us":60165,"num_ops":6,"prepare.queue_time_us":171039,"prepare.run_cpu_time_us":12595,"prepare.run_wall_time_us":201001,"raft.queue_time_us":73261,"raft.run_cpu_time_us":22286,"raft.run_wall_time_us":112705,"replication_time_us":316629,"thread_start_us":304184,"threads_started":4,"wal-append.queue_time_us":88829}]]}
I20260709 12:09:59.806838 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.807557 11946 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.793509 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.799582 11769 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.811540 11769 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 2 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:09:59.812474 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.813678 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.798224 12609 pending_rounds.cc:107] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:09:59.817313 12609 raft_consensus.cc:2917] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:09:59.817790 12609 raft_consensus.cc:2889] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:09:59.819427 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.820502 13351 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.822641 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.823511 12022 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.824826 12014 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.824955 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.825665 12021 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.825832 12018 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.825922 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.824864 11769 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.827849 12013 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.827898 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.828924 12022 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.834117 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.835166 11867 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.836874 11864 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.838508 11940 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.838678 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.839231 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.839517 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.840715 12020 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.841526 11943 raft_consensus.cc:2368] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
W20260709 12:09:59.843298 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.843922 11948 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:09:59.844020 12018 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:59.844336 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.845631 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.846055 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.846674 12018 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.847533 11945 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.849217 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.850059 12022 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.850596 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.850891 12014 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.850596 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.851704 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.852272 11873 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.853474 11864 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.855738 11871 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.857618 12014 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.861146 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.861610 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.790273 11939 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:09:59.863260 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.863504 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.863719 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.864284 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.865258 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.864466 12015 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.865795 11945 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.866400 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.849334 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.868757 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:09:59.872066 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:09:59.874053 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.874465 11942 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:09:59.875033 11864 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:09:59.876016 12021 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:09:59.876454 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 90753.5us
I20260709 12:09:59.876710 12022 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:09:59.878011 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 68808us
I20260709 12:09:59.878221 11940 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.880163 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.880745 11873 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.883154 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.886751 11941 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.888804 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:09:59.886736 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:09:59.913657 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:09:59.914553 11864 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
W20260709 12:09:59.878047 11839 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.587s (SENT)
I20260709 12:09:59.918686 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:59.920205 11839 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.604s (SENT)
W20260709 12:09:59.920946 11839 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.604s (SENT)
I20260709 12:09:59.886404 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:09:59.921387 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.923312 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:59.926203 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.926847 11864 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:59.927731 11839 leader_election.cc:336] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.869s (SENT)
I20260709 12:09:59.928366 11839 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:09:59.858093 13329 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:09:59.889328 13385 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.938089 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:09:59.946497 11864 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:59.948050 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:09:59.944983 11839 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.683s (SENT)
W20260709 12:09:59.952767 11839 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.683s (SENT)
I20260709 12:09:59.953310 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:09:59.954634 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 91225.8us
I20260709 12:09:59.957417 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:09:59.956511 11873 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:59.959442 12018 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:09:59.922621 13302 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.924695 13362 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.924669 13378 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.936721 13382 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.964856 11839 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.943s (SENT)
I20260709 12:09:59.932420 13375 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.029139 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 142949us
I20260709 12:09:59.966794 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:00.044888 11864 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:00.033443 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76105us
I20260709 12:09:59.940040 12017 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:09:59.967842 13302 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:00.043035 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 78204.9us
I20260709 12:09:59.941932 13355 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.049397 11839 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.943s (SENT)
I20260709 12:10:00.051295 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.017891 13353 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.055095 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.018778 13136 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.058862 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 132557us
I20260709 12:10:00.056555 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.060070 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.061740 11872 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:10:00.063330 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:00.065830 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.051194 13302 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:00.075834 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.078542 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.075018 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.066742 13362 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.050045 13378 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.081260 11873 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.052943 13377 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:00.058349 13338 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:00.064929 13385 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.066571 13294 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.100445 13378 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:00.102421 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.103091 11871 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.105754 11946 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:00.092701 11873 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:00.063359 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.086380 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:00.114001 11944 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.074219 13408 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.096402 13363 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.086048 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:00.108197 13403 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:00.064576 13391 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:00.113437 11947 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:00.094877 13353 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.094749 11867 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:00.135792 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.123561 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74214us
I20260709 12:10:00.096164 13377 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.129325 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.137331 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.142398 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.138212 13385 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.145923 11867 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:00.162376 13385 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.163447 13353 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.163456 13385 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.164860 13353 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.166391 13302 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.146840 12611 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 1 LEARNER]: Advancing to term 3
I20260709 12:10:00.173640 11988 leader_election.cc:400] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:00.174021 11988 leader_election.cc:403] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:00.176079 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 89806.9us
I20260709 12:10:00.176368 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.177136 11946 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:00.177832 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.145664 13362 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:00.176342 13329 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:10:00.155361 13402 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:10:00.154716 13407 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:10:00.151846 13405 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:00.138244 13377 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:00.180299 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.198014 11873 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.198685 13351 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:00.199209 13351 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:00.199731 11945 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:00.181888 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:00.205986 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:00.207360 11864 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:10:00.207731 11864 pending_rounds.cc:85] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
I20260709 12:10:00.207944 11864 pending_rounds.cc:107] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:10:00.208786 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:00.212383 12609 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.215165 13250 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.215929 13367 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.215509 11839 leader_election.cc:400] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:00.218111 11839 leader_election.cc:403] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:00.205789 13331 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:00.217705 13411 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.218168 11864 raft_consensus.cc:2917] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:10:00.219396 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:00.219462 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.185456 13338 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:00.269888 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50490.1us
I20260709 12:10:00.270494 13338 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.193802 13377 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.183230 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:00.274098 11948 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:00.186013 13302 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:00.185460 13362 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.275827 13329 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.277029 13407 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.277130 13329 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.277596 13407 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.278468 13329 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.278766 13407 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.280135 13407 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.280508 13329 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.188297 13412 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260709 12:10:00.181907 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48529.7us
I20260709 12:10:00.188668 12607 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.290249 13136 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.304520 13136 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:00.287704 12611 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 3 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.270008 11864 raft_consensus.cc:2889] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:00.286103 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 106769us
I20260709 12:10:00.309654 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.217914 13410 raft_consensus.cc:2764] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:00.282244 13375 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.183810 13382 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.183658 13378 raft_consensus.cc:2764] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:00.219758 13250 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:00.283267 13362 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.271979 13338 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.219794 13367 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:10:00.354774 13250 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.348270 13363 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.384459 13363 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.319897 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:00.388849 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 157816us
I20260709 12:10:00.305799 13355 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:10:00.265247 13294 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:10:00.311064 13208 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:00.345677 13353 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.188380 13285 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
W20260709 12:10:00.389609 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 69863.6us
W20260709 12:10:00.353667 13389 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.001s
I20260709 12:10:00.390815 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.422751 11948 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.423504 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:00.424170 11947 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.425810 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.361904 13410 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:00.349560 13375 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.426985 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.380167 13250 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.396615 13385 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.432029 11947 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:00.436668 12013 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:00.395027 13415 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.398315 13411 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:00.449816 13338 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.422904 13353 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.421090 13424 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:00.457842 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:00.484882 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.480414 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53478.2us
I20260709 12:10:00.403698 13378 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:00.428032 13426 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.425408 13275 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:10:00.500532 11946 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.501853 13355 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.519604 13355 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.446751 13362 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.505843 13375 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:00.490665 13328 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.509637 13428 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.481132 13415 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.516043 13429 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.517204 13423 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:00.495290 13250 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.468438 13302 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:00.533772 13428 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.464403 13385 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.543833 13428 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.490665 13420 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.539117 13415 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.545961 13420 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:00.546458 11948 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.547029 13420 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.536736 13429 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.548763 13429 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.540561 13275 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.553603 13411 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.546164 13428 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.554594 13275 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.555548 13275 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:00.579408 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 296673us
I20260709 12:10:00.616433 13408 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.572309 13331 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:10:00.604609 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.537933 13328 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:00.533375 13436 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.556566 13275 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:00.602555 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 143257us
I20260709 12:10:00.563524 13426 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:00.654829 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.673071 13407 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:00.674660 13250 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:00.677731 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.677949 13385 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:00.633813 13412 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:10:00.629992 13375 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:10:00.684616 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.626899 13408 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:00.654525 13391 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:00.694461 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.699005 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 211445us
I20260709 12:10:00.701606 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.570643 13355 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.706040 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:00.690526 13275 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.707270 13426 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.574270 13353 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.728237 12013 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.680405 13407 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.656690 13436 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.729113 13410 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.733704 13355 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.702200 13391 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.737915 13438 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.741200 13415 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.733253 13411 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:00.727726 13429 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.766144 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:00.766880 12014 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:00.746546 13410 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:00.762300 13415 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:00.762619 13438 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:00.777930 12016 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.788290 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 220) took 2710 ms. Trace:
W20260709 12:10:00.793460 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.798960 11942 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.799486 11940 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.800699 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:00.796590 11769 rpcz_store.cc:276] 0709 12:09:58.077675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.145470 (+ 67795us) service_pool.cc:224] Handling call
0709 12:10:00.788217 (+2642747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:00.060265 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:00.152133 (+ 91868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:00.152172 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:00.152192 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:00.153062 (+   870us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:00.153122 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:00.153149 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:00.153733 (+   584us) tablet.cc:701] Row locks acquired
0709 12:10:00.153755 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:10:00.153915 (+   160us) write_op.cc:270] Start()
0709 12:10:00.154045 (+   130us) write_op.cc:276] Timestamp: P: 1783599000153865 usec, L: 0
0709 12:10:00.154069 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:00.154823 (+   754us) log.cc:844] Serialized 2089 byte log entry
0709 12:10:00.347004 (+192181us) op_driver.cc:464] REPLICATION: finished
0709 12:10:00.465997 (+118993us) write_op.cc:301] APPLY: starting
0709 12:10:00.482717 (+ 16720us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:00.496908 (+ 14191us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:00.497229 (+   321us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:00.500476 (+  3247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:00.500669 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:00.500712 (+    43us) write_op.cc:312] APPLY: finished
0709 12:10:00.500948 (+   236us) log.cc:844] Serialized 46 byte log entry
0709 12:10:00.506697 (+  5749us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.506874 (+   177us) write_op.cc:454] Released schema lock
0709 12:10:00.506943 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:00.508876 (+  1933us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.508922 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":81707,"apply.run_cpu_time_us":3710,"apply.run_wall_time_us":56538,"num_ops":5,"prepare.queue_time_us":205212,"prepare.run_cpu_time_us":4281,"prepare.run_wall_time_us":107381,"replication_time_us":192696,"thread_start_us":127602,"threads_started":2}]]}
I20260709 12:10:00.807058 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.809707 13431 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.810554 13382 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.812016 13449 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.810612 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.818071 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.820120 12611 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.812304 13382 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:00.731165 13328 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:00.831455 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.732301 13408 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:00.837687 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 209476us
I20260709 12:10:00.807758 13412 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:00.838996 12611 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 12:10:00.812719 13449 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.836391 13435 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.850342 12611 pending_rounds.cc:85] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 3
I20260709 12:10:00.862195 12611 pending_rounds.cc:107] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
W20260709 12:10:00.864936 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.865988 11864 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:00.849820 13294 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.822117 13363 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:00.867908 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:00.871932 11871 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:00.822109 13285 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:00.874722 11871 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:00.876390 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.878039 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57509.4us
I20260709 12:10:00.877405 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:00.879253 11871 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.862898 12611 raft_consensus.cc:2917] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 12:10:00.882735 12611 raft_consensus.cc:2889] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:00.878692 13410 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.887493 11868 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:00.888281 13437 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:10:00.889763 13450 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:00.890350 13450 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.891422 13434 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:00.892066 13428 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.891945 13434 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:00.892516 13428 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.893040 13450 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:00.893348 13428 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.893707 13433 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:00.896116 13367 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.896513 13432 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:10:00.896554 13367 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.897915 13407 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:00.897989 13367 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.872663 13438 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.899302 13367 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.902290 13429 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:00.907303 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.874071 13436 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:00.935408 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53664.7us
I20260709 12:10:00.947487 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:00.948244 11946 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:10:00.954535 13445 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:00.958946 13375 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.959694 13375 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:00.893718 13449 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.961643 13449 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.942394 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:00.963179 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 53765.6us
I20260709 12:10:00.982745 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:00.960734 13375 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.993723 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:00.994468 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 365990us
I20260709 12:10:01.001230 13434 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:01.001997 13455 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.003808 13443 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.004238 13443 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:01.005297 13443 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:00.999334 13389 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:01.006604 13443 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.008127 13441 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.009428 13275 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.010166 13415 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.011672 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:01.013113 13375 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.018302 13423 raft_consensus.cc:1064] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:01.018754 13423 raft_consensus.cc:1068] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:01.006671 13361 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:01.015908 13363 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:01.022107 13363 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.004383 13351 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:01.023401 13351 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:00.984650 13331 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:10:01.024749 13363 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.025035 13351 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.024811 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.031405 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:01.036731 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:00.986681 13391 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.008769 13441 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.042793 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.045368 11945 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:01.044988 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44609.2us
I20260709 12:10:00.998667 13285 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.051074 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.052393 11839 leader_election.cc:400] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:01.056653 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.038236 13351 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:01.058732 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.059381 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.044306 13433 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.067075 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:01.006798 13389 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.052994 13208 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.061770 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:01.064324 13443 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.056123 13424 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:10:01.052664 13391 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:10:01.096166 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.083957 13377 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.810s	user 0.012s	sys 0.002s
I20260709 12:10:01.098707 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.101444 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:01.075060 13420 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.105139 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.119119 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.119616 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.085240 13438 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.157567 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58900.6us
W20260709 12:10:01.158680 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.164268 13408 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.165928 11939 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:01.170652 13441 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.172199 13389 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.176406 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:01.183357 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79563.3us
I20260709 12:10:01.188179 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:01.189149 11948 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:01.190042 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.191881 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.193624 12014 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:01.193776 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:01.201786 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:01.205936 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.214775 12020 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.197052 13458 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.220302 13412 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.220752 13457 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.216584 13355 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.222469 13429 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:01.223058 13429 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:01.223186 13463 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:10:01.229646 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:01.230825 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.245556 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.269966 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.286974 13469 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:01.203501 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.197270 13136 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.290860 13434 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:01.296836 13434 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.299218 13434 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:01.104514 13351 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:10:01.162163 13426 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:01.302978 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99559.2us
I20260709 12:10:01.104945 13377 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:01.296176 13468 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:01.308594 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.313577 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.315222 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:01.307548 13375 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.320345 13375 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.320820 13375 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.325984 13427 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.326480 13427 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.326825 13427 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.330402 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:01.331061 11871 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.333376 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:01.334888 12018 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.343307 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.331982 13362 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.308005 13426 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.352226 11944 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.357398 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:01.312487 13434 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.366153 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.372506 11871 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:01.383395 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:01.333257 13448 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:01.414057 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.387872 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:01.431892 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44096.4us
I20260709 12:10:01.369907 13285 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.378913 13436 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.385017 11768 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68), now has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:01.380868 13426 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.366603 13415 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.468314 12018 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:01.485818 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:01.489665 11768 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:10:01.431510 13458 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.419435 13412 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.420718 13410 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:01.518815 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 98920.8us
W20260709 12:10:01.542219 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56555.4us
I20260709 12:10:01.496111 13432 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.543069 13432 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.543502 13432 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.488220 13436 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.473882 13423 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:10:01.473592 13443 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 12:10:01.551692 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.498459 13458 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.504418 13353 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.487854 13420 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:10:01.504742 13412 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.550103 13428 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.490911 13285 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:01.549036 13355 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.499008 13415 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:01.561709 13436 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.565641 13419 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.619465 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.591382 13458 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.606882 13412 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.609911 13434 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:01.673946 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.624053 13136 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.603878 13353 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.681274 13434 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:01.681495 13449 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.719s	user 0.004s	sys 0.015s
I20260709 12:10:01.617080 13355 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.665963 13391 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.715760 13355 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:01.720577 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.728008 13391 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:01.726183 13136 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.729496 11942 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:01.730129 13136 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.740334 13136 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:01.741197 13449 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:01.742009 13449 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:01.748042 13449 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:01.763145 13475 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:10:01.764178 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1130) took 1594 ms. Trace:
W20260709 12:10:01.764607 13474 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:01.764810 11944 rpcz_store.cc:276] 0709 12:10:00.169552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.174544 (+  4992us) service_pool.cc:224] Handling call
0709 12:10:00.189774 (+ 15230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.385090 (+1195316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.763780 (+378690us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400388bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:01.764059 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663606528}
W20260709 12:10:01.768551 13479 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:10:01.771983 13302 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.776091 13377 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:01.782470 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.782801 13476 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:01.633926 13419 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.708592 13482 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.794818 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 252310us
W20260709 12:10:01.730618 13465 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.533s	user 0.002s	sys 0.005s
I20260709 12:10:01.730822 13391 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.837273 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:01.802762 12018 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:01.846808 11867 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:01.848124 11872 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.834206 13448 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.850919 12014 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.805996 13482 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.866426 12021 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.869804 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:01.870693 11872 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.895164 13472 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:10:01.894990 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:01.780659 13328 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:01.953863 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:01.955585 12017 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:01.957481 12019 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.903766 13448 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.964063 13436 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:01.966467 13485 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:10:01.969161 13362 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 12:10:01.970708 13419 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.971621 13353 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:01.888919 13331 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.972499 13331 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:01.840770 13434 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:01.981966 13367 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.082s	user 0.012s	sys 0.003s
I20260709 12:10:02.031749 13487 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.039135 13487 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:02.040449 13487 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.088496 13375 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.004s
W20260709 12:10:02.088868 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.022s	sys 0.030s
W20260709 12:10:02.110278 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.023s	sys 0.030s
W20260709 12:10:02.115691 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.134940 11911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.034s
W20260709 12:10:02.135538 11911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.014s	sys 0.034s
W20260709 12:10:02.148200 12016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.012s	sys 0.019s
W20260709 12:10:02.206106 12016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.012s	sys 0.023s
W20260709 12:10:02.211656 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.191002 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:02.135391 13375 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.232429 13375 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.232999 13482 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:02.089095 13432 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.079803 13423 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:02.235922 13432 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.236217 13423 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.237587 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.239297 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.551s (SENT) [suppressed 51 similar messages]
I20260709 12:10:02.243641 11867 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.033068 13367 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.134826 13362 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:02.276400 12017 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:02.299118 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.299901 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.247612 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:02.293700 13362 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.308095 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1145) took 1299 ms. Trace:
I20260709 12:10:02.308336 13362 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.242275 13285 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:02.247462 13482 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:02.308655 11946 rpcz_store.cc:276] 0709 12:10:01.008563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.025968 (+ 17405us) service_pool.cc:224] Handling call
0709 12:10:01.026361 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.026797 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.026832 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.027353 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.504723 (+477370us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.504772 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.504857 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:01.897922 (+393065us) raft_consensus.cc:1685] finished
0709 12:10:01.897941 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.308007 (+410066us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6358,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":447916,"threads_started":1,"wal-append.queue_time_us":568245}
W20260709 12:10:02.251682 12575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.017s	sys 0.039s
I20260709 12:10:02.249800 13331 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:02.014365 13458 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:02.327955 13362 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.358628 12575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.018s	sys 0.046s
W20260709 12:10:02.385668 13338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.012s	sys 0.038s
W20260709 12:10:02.381178 13412 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
W20260709 12:10:02.388316 13427 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.060s	user 0.013s	sys 0.000s
I20260709 12:10:02.311295 13367 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:02.408207 13338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.012s	sys 0.039s
I20260709 12:10:02.359575 13482 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:02.429399 13331 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.405447 13449 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:02.432114 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:02.442014 13491 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:02.444340 13446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.011s	sys 0.023s
W20260709 12:10:02.432435 13428 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.004s
I20260709 12:10:02.429471 11868 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:10:02.402814 13362 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.470490 11940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.033s
W20260709 12:10:02.499171 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.638406 11940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.005s	sys 0.033s
I20260709 12:10:02.432691 13436 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.432893 13494 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.415993 13412 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.448371 13294 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.513566 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1432) took 1181 ms. Trace:
I20260709 12:10:02.414309 13427 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.770596 13427 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:02.504163 13408 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.339s	user 0.017s	sys 0.000s
I20260709 12:10:02.539320 13458 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.771723 13329 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.543226 13482 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:02.509254 13423 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.548440 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1431) took 1227 ms. Trace:
I20260709 12:10:02.467907 13331 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.451042 11839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.002s	sys 0.029s
I20260709 12:10:02.504559 13431 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 12:10:02.568406 12609 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.002s	sys 0.016s
I20260709 12:10:02.500664 13449 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.565759 13377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.016s
W20260709 12:10:02.722643 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.733649 13492 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:10:02.734884 13367 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:02.736560 13328 consensus_meta.cc:287] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.836s	user 0.014s	sys 0.000s
I20260709 12:10:02.638028 13375 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.738471 13426 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.240s	user 0.013s	sys 0.000s
I20260709 12:10:02.640602 13502 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.748835 13508 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:10:02.749267 13494 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.751988 13412 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.719677 13428 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.754786 13362 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.723019 13420 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.564846 13446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.017s	sys 0.026s
I20260709 12:10:02.502300 13491 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.765717 12016 rpcz_store.cc:276] 0709 12:10:01.332602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.334473 (+  1871us) service_pool.cc:224] Handling call
0709 12:10:01.339316 (+  4843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.354831 (+ 15515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.354877 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.355469 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.206585 (+851116us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.206629 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.206704 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.513291 (+306587us) raft_consensus.cc:1685] finished
0709 12:10:02.513312 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.513476 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16144,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":65416,"thread_start_us":731491,"threads_started":1,"wal-append.queue_time_us":1125847}
I20260709 12:10:02.774140 12020 rpcz_store.cc:276] 0709 12:10:01.321355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.321501 (+   146us) service_pool.cc:224] Handling call
0709 12:10:01.321830 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.562454 (+240624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.562490 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.589692 (+ 27202us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.238820 (+649128us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.238865 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.238958 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.548168 (+309210us) raft_consensus.cc:1685] finished
0709 12:10:02.548193 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.548351 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35907,"raft.queue_time_us":153973,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":21762,"thread_start_us":485973,"threads_started":2,"wal-append.queue_time_us":822903}
W20260709 12:10:02.776728 11839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.005s	sys 0.031s
I20260709 12:10:02.773813 13329 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:02.794142 12609 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.002s	sys 0.017s
W20260709 12:10:02.803385 12018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.027s	sys 0.062s
W20260709 12:10:02.824297 12018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.028s	sys 0.062s
I20260709 12:10:02.825448 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 129) took 1029 ms. Trace:
W20260709 12:10:02.802913 13377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.003s	sys 0.016s
W20260709 12:10:02.817444 11871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.025s	sys 0.128s
W20260709 12:10:02.822350 11988 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.018s	sys 0.078s
W20260709 12:10:02.823122 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 1.27925e+06us
I20260709 12:10:02.825924 12018 rpcz_store.cc:276] 0709 12:10:01.796381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.797716 (+  1335us) service_pool.cc:224] Handling call
0709 12:10:01.802349 (+  4633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.802611 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:02.153178 (+350567us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.824784 (+671606us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.825026 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.825090 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.825147 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.825229 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.825385 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2094,"raft.queue_time_us":157,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":29970,"spinlock_wait_cycles":197504,"thread_start_us":576656,"threads_started":1}
W20260709 12:10:02.830166 11871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.026s	sys 0.128s
I20260709 12:10:02.831609 11867 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.833204 11873 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.834383 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.834587 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.835160 11873 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:02.835229 11866 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:02.836599 11867 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.836323 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.836848 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:02.843235 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.843235 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.844293 11866 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:02.844637 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.845652 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.846484 11873 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:02.830226 11988 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.018s	sys 0.079s
W20260709 12:10:02.850126 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 610815us
I20260709 12:10:02.851786 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.822328 13428 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.854681 11865 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:02.855984 13428 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.828413 13423 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:02.856959 13423 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:02.858784 13494 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:02.859122 13423 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:02.859300 13482 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.807199 13426 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.860781 13494 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.861234 13494 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:02.861908 13426 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.807736 13375 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.862160 13494 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.863615 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.829252 13420 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.865836 13420 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.822373 13362 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.866616 13362 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.868821 13362 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.816237 13502 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.871138 13502 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:02.871330 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 122) took 1033 ms. Trace:
I20260709 12:10:02.872251 11866 raft_consensus.cc:2368] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
W20260709 12:10:02.873466 11988 connection.cc:256] RPC call timeout handler was delayed by -1.4949512539999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:10:02.874133 11988 connection.cc:256] RPC call timeout handler was delayed by -1.4499512540000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 12:10:02.875224 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:02.876215 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:02.881918 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.882464 11988 connection.cc:256] RPC call timeout handler was delayed by -1.3541913770002338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:10:02.883142 11988 connection.cc:256] RPC call timeout handler was delayed by -1.3077512540000953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 12:10:02.883695 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2294512539999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:10:02.884083 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2276512539999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:10:02.884475 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1313512540000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:10:02.880745 11865 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 12:10:02.886085 11865 pending_rounds.cc:85] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:02.886404 11865 pending_rounds.cc:107] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 12:10:02.886756 11865 raft_consensus.cc:2917] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 12:10:02.871665 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.805370 13294 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:02.887375 11865 raft_consensus.cc:2889] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:02.871867 11940 rpcz_store.cc:276] 0709 12:10:01.837825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.838021 (+   196us) service_pool.cc:224] Handling call
0709 12:10:01.838317 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.858225 (+ 19908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.858273 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.869292 (+ 11019us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.639027 (+769735us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.639071 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.639165 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.871050 (+231885us) raft_consensus.cc:1685] finished
0709 12:10:02.871079 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.871250 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16944,"raft.queue_time_us":22228,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":692070,"threads_started":1,"wal-append.queue_time_us":922128}
I20260709 12:10:02.893719 11869 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:02.905028 11865 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:02.907600 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.889717 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 492335us
I20260709 12:10:02.912123 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.916237 11865 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:02.917117 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.918928 11865 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:10:02.919132 12019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.018s	sys 0.064s
W20260709 12:10:02.920259 12019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.019s	sys 0.064s
W20260709 12:10:02.921062 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.932111 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.933599 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:02.935839 11911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.026s	sys 0.083s
W20260709 12:10:02.936324 11911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.026s	sys 0.083s
I20260709 12:10:02.939432 11865 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:10:02.940693 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.941373 11865 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:02.952975 12015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.014s
W20260709 12:10:02.953622 12022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.006s	sys 0.009s
W20260709 12:10:02.954067 12022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.006s	sys 0.009s
W20260709 12:10:02.959323 12015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.004s	sys 0.014s
I20260709 12:10:02.967211 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.968008 11865 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:02.936964 13415 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:02.909591 13489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.009s
I20260709 12:10:02.939567 13331 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.046643 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.305742 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.171772 11942 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:03.162958 11914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.002s	sys 0.024s
I20260709 12:10:03.316586 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:03.422025 11914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.005s	sys 0.038s
W20260709 12:10:03.422435 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 1.06747e+06us
I20260709 12:10:03.277093 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:03.263168 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.411932 11867 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.536s	user 0.022s	sys 0.014s
I20260709 12:10:03.336266 11866 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.018981 11873 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:03.429787 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:02.966799 13423 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:02.965159 13367 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.335536 12609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 416) took 1488 ms. Trace:
I20260709 12:10:03.250772 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.236162 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.435891 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.437100 11866 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:03.307042 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1370) took 1430 ms. Trace:
I20260709 12:10:02.964993 13433 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:02.967754 13435 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:03.425840 11867 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:03.433993 12609 rpcz_store.cc:276] 0709 12:10:01.834229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.834416 (+   187us) service_pool.cc:224] Handling call
0709 12:10:01.834791 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.835002 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:02.827402 (+992400us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.322263 (+494861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.322348 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:03.322532 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.322610 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.322773 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43936,"prepare.queue_time_us":1059111,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":47373,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":56658,"thread_start_us":1428864,"threads_started":2}
W20260709 12:10:03.440058 12610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.006s	sys 0.009s
I20260709 12:10:02.975126 13446 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.438313 11871 rpcz_store.cc:276] 0709 12:10:01.876814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.877041 (+   227us) service_pool.cc:224] Handling call
0709 12:10:01.877519 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.877984 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.878025 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.878611 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.830982 (+952371us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:03.272325 (+441343us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.306528 (+ 34203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.306648 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.306718 (+    70us) raft_consensus.cc:1685] finished
0709 12:10:03.306737 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.306958 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33709,"raft.queue_time_us":33993,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":9785,"thread_start_us":1333092,"threads_started":2,"wal-append.queue_time_us":1083394}
W20260709 12:10:03.322505 13430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.025s	sys 0.009s
W20260709 12:10:03.046331 13429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.009s
W20260709 12:10:02.977627 13489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.007s	sys 0.009s
W20260709 12:10:03.393134 13506 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:10:03.167798 13491 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.447464 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.239169 13487 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.065230 13420 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.064862 11869 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:10:03.168916 13294 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:03.463801 13519 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 12:10:03.463563 13294 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:03.465197 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1447) took 1573 ms. Trace:
I20260709 12:10:03.465634 12019 rpcz_store.cc:276] 0709 12:10:01.891737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.958694 (+ 66957us) service_pool.cc:224] Handling call
0709 12:10:02.240068 (+281374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.244371 (+  4303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.244440 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.274192 (+ 29752us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.920756 (+646564us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.920814 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.920912 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.464948 (+544036us) raft_consensus.cc:1685] finished
0709 12:10:03.464972 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.465125 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4991,"raft.queue_time_us":10872,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":18572,"thread_start_us":611013,"threads_started":1,"wal-append.queue_time_us":964098}
W20260709 12:10:03.448401 13430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.031s	sys 0.012s
I20260709 12:10:02.981287 13449 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:03.472114 13512 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:10:03.468793 13408 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.378635 13434 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:02.979480 13415 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:03.326972 13377 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.411170 13329 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.410470 13514 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.452574 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:03.444175 12610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.007s	sys 0.009s
I20260709 12:10:03.449306 11867 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:03.491808 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:03.450955 13429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.020s	sys 0.028s
I20260709 12:10:03.467590 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.468322 11866 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:03.473685 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1439) took 1625 ms. Trace:
I20260709 12:10:03.287946 13426 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.480603 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.500540 11871 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
W20260709 12:10:03.482407 11986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.017s	sys 0.032s
I20260709 12:10:03.483112 11865 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:03.484253 12577 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.025s	sys 0.029s
W20260709 12:10:03.502182 12577 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.025s	sys 0.029s
W20260709 12:10:03.502660 11986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.017s	sys 0.032s
I20260709 12:10:03.467799 13491 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:03.493254 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.467932 13487 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.448151 13433 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:03.502619 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 558339us
I20260709 12:10:03.446376 13367 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.451107 13446 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.503710 11867 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:03.451077 13435 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:03.505059 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 595911us
I20260709 12:10:03.512579 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.470798 13420 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.516614 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:03.446426 13423 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.486646 13408 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:03.596204 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 78038.6us
W20260709 12:10:03.511000 13338 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.021s
W20260709 12:10:03.597707 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.621068 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.621315 11873 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:03.489701 13415 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.496433 12022 rpcz_store.cc:276] 0709 12:10:01.848551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.849670 (+  1119us) service_pool.cc:224] Handling call
0709 12:10:01.849983 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.854793 (+  4810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.854843 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.859853 (+  5010us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.382239 (+522386us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800115240. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:02.954551 (+572312us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.954610 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.954709 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.473278 (+518569us) raft_consensus.cc:1685] finished
0709 12:10:03.473299 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.473586 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":839,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3884,"spinlock_wait_cycles":25650048,"thread_start_us":572049,"threads_started":1,"wal-append.queue_time_us":1393489}
I20260709 12:10:03.500931 13429 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.597167 12609 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:10:03.510131 13329 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.637509 13530 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.515223 13426 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.638042 13329 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.639266 13448 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.622574 11945 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
W20260709 12:10:03.642043 13525 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:10:03.491251 13377 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.643658 13415 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.644196 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 424) took 1084 ms. Trace:
I20260709 12:10:03.643884 13429 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.644541 13415 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.514230 13361 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:03.645531 13361 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.636464 13528 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.647480 13528 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.638420 13530 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.488277 13434 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:02.976621 11939 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:03.641215 13329 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:03.620844 13338 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.017s	sys 0.030s
I20260709 12:10:03.496954 13514 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.658136 11867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:10:03.659133 11867 raft_consensus.cc:606] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Received request to transfer leadership to TS 189a165e6619406382914fe3075dd436
I20260709 12:10:03.659641 11867 raft_consensus.cc:614] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:03.514914 13491 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.645211 13415 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.676399 13530 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.677570 13423 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.678272 13377 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.665390 13448 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.679322 13448 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.680047 13361 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.682897 13514 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.684692 13429 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.698474 13411 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:03.709357 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:03.688453 13448 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:03.704517 13411 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:03.722051 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 297525us
I20260709 12:10:03.724835 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1438) took 1876 ms. Trace:
I20260709 12:10:03.725373 12015 rpcz_store.cc:276] 0709 12:10:01.848304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.849590 (+  1286us) service_pool.cc:224] Handling call
0709 12:10:02.365052 (+515462us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:02.365292 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.365515 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:02.960124 (+594609us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.724457 (+764333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.724519 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.724569 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.724639 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.724760 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":789851,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":224293,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":9132928,"thread_start_us":1334957,"threads_started":3,"wal-append.queue_time_us":672828}
W20260709 12:10:03.728117 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.672642 11869 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:03.750569 13377 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:03.753854 13423 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:03.756716 11839 connection.cc:256] RPC call timeout handler was delayed by -2.8908209050000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:10:03.757357 13517 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:03.757946 13517 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:03.757332 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6991209049999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:10:03.761109 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6983935190000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:10:03.761445 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6011935189999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:10:03.761787 11839 connection.cc:256] RPC call timeout handler was delayed by -2.5651935190001041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:10:03.762096 11839 connection.cc:256] RPC call timeout handler was delayed by -2.4510082330000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:10:03.721858 13515 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:03.793753 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.644606 12604 rpcz_store.cc:276] 0709 12:10:02.560116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.566618 (+  6502us) service_pool.cc:224] Handling call
0709 12:10:03.643312 (+1076694us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:03.643551 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.643785 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.643816 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.643869 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:03.643907 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.643976 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.644120 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64152960}
I20260709 12:10:03.763506 13432 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.763906 13448 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.765035 13482 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:03.760722 13411 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:10:03.823784 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.807983 13329 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.823320 13491 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.805078 13517 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:10:03.842039 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 74122.7us
I20260709 12:10:03.845767 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:03.814958 13377 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:10:03.848798 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 242253us
I20260709 12:10:03.849468 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:03.825503 13528 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.811813 13515 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.833204 13446 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.816848 13432 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.837188 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 421) took 1940 ms. Trace:
I20260709 12:10:03.826345 13482 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.871555 12013 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:03.848579 13367 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.869910 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.834784 13491 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:03.869910 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.871909 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.878302 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:03.848518 13530 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.831853 13329 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.819401 13448 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.889226 13515 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:03.890187 13538 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:10:03.890939 13448 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.891497 13448 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:03.892055 13432 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.892681 13482 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:03.893349 13522 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:10:03.893762 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.894688 12019 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:03.895318 12018 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.867807 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:03.896597 11869 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.876847 12020 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:03.856709 13136 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.855507 13449 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.880728 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.884063 11867 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.900537 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.882710 13491 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.862159 13434 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.906311 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:03.863859 13435 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.864338 13426 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.906857 13491 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.887682 13415 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.907094 12611 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:03.888959 13329 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:03.871596 13446 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:10:03.884068 13367 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.882903 13530 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.908182 13434 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.908036 13367 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.908634 13434 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:03.909847 13530 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.909628 13434 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:03.910369 13367 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:03.915144 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.915578 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:03.915836 12022 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:03.915836 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.891965 13448 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.918113 12020 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:03.920100 13448 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:03.923475 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53438.1us
I20260709 12:10:03.926884 11986 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:03.932766 11869 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:03.932951 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.935168 11867 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:03.936771 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:03.952636 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:03.957633 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.961093 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1368) took 2088 ms. Trace:
I20260709 12:10:03.967180 11864 rpcz_store.cc:276] 0709 12:10:01.872367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.873314 (+   947us) service_pool.cc:224] Handling call
0709 12:10:02.312090 (+438776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.312489 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.312526 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.446240 (+1133714us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b2c000014c8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:03.450877 (+  4637us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.749835 (+298958us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:03.749892 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.749983 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.960708 (+210725us) raft_consensus.cc:1685] finished
0709 12:10:03.960737 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.961011 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15857,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":21572,"spinlock_wait_cycles":113984384,"thread_start_us":298557,"threads_started":1,"wal-append.queue_time_us":379550}
I20260709 12:10:03.965210 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:03.970613 12019 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:03.981523 12610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 159) took 2098 ms. Trace:
I20260709 12:10:03.983237 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:03.938251 13487 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:03.986239 13316 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:03.994702 13316 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:03.982167 12610 rpcz_store.cc:276] 0709 12:10:01.865855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.866029 (+   174us) service_pool.cc:224] Handling call
0709 12:10:01.906792 (+ 40763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.273145 (+366353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.273177 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.340085 (+ 66908us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.731815 (+391730us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b18003bca40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:03.496206 (+764391us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:03.827647 (+331441us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.831197 (+  3550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.831286 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.915012 (+ 83726us) raft_consensus.cc:1685] finished
0709 12:10:03.964246 (+ 49234us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.964378 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374757,"prepare.queue_time_us":315424,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":369309,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":37159,"spinlock_wait_cycles":8843520,"thread_start_us":1092893,"threads_started":2,"wal-append.queue_time_us":1347686}
I20260709 12:10:03.961720 13415 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.000061 11864 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.007630 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.011162 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.012188 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70655us
I20260709 12:10:03.959479 13543 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:04.019129 11837 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:03.999675 13415 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:10:04.022439 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 162886us
I20260709 12:10:04.027657 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.006016 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.049451 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.007651 13448 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.056900 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.046759 13488 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.050390 13377 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.038568 13415 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.061841 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.027119 13557 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.065820 13488 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:04.061345 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.068142 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.029954 13493 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:04.077386 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.078308 13494 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.079902 13338 raft_consensus.cc:1064] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:04.082343 13316 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.072886 13377 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.050697 13487 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.046231 13429 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.018496 13528 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:04.065703 13530 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.097826 13435 raft_consensus.cc:1064] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:04.084733 13488 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.104750 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.106297 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:03.867400 12603 rpcz_store.cc:276] 0709 12:10:01.896867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.897103 (+   236us) service_pool.cc:224] Handling call
0709 12:10:02.032199 (+135096us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:03.390993 (+1358794us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890ee9c 00007f1f1890ea5b 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:03.407432 (+ 16439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.433026 (+ 25594us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:03.452441 (+ 19415us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.762158 (+309717us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b180030d660. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:03.811711 (+ 49553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.814344 (+  2633us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:03.818618 (+  4274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.825946 (+  7328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.834003 (+  8057us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4528,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4538,"raft.queue_time_us":3788,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3769,"spinlock_wait_cycles":31900032,"thread_start_us":312864,"threads_started":1,"wal-append.queue_time_us":413959}
I20260709 12:10:04.063138 11869 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:04.125363 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.126071 11869 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:04.065809 13448 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.127470 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.110699 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.084554 13557 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.114063 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:04.077450 13493 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.142048 13493 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.143425 11940 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
W20260709 12:10:04.119614 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46061.2us
I20260709 12:10:04.103049 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.121969 11941 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
W20260709 12:10:04.124318 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.144874 11946 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:04.134979 11871 raft_consensus.cc:2368] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:04.138208 13338 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.139169 13557 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.144057 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.150856 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1369) took 2275 ms. Trace:
I20260709 12:10:04.151412 11868 rpcz_store.cc:276] 0709 12:10:01.875447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.886803 (+ 11356us) service_pool.cc:224] Handling call
0709 12:10:02.269200 (+382397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.641354 (+372154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.150543 (+1509189us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002f6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:04.150760 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275584512}
I20260709 12:10:04.152869 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.153056 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.155326 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.156725 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.160169 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76336.6us
I20260709 12:10:04.161271 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:04.161731 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.165580 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:04.166806 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:04.171504 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.175211 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.175457 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:04.175876 12016 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
I20260709 12:10:04.116331 13429 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.115684 13487 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.164916 13482 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.188871 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.188180 11945 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:04.185686 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:04.179392 13515 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.190088 11868 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:04.205014 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.205749 11868 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:04.206827 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:04.206923 13448 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.207489 11868 raft_consensus.cc:2376] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3. Re-sending same reply.
I20260709 12:10:04.208720 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.188519 13482 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.174822 13329 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:04.165266 13543 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:04.202353 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.216189 11871 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:04.217329 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.178915 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.187772 13553 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:04.181690 13540 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.181113 13568 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:04.189931 13559 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.232374 13559 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.190001 13539 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.183807 13377 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.219105 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.187368 13528 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:04.209157 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.196018 13328 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.215250 11868 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.189814 13532 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:04.222695 13540 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.225986 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.244701 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77981.5us
I20260709 12:10:04.209705 13482 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.209228 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.238077 13328 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:04.250046 13328 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.251508 13544 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.252017 13544 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.252692 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.253443 11867 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:04.256855 13329 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.257833 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.245846 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:04.230887 13429 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.248314 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.248788 13540 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.260488 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:04.245335 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.261384 11943 raft_consensus.cc:606] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:04.248260 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.237701 13528 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.273447 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.263075 11867 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.264585 11872 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:04.236418 13539 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.266795 11943 raft_consensus.cc:614] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:04.284062 11988 leader_election.cc:400] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:04.285126 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:04.286052 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.267606 13487 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.286324 13285 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.283049 13528 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.283237 11868 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:04.286890 13285 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.288599 13552 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.288935 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.289673 11945 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.290524 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.288611 13285 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.290990 13420 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.291594 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.292160 11945 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.293169 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.294183 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.295094 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.295756 11942 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:10:04.296442 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.297111 11942 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:04.292918 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.302932 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.302309 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:04.308156 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.301590 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.310745 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.311698 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.313906 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.314846 12014 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.312307 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.317106 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.317986 12022 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.320125 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.320957 12020 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.310775 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.322283 11943 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.323730 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.325625 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.255277 13544 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.332261 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.319046 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.333117 12022 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.333575 11943 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:04.332561 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.336556 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.337393 12022 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.350303 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.351363 12019 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.359575 12014 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:04.298328 13539 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.364614 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.325814 13494 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.364845 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.365212 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.366263 11943 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.366374 11867 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:04.365423 12016 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.368491 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.369192 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.369437 12016 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:04.372074 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.335196 13316 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.374908 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.375752 11947 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.377815 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.379248 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.379437 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.381031 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:04.382342 11943 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:04.387356 12020 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:04.390874 11943 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.373952 13316 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:04.391796 13530 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.392390 13316 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.374596 13494 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.394722 13494 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.361057 13495 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:04.397758 12018 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.398870 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49974
I20260709 12:10:04.399482 11946 raft_consensus.cc:606] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Received request to transfer leadership
I20260709 12:10:04.397964 13495 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:04.403990 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.420153 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.420868 12018 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:04.424376 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.425601 11946 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:04.434908 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:04.422504 13569 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:04.396824 13435 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.422853 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.448057 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.449659 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.441664 13488 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:04.454488 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 86034.6us
I20260709 12:10:04.437336 13559 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.444607 13408 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.470350 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:04.493084 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.494593 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.499398 13488 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.500319 11871 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.500423 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.502329 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:04.460012 11869 raft_consensus.cc:2376] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3. Re-sending same reply.
I20260709 12:10:04.514350 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.515061 12018 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.515458 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.506328 13420 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.509315 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 126) took 1596 ms. Trace:
I20260709 12:10:04.526094 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:04.528016 13580 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:04.523343 11939 rpcz_store.cc:276] 0709 12:10:02.913010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.918725 (+  5715us) service_pool.cc:224] Handling call
0709 12:10:02.938995 (+ 20270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.970749 (+ 31754us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:04.166669 (+1195920us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.459560 (+292891us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.469185 (+  9625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.500056 (+ 30871us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:04.502355 (+  2299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.507174 (+  4819us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.509231 (+  2057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519,"prepare.queue_time_us":17811,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":39,"raft.queue_time_us":6708,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":37413,"thread_start_us":225669,"threads_started":1,"wal-append.queue_time_us":270729}
I20260709 12:10:04.545655 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.550292 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1371) took 2673 ms. Trace:
I20260709 12:10:04.552809 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.555202 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1157) took 1581 ms. Trace:
I20260709 12:10:04.557349 13434 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.570614 11869 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:04.623668 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.628427 11947 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:10:04.639922 11872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1119) took 1804 ms (client timeout 2062 ms). Trace:
W20260709 12:10:04.640504 11872 rpcz_store.cc:269] 0709 12:10:02.835798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.835953 (+   155us) service_pool.cc:224] Handling call
0709 12:10:04.639680 (+1803727us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002940d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:04.639844 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3261214592}
I20260709 12:10:04.567656 11870 rpcz_store.cc:276] 0709 12:10:01.877097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.883676 (+  6579us) service_pool.cc:224] Handling call
0709 12:10:03.409418 (+1525742us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800002798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:03.411095 (+  1677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.446245 (+ 35150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.448728 (+  2483us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.497085 (+ 48357us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.980027 (+482942us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:04.549749 (+569722us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54002f15a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b9ae733 00007f1f1ba33dbf 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c
0709 12:10:04.549840 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.549978 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.550027 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:04.550044 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.550221 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2118,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":19412,"spinlock_wait_cycles":85549184,"thread_start_us":319106,"threads_started":1,"wal-append.queue_time_us":475326}
I20260709 12:10:04.587522 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1148) took 1161 ms. Trace:
I20260709 12:10:04.593822 11866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:55178
I20260709 12:10:04.659791 11866 raft_consensus.cc:606] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:04.660171 11866 raft_consensus.cc:614] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:04.595961 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.537384 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.661610 12018 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.658273 11871 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:04.661267 11867 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:04.666250 11872 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:04.667855 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1146) took 1749 ms. Trace:
I20260709 12:10:04.668408 11865 rpcz_store.cc:276] 0709 12:10:02.918507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.518275 (+599768us) service_pool.cc:224] Handling call
0709 12:10:04.641729 (+1123454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.642076 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.642105 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.642161 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:04.642203 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.642284 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.667629 (+ 25345us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002940d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:04.667780 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":676,"spinlock_wait_cycles":2390326528}
I20260709 12:10:04.670651 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 113) took 4360 ms. Trace:
I20260709 12:10:04.670113 13448 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.672659 11865 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.674273 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49974
I20260709 12:10:04.658821 11873 rpcz_store.cc:276] 0709 12:10:03.426114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.429369 (+  3255us) service_pool.cc:224] Handling call
0709 12:10:04.587270 (+1157901us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400095bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:04.587435 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423193344}
I20260709 12:10:04.677063 11873 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.684224 11867 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.687695 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.690258 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.694222 11867 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.667130 13488 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.697258 11872 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:04.708550 13488 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.710192 13328 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.711457 12603 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.679052 13446 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:04.714133 13446 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.714886 13495 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.716480 13446 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.718591 13285 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.719058 13494 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.720474 12019 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:04.724243 13488 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.728015 13316 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:04.698387 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.736532 11947 raft_consensus.cc:606] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Received request to transfer leadership
I20260709 12:10:04.679859 13448 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:04.704205 13433 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.589872 11944 rpcz_store.cc:276] 0709 12:10:02.973577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.974289 (+   712us) service_pool.cc:224] Handling call
0709 12:10:04.244505 (+1270216us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890eeee 000000000036eb39 00007f1f209821e0 00007f1f20a4b0c4 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:04.244733 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.244984 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:04.275161 (+ 30177us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.515068 (+239907us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.540479 (+ 25411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.542172 (+  1693us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.554806 (+ 12634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.554892 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.555107 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3429,"prepare.queue_time_us":22578,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":45030,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":13245,"spinlock_wait_cycles":148292480,"thread_start_us":140167,"threads_started":1}
I20260709 12:10:04.738672 12020 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:04.744201 12022 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.739710 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.743176 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.671624 11768 rpcz_store.cc:276] 0709 12:10:00.303960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.310663 (+  6703us) service_pool.cc:224] Handling call
0709 12:10:00.401061 (+ 90398us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99d090 00007f1f1ba3bf3a 00007f1f217f1e9c 00007f1f218f004e 00007f1f1fdb12a4 00007f1f1fdb1232 00007f1f1fdb1161 00007f1f1fdb10dc 00007f1f1fdb0392 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:04.663638 (+4262577us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:01.899738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:01.900410 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:01.900446 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:01.900464 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:01.901016 (+   552us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:01.901075 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:01.901106 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:01.901373 (+   267us) tablet.cc:701] Row locks acquired
0709 12:10:01.901407 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:10:01.901598 (+   191us) write_op.cc:270] Start()
0709 12:10:01.901723 (+   125us) write_op.cc:276] Timestamp: P: 1783599001901526 usec, L: 0
0709 12:10:01.901744 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.253229 (+351485us) log.cc:844] Serialized 1295 byte log entry
0709 12:10:03.858038 (+1604809us) op_driver.cc:464] REPLICATION: finished
0709 12:10:03.901318 (+ 43280us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2ee28 00007f1f1f469581 00007f1f1f468d58 00007f1f1f46d9f1 00007f1f1f46d9a9 00007f1f1f46d939 00007f1f1f46d901 00007f1f1f46cb2d 0000000000388634 0000000000388479
0709 12:10:04.089599 (+188281us) write_op.cc:301] APPLY: starting
0709 12:10:04.107016 (+ 17417us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:04.115154 (+  8138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:04.115179 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:04.164235 (+ 49056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:04.181879 (+ 17644us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:04.187072 (+  5193us) write_op.cc:312] APPLY: finished
0709 12:10:04.200378 (+ 13306us) log.cc:844] Serialized 28 byte log entry
0709 12:10:04.221650 (+ 21272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.224428 (+  2778us) write_op.cc:454] Released schema lock
0709 12:10:04.236255 (+ 11827us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:04.270507 (+ 34252us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.270545 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":87955968,"child_traces":[["op",{"apply.queue_time_us":206524,"apply.run_cpu_time_us":3096,"apply.run_wall_time_us":184532,"num_ops":2,"prepare.queue_time_us":314070,"prepare.run_cpu_time_us":33119,"prepare.run_wall_time_us":2008201,"raft.queue_time_us":354489,"raft.run_cpu_time_us":5516,"raft.run_wall_time_us":191173,"replication_time_us":1940163,"spinlock_wait_cycles":104586624,"thread_start_us":1779028,"threads_started":4,"wal-append.queue_time_us":1116984}]]}
I20260709 12:10:04.738957 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.745113 12019 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:04.721328 13494 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:04.752604 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.753080 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.753850 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.755132 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.755707 12015 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.751075 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:04.666163 13420 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.763500 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:04.766927 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 298670us
I20260709 12:10:04.749406 13488 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.768489 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.770056 13331 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:04.762408 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:04.770665 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.771251 13448 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.778405 13488 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:04.782089 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.782976 13587 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.783574 13488 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.776679 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.778498 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:04.775957 13543 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.771682 13329 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:04.774160 13415 consensus_meta.cc:287] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.012s
I20260709 12:10:04.772800 13375 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.793850 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:04.790555 13540 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.524s	user 0.018s	sys 0.031s
I20260709 12:10:04.796425 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.799481 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.785427 13285 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:04.806214 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:04.760040 13539 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.796759 13532 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.800542 13567 raft_consensus.cc:1027] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: attempt to promote peer 189a165e6619406382914fe3075dd436: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:10:04.801400 13543 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.806526 13426 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:04.786155 13528 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.821120 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.793854 13415 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.828078 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:04.798890 13448 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:04.814870 13329 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.842293 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.823953 13491 raft_consensus.cc:1027] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: attempt to promote peer 189a165e6619406382914fe3075dd436: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:10:04.853799 13448 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.852617 11947 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.859726 13448 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:04.864616 13420 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:04.826359 13316 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:04.869393 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.832674 13426 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Service unavailable: leader transfer in progress
I20260709 12:10:04.806943 13540 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:04.872856 12021 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.874261 12014 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:04.842892 13328 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:04.886516 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.887012 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.887485 11944 raft_consensus.cc:2410] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:04.888118 13329 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:04.888067 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60119.7us
I20260709 12:10:04.888809 13329 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.889257 13329 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.889557 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:04.875168 11771 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.877012 11864 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:04.876704 13448 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:04.877599 12609 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 3 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:04.878446 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:04.890450 13514 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:04.878710 12603 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.879549 12610 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:04.872895 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:04.877641 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 170) took 6406 ms. Trace:
I20260709 12:10:04.895262 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.898991 11947 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:04.883011 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1373) took 1031 ms. Trace:
W20260709 12:10:04.877743 13582 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 12:10:04.892947 11771 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 2 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.887036 13426 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:04.904053 12013 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:04.897673 11770 rpcz_store.cc:276] 0709 12:09:58.471247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.481672 (+ 10425us) service_pool.cc:224] Handling call
0709 12:10:04.877573 (+6395901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3,"reported_tablets":13}
I20260709 12:10:04.906117 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:04.903095 11868 rpcz_store.cc:276] 0709 12:10:03.851617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.637874 (+786257us) service_pool.cc:224] Handling call
0709 12:10:04.638217 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.638475 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:04.746682 (+108207us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.882509 (+135827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.882573 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.882635 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.882743 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.882894 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141020,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":73,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6947,"thread_start_us":205845,"threads_started":2}
I20260709 12:10:04.913970 13448 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.890571 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:04.904430 13557 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:10:04.912322 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.916796 13585 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.917268 13585 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:04.900444 13491 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:04.917790 13585 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.900620 13375 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:04.912725 13559 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.901010 13420 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.921456 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:04.924149 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.906394 11771 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.927652 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.930518 11864 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.921406 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.910485 13426 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Service unavailable: leader transfer in progress
I20260709 12:10:04.944464 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.941476 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.945399 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.937155 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.946554 11867 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:04.919852 13434 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:04.933391 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:04.935534 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.072302 11868 raft_consensus.cc:2376] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2. Re-sending same reply.
I20260709 12:10:05.073369 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:04.941336 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:04.941318 11771 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.074651 11864 raft_consensus.cc:2376] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2. Re-sending same reply.
I20260709 12:10:04.953146 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:04.953680 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.063635 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.074368 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:04.926123 13559 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:04.957099 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.956884 11942 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:04.958094 11873 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:04.963018 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 164527us
I20260709 12:10:05.064110 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:04.956835 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:04.954620 13420 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:05.017253 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.934132 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:04.955804 13434 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:04.905160 13514 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:05.078074 11867 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:04.930570 13491 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 12:10:05.076691 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 143353us
I20260709 12:10:05.075371 11771 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.065451 13375 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.100317 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:04.943089 13557 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.088747 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:05.108736 11771 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.110528 11771 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.110860 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.065026 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:05.075412 13482 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.806s	user 0.029s	sys 0.011s
I20260709 12:10:05.113910 13434 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:05.114279 13482 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.094669 11865 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:05.115366 13434 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.116631 13482 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.117735 13415 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:05.119161 13375 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:05.113993 11944 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:05.122519 13420 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.099323 11870 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:05.079156 13589 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:05.129621 13375 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.111603 11868 raft_consensus.cc:2376] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2. Re-sending same reply.
I20260709 12:10:05.129954 13589 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.132334 13589 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.137748 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.138808 11868 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:05.108397 13587 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.142046 12608 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.097467 13338 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:05.142820 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.145561 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.146302 11865 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:05.083503 13567 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.090523 13559 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:05.153617 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53451.1us
I20260709 12:10:05.163053 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.164008 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.170755 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.171430 11941 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.095692 13446 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.177996 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.178941 11942 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.187299 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.188560 11865 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:05.154196 13567 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:05.200945 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:05.206514 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.183836 13435 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.182653 13377 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.196734 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.231408 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.230036 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:05.187405 13528 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.194494 13429 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.239727 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:05.243040 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.218847 13415 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.190117 13585 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:05.204962 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:05.233484 13598 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:10:05.221138 13567 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.231544 13482 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.238111 13377 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:05.314622 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.232625 13435 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.246248 13429 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:05.246166 13543 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:05.323925 11758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 265046us
I20260709 12:10:05.221565 13329 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.359740 11942 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:05.360265 13329 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.247335 13540 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.248895 13285 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.252874 13532 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.295433 13482 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.377767 13482 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:05.379056 13594 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:10:05.321255 13377 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.328933 13429 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:05.387530 13600 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:10:05.364584 13598 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:05.328931 11944 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:05.389681 13593 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:05.257844 13491 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:10:05.329068 13543 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.408726 13567 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.411535 13377 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.412106 13567 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.367704 13514 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:05.414553 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.396238 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49974
W20260709 12:10:05.422358 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 178185us
I20260709 12:10:05.423440 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.424423 13285 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.424893 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.436569 13614 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.437170 13614 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:05.438347 13614 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.414171 13377 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.451745 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.402997 13543 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.453224 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.391548 13435 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:05.458570 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.415340 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:05.469941 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54707.6us
I20260709 12:10:05.461311 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.472858 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.416911 13514 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.483672 13539 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.481626 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.489353 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 98) took 1253 ms. Trace:
I20260709 12:10:05.493992 11873 rpcz_store.cc:276] 0709 12:10:04.236104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.700236 (+464132us) service_pool.cc:224] Handling call
0709 12:10:04.701028 (+   792us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:04.757323 (+ 56295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.757354 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:04.776823 (+ 19469us) log.cc:844] Serialized 590 byte log entry
0709 12:10:04.957958 (+181135us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:05.106627 (+148669us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.428833 (+322206us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.431029 (+  2196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.488859 (+ 57830us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b54003561d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:05.488911 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.489074 (+   163us) raft_consensus.cc:1685] finished
0709 12:10:05.489089 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.489280 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220233,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":25305,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":265,"spinlock_wait_cycles":180608640,"thread_start_us":443442,"threads_started":3,"wal-append.queue_time_us":314484}
I20260709 12:10:05.458155 13614 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.503326 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:05.504868 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 308217us
I20260709 12:10:05.507267 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:05.480348 13494 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.509908 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.461077 13285 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.502336 13514 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.503172 13532 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.509135 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.505964 13539 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.482409 13329 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.482733 13550 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.520972 13532 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:05.512228 13614 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:05.531457 13608 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:10:05.533773 13599 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 12:10:05.502655 13544 consensus_queue.cc:1175] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "189a165e6619406382914fe3075dd436" responder_term: 2 status { last_received { term: 2 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 2 index: 3 } }
W20260709 12:10:05.575132 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.577613 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 415859us
W20260709 12:10:05.578896 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.587286 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 79520.5us
I20260709 12:10:05.513427 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.513751 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:05.594941 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 87787.1us
I20260709 12:10:05.614719 12013 raft_consensus.cc:2410] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:05.532141 13539 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:05.595230 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.619551 12014 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:05.512473 13415 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.620806 13415 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:05.506237 13331 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.543104 13614 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.623215 13415 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.534696 13550 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:05.534111 13532 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.510272 13377 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:10:05.630517 13550 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:05.637070 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.638803 13434 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.639906 13434 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.640236 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.643307 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:05.643720 13434 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.620187 13539 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.662624 13610 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.675799 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.676564 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.676892 11945 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.678264 11948 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.678756 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.680127 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:05.681344 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68470.6us
I20260709 12:10:05.685382 13567 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:05.688246 13567 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.688572 13433 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:05.685366 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 62331.9us
W20260709 12:10:05.691953 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.692941 13377 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.696029 13377 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.689523 13433 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.688879 13567 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.710630 12014 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.711761 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.712730 11947 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.714040 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:05.711005 13433 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.717365 13433 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.719597 13328 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:05.713308 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.706606 11873 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:05.729782 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:05.730146 13328 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.730737 13328 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:05.732108 13328 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:05.739328 11864 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
W20260709 12:10:05.734649 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59700.1us
I20260709 12:10:05.740870 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:05.748814 13514 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.750404 13420 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.740911 13488 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.752660 13488 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:05.753232 13488 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.756534 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.756712 13377 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.758608 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.759404 13377 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.760311 13408 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.762274 13544 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:05.759550 13482 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.773001 13610 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.773583 13610 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.774685 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:05.760509 13578 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.762971 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:05.775143 13482 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.787055 13514 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.764144 13589 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.777105 11945 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:05.798666 13589 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.763540 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:05.801894 11947 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:05.806051 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55960.2us
I20260709 12:10:05.733353 13585 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:05.810206 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 47391.1us
I20260709 12:10:05.800380 13589 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.760027 13435 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.782390 11941 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.013s
I20260709 12:10:05.833861 11941 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:05.834595 13294 raft_consensus.cc:2764] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:05.820983 13426 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.821682 13523 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.828076 13328 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.837119 13585 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.839730 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.844389 13523 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.844928 13523 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.845343 13523 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.848915 13408 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:05.850144 13408 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.850665 13408 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:05.852118 13408 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.846262 13578 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.855086 13434 raft_consensus.cc:2764] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:10:05.856003 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92770.2us
I20260709 12:10:05.856914 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:05.775151 13567 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:05.863965 13415 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:05.865224 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.865500 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.866493 12013 raft_consensus.cc:2368] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:10:05.866673 12020 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:05.867383 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.866508 12021 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:05.869232 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.870083 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:05.871145 12610 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:05.775318 13610 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.874106 13415 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:05.893738 12019 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:05.895814 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.899343 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.899765 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.900542 11867 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:05.901717 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.904042 13434 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.904724 13434 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.905284 13434 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.911597 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.912556 11873 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:05.914095 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.910034 13408 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.923821 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:05.920049 13482 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:05.925256 12020 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:05.925843 12021 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.929291 12017 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.929595 13491 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.930078 13491 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:05.931476 11942 raft_consensus.cc:606] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 12:10:05.931984 11942 raft_consensus.cc:614] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:05.925880 13482 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.934510 13482 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:05.934777 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.935631 13482 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.936167 13482 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:05.937369 13482 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.940649 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.941648 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:05.942130 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.942701 12018 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.943122 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:05.943455 13614 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.944000 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.945112 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.946260 12020 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:05.947199 13415 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.947285 13375 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.947973 13415 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:05.948766 13543 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.949988 12014 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:05.949150 13415 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.951104 13567 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:05.949095 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.942659 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51466.8us
I20260709 12:10:05.931082 13491 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.947372 13614 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:05.963429 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.940707 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:05.946604 13610 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.985594 13429 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.014s
I20260709 12:10:05.986436 11771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 189) took 5216 ms. Trace:
I20260709 12:10:05.986241 13429 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:05.987695 11948 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:05.989187 13429 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:05.986900 11771 rpcz_store.cc:276] 0709 12:10:00.770126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.772920 (+  2794us) service_pool.cc:224] Handling call
0709 12:10:05.986155 (+5213235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.374213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.374979 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.375036 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:05.375058 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:05.376126 (+  1068us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.376227 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.376269 (+    42us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:05.377059 (+   790us) tablet.cc:701] Row locks acquired
0709 12:10:05.377078 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:05.377266 (+   188us) write_op.cc:270] Start()
0709 12:10:05.377409 (+   143us) write_op.cc:276] Timestamp: P: 1783599005377210 usec, L: 0
0709 12:10:05.377433 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.420359 (+ 42926us) log.cc:844] Serialized 2927 byte log entry
0709 12:10:05.548327 (+127968us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.610178 (+ 61851us) write_op.cc:301] APPLY: starting
0709 12:10:05.610531 (+   353us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.611114 (+   583us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.645720 (+ 34606us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.649012 (+  3292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.649409 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:05.649473 (+    64us) write_op.cc:312] APPLY: finished
0709 12:10:05.650094 (+   621us) log.cc:844] Serialized 58 byte log entry
0709 12:10:05.652231 (+  2137us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.652777 (+   546us) write_op.cc:454] Released schema lock
0709 12:10:05.652879 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:05.713836 (+ 60957us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.713872 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142555,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":1311,"apply.run_cpu_time_us":6196,"apply.run_wall_time_us":99882,"num_ops":7,"prepare.queue_time_us":238662,"prepare.run_cpu_time_us":35147,"prepare.run_wall_time_us":155876,"raft.queue_time_us":1163,"raft.run_cpu_time_us":1476,"raft.run_wall_time_us":1475,"replication_time_us":170731,"thread_start_us":322964,"threads_started":4,"wal-append.queue_time_us":123919}]]}
W20260709 12:10:06.004375 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.006158 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:06.019457 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:05.962832 13488 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.013468 13491 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.035076 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:06.035802 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.036831 13543 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:06.035842 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.034392 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:06.041215 13559 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.016s
I20260709 12:10:06.041867 13559 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.043171 11946 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.044235 13559 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:06.035817 11819 auto_rebalancer.cc:893] Removing replace marker failed: Replica 6b7d9b5a12ef4a6cb097df86b95e5bfa is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:10:06.049746 11819 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:10:06.050124 11819 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:10:06.060168 13589 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.019932 11770 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:10:06.061648 11867 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:06.062898 11942 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.062768 11770 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 3, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 3 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.065237 13488 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:06.066175 13643 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:06.066115 13488 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.066953 13488 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.067339 13488 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.030381 13375 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.074503 13375 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:06.075640 13375 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.077678 13434 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.078648 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.072713 13523 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.080197 12611 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:06.065280 11770 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 3, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.102753 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:06.129004 11946 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:06.134950 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:06.139329 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:06.106463 13640 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:06.154229 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:06.152887 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:06.156044 11872 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:06.107936 13523 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:06.159354 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.106199 13488 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.184473 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:06.181949 12016 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:06.192756 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.168280 13488 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:06.195017 13532 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.009s
I20260709 12:10:06.195959 13434 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.197431 13589 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.169776 13415 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.110807 13614 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.202440 13331 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:06.204807 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:06.195636 13532 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.207437 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 188113us
I20260709 12:10:06.162894 13329 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:06.218021 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:06.219605 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:06.222002 12015 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.206656 13415 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:06.225845 12021 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:06.207109 13578 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:06.254037 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:06.255468 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.233496 13655 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:06.266583 13329 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.267051 13329 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:06.267434 13329 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.269099 11947 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.270874 11869 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.271891 13532 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:06.273622 11948 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:06.275710 13645 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 12:10:06.275338 13415 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:06.255566 13610 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:06.265654 13655 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:06.298084 13532 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:06.306145 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:06.310698 13647 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:06.311638 13647 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:06.337666 11948 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:06.298414 13543 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:06.349047 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:06.357441 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 93225.3us
I20260709 12:10:06.338073 13539 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:06.332780 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:06.367486 13482 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.382462 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:06.383275 11866 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:06.383906 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47067.5us
I20260709 12:10:06.385699 13434 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.389305 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:06.391011 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:06.389302 13614 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:06.384826 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:06.393844 13611 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.394690 13611 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.395061 13611 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:06.395097 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:06.395375 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:06.393215 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:06.385056 13539 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.378860 13482 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:06.418023 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.401800 13611 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.402756 13589 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.384706 13647 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:06.434312 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.439278 13652 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.073s	user 0.002s	sys 0.001s
I20260709 12:10:06.439790 13539 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:06.424528 13567 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.384899 13655 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.451470 13488 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:06.451474 11941 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:06.454357 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59189.1us
W20260709 12:10:06.459688 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.459112 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66006.9us
I20260709 12:10:06.475946 13528 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.471911 11946 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:06.489653 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:06.499238 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:06.476642 13528 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:06.507563 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.501556 13375 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.481976 13488 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.536566 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 64121.2us
I20260709 12:10:06.539063 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:06.562143 13528 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.564142 13528 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.543397 13589 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.504307 12603 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:06.575513 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53011.6us
W20260709 12:10:06.604015 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66457.5us
I20260709 12:10:06.623301 13329 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.631398 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.632191 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.636909 11942 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:06.638670 13647 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.639426 13647 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.639917 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:06.641215 11869 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:06.528353 13482 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.619359 13434 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.651041 13434 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:06.652439 13434 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.654966 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 193983us
I20260709 12:10:06.666817 13488 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.671638 11866 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:06.688735 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 68476.8us
I20260709 12:10:06.671240 13482 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:06.702836 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.714496 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94589us
I20260709 12:10:06.738272 13651 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:06.739087 13651 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.739526 13331 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.740027 13331 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:06.740929 13331 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.742178 13331 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.743007 11865 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:06.750241 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.750752 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.751657 13655 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.751978 13578 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.752491 13578 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.754613 13589 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:06.755338 13589 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.757292 13654 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.757200 13630 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:06.757931 13654 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.760927 13654 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:06.762367 12610 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:06.763098 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.763727 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.764828 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:06.741228 13651 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.774638 11945 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:06.686309 13415 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:06.754760 13375 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:06.754663 13578 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:06.787103 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.783246 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53825.7us
I20260709 12:10:06.780159 13375 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:06.790944 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62029us
I20260709 12:10:06.793309 13578 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:06.799360 13654 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.799888 13654 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.805919 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:06.806773 13377 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.807600 13377 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:06.809108 13375 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:06.825169 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:06.826874 13375 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.827006 13377 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:06.828938 13654 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:06.792840 13647 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:06.856314 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.830520 13329 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:06.864764 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.868904 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54460.5us
I20260709 12:10:06.874118 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:06.877647 13646 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:06.884263 13647 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.892702 11945 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:06.896749 13647 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.907371 13647 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.909775 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:06.910655 11943 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:06.913617 11944 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:06.916076 12016 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:06.917044 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:06.917486 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:06.918159 13491 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.918577 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:06.918819 13491 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:06.919937 13491 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:06.927830 13668 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:06.942626 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:06.954242 11945 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:06.950661 13415 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.961998 11943 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.951570 13408 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.958755 13488 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.969625 11914 leader_election.cc:400] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
I20260709 12:10:06.973337 11914 leader_election.cc:403] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:06.977144 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 61931us
I20260709 12:10:06.958993 13667 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:06.983203 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:07.000020 12021 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Received request to transfer leadership
W20260709 12:10:06.991338 13611 consensus_meta.cc:287] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.005s
I20260709 12:10:06.991982 11943 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.968941 13408 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.002251 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:06.976490 13415 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:06.999059 13567 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3.
W20260709 12:10:07.016567 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.003216 13488 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.002307 13408 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.020532 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:07.021320 12021 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Received request to transfer leadership
W20260709 12:10:07.023262 13679 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:10:07.025492 13415 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.030963 13658 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.034118 13329 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.037457 13578 raft_consensus.cc:993] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:10:07.038095 13578 raft_consensus.cc:1081] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:10:07.004807 13434 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:07.041285 13375 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:07.041553 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 86963.7us
I20260709 12:10:07.041966 13375 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:07.043032 13491 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.042989 13375 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.044384 13491 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.044811 13491 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:07.041414 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.042977 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.047654 11945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:49986
I20260709 12:10:07.048418 11945 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:07.048017 13491 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.048676 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 114) took 1696 ms. Trace:
I20260709 12:10:07.048820 11945 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.040041 13647 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.002206 13611 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.070102 13567 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.045310 13375 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.074285 11945 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.076256 11946 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:07.076478 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.070729 13567 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.049165 11770 rpcz_store.cc:276] 0709 12:10:05.351976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.353713 (+  1737us) service_pool.cc:224] Handling call
0709 12:10:07.048584 (+1694871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:06.268658 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:06.269433 (+   775us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:06.269497 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:10:06.269517 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:06.270267 (+   750us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:06.270378 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:06.270413 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:06.270882 (+   469us) tablet.cc:701] Row locks acquired
0709 12:10:06.270942 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:10:06.271134 (+   192us) write_op.cc:270] Start()
0709 12:10:06.271292 (+   158us) write_op.cc:276] Timestamp: P: 1783599006271069 usec, L: 0
0709 12:10:06.271321 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:10:06.272136 (+   815us) log.cc:844] Serialized 1427 byte log entry
0709 12:10:06.386975 (+114839us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.683902 (+296927us) write_op.cc:301] APPLY: starting
0709 12:10:06.685999 (+  2097us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.718428 (+ 32429us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.782044 (+ 63616us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.872926 (+ 90882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.886060 (+ 13134us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:06.896276 (+ 10216us) write_op.cc:312] APPLY: finished
0709 12:10:06.930126 (+ 33850us) log.cc:844] Serialized 34 byte log entry
0709 12:10:06.930324 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.930422 (+    98us) write_op.cc:454] Released schema lock
0709 12:10:06.930463 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.930843 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.930869 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":239,"mutex_wait_us":55828,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":225634,"apply.run_cpu_time_us":3633,"apply.run_wall_time_us":276403,"num_ops":3,"prepare.queue_time_us":120149,"prepare.run_cpu_time_us":3846,"prepare.run_wall_time_us":3846,"replication_time_us":115451,"thread_start_us":170668,"threads_started":2}]]}
W20260709 12:10:07.091884 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49027.1us
I20260709 12:10:07.059536 13589 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:07.097735 11758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 55141.8us
I20260709 12:10:07.097903 13435 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.098912 13435 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.099272 13435 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.100484 13435 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.101104 11945 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.101981 13435 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.104462 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.090224 13567 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.099334 13491 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.126157 12016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:07.130735 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:07.129076 13523 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:07.131516 12610 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.131173 11871 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.099277 13647 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:07.133837 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.142962 13611 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.149562 13630 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.150866 13563 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.151353 13563 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:07.152351 13563 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:07.154248 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.154536 13676 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:07.155236 13563 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.156517 12016 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Received request to transfer leadership
I20260709 12:10:07.158946 13589 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:07.159759 13589 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:07.160313 13589 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.162710 13589 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.163393 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.168028 12610 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.170457 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:07.170746 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.171155 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.173056 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.174997 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.175647 11867 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.176200 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.177428 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.178130 11871 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.178638 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.179317 11869 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.181249 13435 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.181819 13435 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:07.182953 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.177999 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:07.198046 11819 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:10:07.198550 11819 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b93a2cf326204d8e89e4fe76ead348c5 already in progress
W20260709 12:10:07.198896 11819 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b93a2cf326204d8e89e4fe76ead348c5 already in progress
I20260709 12:10:07.203999 11871 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:07.227603 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 102414us
I20260709 12:10:07.180146 13567 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.198931 13435 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:07.234951 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 109673us
I20260709 12:10:07.229064 13491 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.254004 13687 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:10:07.226677 13408 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.271661 13408 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.259415 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:07.264335 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.274204 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.275408 11867 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.278678 11864 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:07.268095 13567 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:07.245357 12577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.054s (SENT) [suppressed 27 similar messages]
I20260709 12:10:07.298517 12608 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:07.294776 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.304966 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 107664us
W20260709 12:10:07.306145 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.308580 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 63301us
W20260709 12:10:07.301396 13663 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:07.315409 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:07.316064 11945 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.247044 13491 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.333864 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.334824 11867 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 2: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:10:07.338555 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 90622.5us
I20260709 12:10:07.310252 11869 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:07.344386 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.359609 12611 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.361588 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.338101 13539 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.368064 11945 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:07.368340 11867 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:07.370414 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:07.389816 13435 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.394326 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:07.394685 11869 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.395169 11943 raft_consensus.cc:606] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:07.396602 11943 raft_consensus.cc:614] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:07.363353 13610 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:07.372749 13539 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.385856 13694 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:07.410064 13694 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.410264 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.410636 13694 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.412185 13694 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.412516 13696 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.413214 13696 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.413827 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.414510 11867 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.414733 11869 raft_consensus.cc:2368] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:07.414999 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.417022 11866 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.417966 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.418684 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:07.423107 13491 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:07.423079 13539 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.423467 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.423014 13658 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.418236 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.425377 11869 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.424830 13658 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:07.426812 11871 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.427896 13658 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.428119 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.428275 13539 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.429491 13539 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:07.430259 13694 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.430722 13696 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.431991 13539 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.432314 13696 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.432628 13539 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:07.433593 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.433338 13539 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.424196 11867 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.424448 11865 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:07.444628 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:07.445225 11946 raft_consensus.cc:606] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.445591 11946 raft_consensus.cc:614] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:07.446866 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.443390 11870 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.449458 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.451879 13408 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:07.453244 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82957.6us
I20260709 12:10:07.483807 13329 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.484488 13329 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.486814 13329 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.487324 13329 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:07.494629 13701 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:07.497217 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:07.541175 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44051.5us
I20260709 12:10:07.541894 13329 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.480271 13415 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.453645 13578 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.543560 13377 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.543984 13415 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.544095 13578 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.545009 13377 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:07.546406 13578 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.504895 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.505503 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:07.547773 11948 raft_consensus.cc:606] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:07.547601 13377 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.548174 11948 raft_consensus.cc:614] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:07.548300 13415 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.506238 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.543632 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.551452 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:07.552093 11948 raft_consensus.cc:606] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.552228 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.515053 13539 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.507570 13408 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.516062 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.524544 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.524611 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.555192 13377 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.525246 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.555742 13377 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.556167 13377 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.556327 11871 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:07.556936 13329 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.557969 13408 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.526057 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:07.558346 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.526595 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.558812 11869 raft_consensus.cc:2376] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3. Re-sending same reply.
I20260709 12:10:07.527628 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.528882 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:07.559868 11866 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.529443 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.560938 13408 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.561101 11865 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.504434 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.562289 11944 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.506316 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.525820 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.563014 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:07.563439 11946 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:07.563541 11870 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3. Re-sending same reply.
I20260709 12:10:07.563777 11940 raft_consensus.cc:606] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.564837 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.564990 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.565785 11940 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.565968 11946 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:07.566185 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.566877 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.567168 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.567442 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.568179 11942 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:07.568293 13694 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.569024 13694 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.569375 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:07.570158 13694 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.571400 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:07.572758 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:07.572757 13614 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.577131 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:07.586024 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.586769 13614 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.589648 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.589944 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.590309 12013 raft_consensus.cc:2376] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4. Re-sending same reply.
I20260709 12:10:07.590629 12015 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:07.578588 11870 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.591243 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.592044 12014 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:07.580128 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.593353 11865 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.581156 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.584002 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.584527 13647 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.617475 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.621349 12016 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:07.625239 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.625527 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.625985 11866 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.626335 12016 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.632179 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.632875 12013 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:07.634137 12015 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:07.624883 13647 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.637739 12015 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:07.638718 13647 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.627578 11869 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.644482 11865 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:07.649483 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.651474 11865 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:07.652853 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.653789 11871 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:07.654935 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.655026 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.655838 12017 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.656487 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.661404 13491 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.657145 12020 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:07.662274 13491 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.661463 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.625867 13611 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.670939 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.671324 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:07.672019 11872 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.673568 11871 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.674875 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.675410 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.675892 12017 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.676004 12013 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.676862 12013 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:07.679556 12016 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.677695 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:07.681756 11870 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.685181 13377 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.686858 12021 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.690611 13491 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:07.692613 11866 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.681295 12013 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.694875 12013 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.687685 13377 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:07.710520 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:07.710909 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.671067 13611 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.696569 11872 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.697358 11943 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:07.707280 13614 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:07.707849 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.714843 11770 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 3, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:07.716295 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.712538 13611 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.713727 13630 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.717875 13611 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.717774 13630 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.716511 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.720424 13630 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.719792 11770 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:07.724401 12017 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:07.722111 13647 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.726502 13647 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:07.728945 13647 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:07.733381 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.722049 13377 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.741678 12013 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.743244 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.747685 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:07.749756 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.751794 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.752502 12611 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.754123 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.754907 12608 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:07.761005 13491 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:07.764074 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.765590 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.767282 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:07.774322 11839 connection.cc:256] RPC call timeout handler was delayed by -2.3765705960001924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:10:07.774982 11839 connection.cc:256] RPC call timeout handler was delayed by -2.3711705960001837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:10:07.775349 11839 connection.cc:256] RPC call timeout handler was delayed by -2.3108705960000862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 12:10:07.789273 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:07.794492 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47313.2us
I20260709 12:10:07.794551 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.795531 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:07.796487 12022 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:07.759516 13435 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.799391 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.759217 13377 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:07.801285 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.808919 12020 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.803061 13647 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:07.791178 13704 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:07.805473 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.805986 13693 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.807013 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.757984 13669 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:07.788252 13491 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.804831 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.768443 13614 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.807829 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:07.822018 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.814571 13491 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.823802 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.824626 12017 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:07.825241 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.831281 12022 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:07.811177 13647 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.837025 13377 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:07.845907 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50518us
I20260709 12:10:07.846959 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:07.847972 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.843384 13614 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.852484 12020 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:07.854034 13614 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:07.832165 13539 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.858098 13539 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.823325 13491 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.860960 12020 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.863160 11869 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:07.881629 13703 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.844782 13647 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.892352 13539 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:07.895619 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.896220 12610 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.898307 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.899047 12020 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:07.901065 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:07.901592 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.903286 13578 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.903959 13578 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.909106 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:07.909649 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.909888 12020 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:07.911288 13658 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.911821 13658 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:07.914302 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 43619.6us
I20260709 12:10:07.915922 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.917925 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.919647 11945 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:07.920300 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:07.912792 13658 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:07.924177 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:07.919592 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 72772.7us
I20260709 12:10:07.928165 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:07.944073 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:07.949168 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.955567 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.956585 13539 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.957022 13539 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.957381 13539 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.957648 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:07.959167 13669 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.960907 13408 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.970465 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:07.943046 13693 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.967061 13408 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:07.968964 13415 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:07.984063 13408 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.974907 13696 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.975384 13693 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:07.985117 13415 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.018501 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 54702.5us
W20260709 12:10:08.019416 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 243417us
I20260709 12:10:08.019568 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.002363 13693 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.025197 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.020853 13415 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.019636 13578 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:08.044885 13654 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.041065 13329 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:08.085274 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 141319us
I20260709 12:10:08.086777 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:08.099609 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 140851us
I20260709 12:10:08.048287 13647 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.100668 13491 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.103821 11948 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:08.106230 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:08.106994 12608 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:08.109249 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.110435 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.121021 12608 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:08.123474 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.111657 13491 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:08.133028 11839 connection.cc:256] RPC call timeout handler was delayed by -2.284770596000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:10:08.133642 11839 connection.cc:256] RPC call timeout handler was delayed by -2.2577705960000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 12:10:08.133955 11839 connection.cc:256] RPC call timeout handler was delayed by -2.2334705960001884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:10:08.134259 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1488705960000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:10:08.134546 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1335838770000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:10:08.134814 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1281705960000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:10:08.135107 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1074838770000497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:10:08.135380 11839 connection.cc:256] RPC call timeout handler was delayed by -2.0543705960001262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 12:10:08.135655 11839 connection.cc:256] RPC call timeout handler was delayed by -2.04447059600011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:10:08.135897 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:08.135926 11839 connection.cc:256] RPC call timeout handler was delayed by -2.0129705960000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 12:10:08.111136 13722 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:08.136874 11839 connection.cc:256] RPC call timeout handler was delayed by -1.9724705960002211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
I20260709 12:10:08.115533 13329 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:08.145490 11839 connection.cc:256] RPC call timeout handler was delayed by -1.601683876999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:10:08.146222 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:08.150213 11839 connection.cc:256] RPC call timeout handler was delayed by -1.294075969000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:10:08.150633 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2443705960001807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30760000000000004s for a response
W20260709 12:10:08.150985 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1756772170001568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:10:08.151330 11839 connection.cc:256] RPC call timeout handler was delayed by -1.114902696000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 12:10:08.151695 11839 connection.cc:256] RPC call timeout handler was delayed by -1.105002696000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:10:08.152076 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0164793300000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 12:10:08.158587 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:08.159318 11942 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:08.159860 13415 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:08.160733 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.161631 12017 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:08.137742 13614 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:08.170962 13415 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:08.176283 13693 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.124567 13435 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:08.178733 13693 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:08.180464 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.152s (SENT)
I20260709 12:10:08.180918 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.183269 13415 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.184932 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:08.185806 13491 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.186362 13491 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.182646 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.187376 13491 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.188334 13415 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.189141 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.137343 13696 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.194979 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.192535 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.209671 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:08.213932 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:08.215060 13667 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.208338 13614 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.226395 11988 leader_election.cc:400] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:08.228622 11988 leader_election.cc:403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.215399 13329 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.218760 13696 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.235908 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.239742 13415 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.225082 13377 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:08.241935 13724 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:08.226991 13693 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.211056 13539 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.246546 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.210222 13408 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:08.261289 13658 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.261811 13658 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:08.262667 13658 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.261658 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.263953 13724 raft_consensus.cc:2764] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:08.267498 13724 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.270404 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:08.271725 13614 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.272398 13614 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:08.231160 13667 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:10:08.275352 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.276063 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45458.7us
I20260709 12:10:08.138535 13630 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:08.290344 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 137530us
I20260709 12:10:08.292038 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:08.292692 12608 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.303138 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.250449 13720 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:08.287230 13647 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.318455 12608 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:08.321135 13694 raft_consensus.cc:993] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:08.321825 13694 raft_consensus.cc:1081] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:08.324910 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:08.333135 13539 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:08.335614 13647 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.338581 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:08.314060 13578 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.294543 13667 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:08.353178 13578 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.354718 13730 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.351815 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.315762 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.356043 13647 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.282518 13614 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.362736 13721 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.372157 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 80605.9us
I20260709 12:10:08.307000 13696 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.356065 13578 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.335793 13658 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.378557 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.380731 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.384114 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.373584 11944 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.356154 13730 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:08.390733 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.394686 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:08.396008 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71212.9us
I20260709 12:10:08.401660 11872 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.406021 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:08.406426 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:08.406965 11866 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.407249 11873 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.407809 11873 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.410036 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:08.411092 11871 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:08.411923 11864 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.413717 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.416764 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:08.386413 13703 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.424562 11873 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.390164 13647 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:08.386883 13732 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.437608 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:08.396520 13611 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.438670 12017 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:08.377450 13721 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.392652 13730 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.445468 13726 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:10:08.447454 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.427325 13491 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.413424 13694 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.386209 13693 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:08.439538 13740 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:08.439347 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:08.433909 13703 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.439910 13408 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:08.465889 13703 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.452585 11873 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.466923 13647 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.443068 13732 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.460345 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:08.471143 12608 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.460911 13708 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:08.460968 13722 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:10:08.456549 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 147598us
I20260709 12:10:08.492431 11866 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:08.495155 12610 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.487005 12608 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
W20260709 12:10:08.498469 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 93564.5us
I20260709 12:10:08.504688 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:08.507354 12608 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.509433 11872 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:08.471271 13491 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.485675 13732 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:08.564036 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 150526us
I20260709 12:10:08.565857 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:08.566705 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.557472 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58290.1us
I20260709 12:10:08.571197 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:08.573454 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:08.579468 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.582070 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.582876 11942 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.553720 13611 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.586233 13611 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.472154 13740 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.666930 13752 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.668610 13740 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.612046 13694 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.669510 13740 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.669615 13491 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:08.669728 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52558us
I20260709 12:10:08.502198 13708 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.613801 13658 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:08.693672 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 127917us
W20260709 12:10:08.691349 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 140865us
W20260709 12:10:08.671473 13738 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:08.699975 13721 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:08.700863 13748 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:08.701249 13647 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:08.670578 13750 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.670274 13757 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.703233 13708 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.707922 11839 leader_election.cc:400] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:10:08.672739 13747 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.718155 13746 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.718608 13746 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.719475 13746 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.720516 13746 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.710377 11839 leader_election.cc:403] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.729197 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:08.715325 11944 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:08.731501 13578 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.732034 13733 raft_consensus.cc:2764] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:08.733803 13752 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.734366 13752 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.736743 13752 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.714984 13734 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:08.737370 13750 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.738934 13724 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.739406 13724 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:08.739171 13750 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.740293 13724 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.747574 11942 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:08.759611 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:08.706189 13658 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:08.768970 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64872us
I20260709 12:10:08.771193 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.750347 13754 raft_consensus.cc:2764] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:08.774600 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92689.3us
I20260709 12:10:08.744342 13757 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:08.674914 13694 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.783879 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.785104 13578 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:08.757093 13724 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.757740 13708 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.710888 13647 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.797811 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:08.798187 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.779774 13740 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3.
I20260709 12:10:08.799714 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.801975 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.804190 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.757078 13758 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:08.781334 13658 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.841001 13658 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.831068 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.804080 13630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36802 (request call id 0) took 1442 ms. Trace:
I20260709 12:10:08.843400 13630 rpcz_store.cc:276] 0709 12:10:07.357615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.357755 (+   140us) service_pool.cc:224] Handling call
0709 12:10:07.369238 (+ 11483us) log.cc:844] Serialized 501 byte log entry
0709 12:10:07.701973 (+332735us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b180033da80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1b98cb0b 00007f1f1ba11b63 00007f1f1ba39752 00007f1f1ba319fa
0709 12:10:08.795276 (+1093303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":297726,"raft.queue_time_us":302367,"raft.run_cpu_time_us":1752,"raft.run_wall_time_us":4925,"spinlock_wait_cycles":3865856,"thread_start_us":29862,"threads_started":1,"wal-append.queue_time_us":73898,"wal-append.run_cpu_time_us":2243,"wal-append.run_wall_time_us":1098688}
I20260709 12:10:08.844887 13757 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.833288 13762 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.834002 13751 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:08.847512 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.808409 13614 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.827958 13667 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.800789 13708 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.856992 13747 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.857729 13614 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:08.870337 13667 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:08.898242 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 101853us
I20260709 12:10:08.879802 13722 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.889389 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:08.904553 11946 raft_consensus.cc:2955] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:08.912557 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.913158 11942 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.913195 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:08.901633 13722 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:08.915923 11948 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:08.872604 13703 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:08.904140 13758 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.919407 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.920162 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:08.920800 11942 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.922080 11756 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e361e6345864efa81f207f2a9dafda0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:08.922181 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:08.927466 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:08.926997 13758 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.944355 11945 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:08.942672 13667 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.947233 13776 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.953083 13776 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.954115 11942 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:08.955019 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.954671 13722 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.955405 13776 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.956449 13747 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.929327 13614 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:08.958077 13769 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.186s	user 0.000s	sys 0.003s
I20260709 12:10:08.961632 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.964607 13722 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.965763 13732 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:08.966363 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:08.967078 11939 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:08.967769 13743 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:08.970427 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.928059 13647 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.986315 12603 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.986824 13732 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.986919 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:08.987934 11870 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:08.976904 13747 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.990464 13751 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:08.991032 13751 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:08.991950 13703 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.993963 13751 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:08.994634 13654 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.994748 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:08.995111 13758 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:08.998281 13708 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.010461 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.011507 12017 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:09.026535 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.028338 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:08.978185 13408 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.031821 13747 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.041450 13408 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:09.037839 13751 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.042641 13408 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.049911 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.051090 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:09.051867 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.052174 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:09.053063 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:09.053959 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:09.054158 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.054910 11944 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:09.055567 11941 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.055968 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:09.056737 11943 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:09.057616 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.058197 12608 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:09.059481 12017 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:09.060385 12015 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.060870 12016 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.059309 11868 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.062247 12610 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:09.049173 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.065164 11868 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:09.065346 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.066013 12020 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:09.066001 11948 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:09.058228 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.068018 12015 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.068274 11865 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:09.069093 12017 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:09.069602 12017 pending_rounds.cc:85] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 1
W20260709 12:10:09.071956 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 43691us
I20260709 12:10:09.063923 12021 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:09.076355 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:09.077021 12014 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.069160 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.078424 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:09.079006 12015 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.081995 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.082599 12020 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:09.083877 12016 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:09.069825 12017 pending_rounds.cc:107] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:09.085321 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.086601 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:08.976214 13730 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:09.088577 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.085280 12017 raft_consensus.cc:2889] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.091557 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:09.102010 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:09.102762 11865 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.103749 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.104409 11872 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:09.091926 12022 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:09.106992 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:09.113651 11870 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.114579 13730 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:09.117642 13757 raft_consensus.cc:2764] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:09.119725 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:09.120471 11869 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.081198 13722 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:09.104028 13491 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.124977 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:09.109442 13758 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:09.128499 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 115) took 1787 ms. Trace:
I20260709 12:10:09.128947 12603 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.129699 13724 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.982764 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.130219 13724 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.131174 13614 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.132905 13724 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:09.138132 11771 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.140316 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.140260 11771 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.140182 12014 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:09.144421 11771 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.146510 12015 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:09.146739 11771 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.149340 11771 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.157040 11771 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.159255 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.161783 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.160044 11771 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 3, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:09.168718 11947 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:09.170889 13749 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:09.171787 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.163656 13722 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:09.166627 11771 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:09.184321 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 81729.1us
I20260709 12:10:09.154448 13747 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.170961 11865 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:09.146206 13733 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.154691 13751 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.179776 11869 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:09.190235 12014 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.194031 11988 leader_election.cc:400] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:09.195482 11988 leader_election.cc:403] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.200611 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:09.201014 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.197690 11865 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:09.196931 13757 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.184608 13611 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.128888 11770 rpcz_store.cc:276] 0709 12:10:07.386164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.386687 (+   523us) service_pool.cc:224] Handling call
0709 12:10:09.128426 (+1741739us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:07.937186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:07.938120 (+   934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:07.938162 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:10:07.938184 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:07.938902 (+   718us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:07.945206 (+  6304us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:07.949041 (+  3835us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:07.997673 (+ 48632us) tablet.cc:701] Row locks acquired
0709 12:10:07.998658 (+   985us) write_op.cc:260] PREPARE: finished
0709 12:10:08.091556 (+ 92898us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b2c00000448. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33ba0a 00007f1f1a33b693 00007f1f1a33b631 00007f1f1ba6e902 00007f1f1ba6e6dd 00007f1f1f469243 00007f1f1f468d58 00007f1f1f46d9f1 00007f1f1f46d9a9 00007f1f1f46d939
0709 12:10:08.091650 (+    94us) write_op.cc:270] Start()
0709 12:10:08.093741 (+  2091us) write_op.cc:276] Timestamp: P: 1783599008019511 usec, L: 0
0709 12:10:08.093785 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:10:08.094496 (+   711us) log.cc:844] Serialized 1365 byte log entry
0709 12:10:08.387590 (+293094us) op_driver.cc:464] REPLICATION: finished
0709 12:10:08.670743 (+283153us) write_op.cc:301] APPLY: starting
0709 12:10:08.670847 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:08.671003 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:08.671024 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:08.671498 (+   474us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:08.671660 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:08.671709 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:08.671920 (+   211us) log.cc:844] Serialized 35 byte log entry
0709 12:10:08.672080 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.672171 (+    91us) write_op.cc:454] Released schema lock
0709 12:10:08.672217 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:08.843073 (+170856us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54003c4c00. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1f39d161 00007f1f1f47233d 00007f1f1f46b3c2 00007f1f1f46ab53 00007f1f1f46ed61 00007f1f1f46ed19 00007f1f1f46eca9 00007f1f1f46ec71 00007f1f1f46de9d 0000000000388634 0000000000388479
0709 12:10:08.843364 (+   291us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.843390 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":282873,"apply.run_cpu_time_us":5241,"apply.run_wall_time_us":172586,"num_ops":3,"prepare.queue_time_us":208220,"prepare.run_cpu_time_us":16310,"prepare.run_wall_time_us":188017,"raft.queue_time_us":62714,"raft.run_cpu_time_us":29571,"raft.run_wall_time_us":226143,"replication_time_us":293643,"spinlock_wait_cycles":29588096,"thread_start_us":472873,"threads_started":4,"wal-append.queue_time_us":140305}]]}
I20260709 12:10:09.202651 11868 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:09.206871 11869 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:09.221707 11988 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.698s (SENT)
W20260709 12:10:09.209868 13775 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:10:09.230273 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.202430 13730 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.230602 13732 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:09.233681 13751 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.239606 11939 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:09.213213 13611 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.251745 13611 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.211001 13764 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.227660 13733 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:09.222817 13722 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:09.207415 13754 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:09.205669 13408 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:09.249671 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.259256 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.270020 11839 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.286535 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:09.254626 13764 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:09.311404 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52286.6us
I20260709 12:10:09.312280 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.314316 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:09.285511 13751 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.324025 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:09.325261 12577 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.014s (SENT)
I20260709 12:10:09.310969 13730 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.326422 13730 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:09.326853 13730 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.327229 13768 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.551s	user 0.005s	sys 0.000s
I20260709 12:10:09.329195 13740 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.340204 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:09.296557 13757 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.306969 13764 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.348026 11839 leader_election.cc:400] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:09.348430 11839 leader_election.cc:403] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.318444 13491 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.324200 13693 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.361931 11839 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:09.381811 11839 leader_election.cc:403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:09.372426 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60224.7us
I20260709 12:10:09.323939 13762 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.339700 13703 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.383483 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:09.395612 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70370.7us
W20260709 12:10:09.400537 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.054s (SENT)
I20260709 12:10:09.405871 13757 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.408571 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.890s (SENT)
I20260709 12:10:09.409864 13703 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.412616 13703 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.409233 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:09.418853 13795 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:09.362612 13491 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:09.378051 13664 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.378523 13747 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:09.383486 13750 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.394289 13693 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.427390 12611 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.396052 13762 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:09.445849 11988 leader_election.cc:336] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.735s (SENT)
I20260709 12:10:09.383237 13740 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:09.422626 13746 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:09.460819 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 99121.8us
I20260709 12:10:09.465358 11839 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.466629 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.467990 11945 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.430831 13667 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.468556 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:09.440060 13693 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.470141 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:09.475404 11869 raft_consensus.cc:2376] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4. Re-sending same reply.
I20260709 12:10:09.470407 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.471820 11867 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:09.477766 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49170us
I20260709 12:10:09.454543 13762 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.487171 13740 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.511766 11868 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:09.512231 12014 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.514159 12021 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:09.477656 13750 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:09.524703 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.527506 11869 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:09.528937 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.529687 11869 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:09.488019 13746 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:09.542415 11865 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:09.539253 13754 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.539903 13765 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.540108 11870 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.540023 13764 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.544205 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:09.501399 13740 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:09.547919 11868 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.542836 11865 pending_rounds.cc:85] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 1
I20260709 12:10:09.559756 11865 pending_rounds.cc:107] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:09.560178 11865 raft_consensus.cc:2889] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.499650 13752 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:09.564926 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.550280 13743 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.575477 12017 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:09.583094 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.589376 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.502466 13491 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:09.592392 13759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.001s	sys 0.027s
I20260709 12:10:09.599918 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.612283 11942 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.553678 13765 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.621131 12016 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.567088 13703 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:10:09.631315 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.129s (SENT)
I20260709 12:10:09.632968 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:09.633698 11945 raft_consensus.cc:606] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:09.606272 13759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.027s
I20260709 12:10:09.597704 13797 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.599382 13773 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.587088 13743 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.625168 13408 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:09.647758 13797 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.685222 12017 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:09.685192 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 81795.1us
I20260709 12:10:09.598481 13750 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.661830 13757 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:09.669720 13758 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:09.687203 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 83322.5us
I20260709 12:10:09.664131 13669 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:09.646620 13740 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.698414 13758 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.710855 13765 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.715386 12608 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.637526 13746 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:10:09.715942 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 126709us
I20260709 12:10:09.721060 12608 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:09.747517 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:09.751413 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:09.752560 12021 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
W20260709 12:10:09.765604 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.701052 13798 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:09.781212 12015 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.718070 13758 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.783005 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:09.783562 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 179240us
I20260709 12:10:09.687152 13797 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:09.808894 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 209002us
I20260709 12:10:09.810197 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:09.771256 13647 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:09.795360 13764 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.785487 13703 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:09.822389 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:09.802075 13757 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.824905 13809 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:09.832165 13743 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:09.834733 13803 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:10:09.845970 13730 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.008s
I20260709 12:10:09.877414 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:09.883517 11939 raft_consensus.cc:606] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:09.857147 13734 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:09.886016 13491 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.871930 13730 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.894786 13820 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.903764 13730 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.906554 13762 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.906967 13693 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.907793 11873 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:09.909322 13762 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:09.914734 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92465.1us
W20260709 12:10:09.919448 13611 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.000s
I20260709 12:10:09.920322 13611 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.924183 13758 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.926750 13611 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.931368 13758 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:09.944275 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45939.1us
I20260709 12:10:09.914728 13654 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.954768 13654 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.957371 13797 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:09.958650 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:09.964838 13654 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:09.952986 13693 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:09.981312 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:09.982141 11939 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:09.982520 11939 raft_consensus.cc:614] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.995699 13751 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.996236 13751 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:09.999523 13751 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:09.996946 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:09.985394 13693 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:10.009018 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.009262 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.009969 11946 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:10.010825 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.011016 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:10.011394 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.011678 11942 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:10.012557 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:10.013391 11948 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.019734 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.022580 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.023277 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.023277 11872 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.023522 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.024212 11870 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.024971 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:10.028038 11944 pending_rounds.cc:85] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 1
I20260709 12:10:10.028409 11944 pending_rounds.cc:107] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:10.028676 11944 raft_consensus.cc:2889] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.994411 13694 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:10.034200 11941 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:10.029901 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.035789 11866 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.005580 13734 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.008517 13751 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.052333 11872 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:10.055063 11870 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:10.069602 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:10.070585 12015 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.025182 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:10.046610 13734 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:10.066824 13830 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
W20260709 12:10:10.086476 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67262.6us
I20260709 12:10:10.088667 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:10.089365 12022 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.087423 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:10.090370 12017 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.076881 13539 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.100034 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:10.104943 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:10.105849 12020 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.089408 13734 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.114236 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:10.127883 11866 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:10.115702 13758 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.092406 11939 raft_consensus.cc:606] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:10.133986 12022 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:10.130066 12015 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:10.135880 12017 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:10.139143 12020 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:10.133695 13694 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:10.157259 13694 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:10.143682 13703 raft_consensus.cc:993] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:10:10.158290 13703 raft_consensus.cc:1081] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:10:10.158255 13694 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.115144 13539 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.162204 13539 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:10.140995 13819 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:10.156291 13825 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.171072 13811 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.171682 13811 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:10.172150 13811 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.144753 13758 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:10.190101 13758 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:10.193284 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 88642.3us
W20260709 12:10:10.236796 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 91499us
W20260709 12:10:10.237555 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 427381us
I20260709 12:10:10.245344 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.248600 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.251309 12018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:10:10.252161 12018 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:10.252615 12018 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.255389 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:10.256420 13740 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.257468 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.260036 13839 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.254235 13647 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.268625 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.272179 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.275107 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.276893 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:10.268415 13539 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.273554 13809 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.273749 13839 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.280916 13740 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.336807 13809 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:10.337924 13809 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.334430 13693 raft_consensus.cc:993] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:10.343557 13693 raft_consensus.cc:1081] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:10.294299 13825 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.347090 13825 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:10.348021 13825 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:10.356721 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.363094 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.365000 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.361059 12018 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:10.377977 13664 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.378394 13664 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:10.379249 13664 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:10.380458 13664 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.383713 12015 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:10.383492 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:10.384768 13839 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.385322 13809 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:10.386169 11988 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.207s (SENT)
I20260709 12:10:10.386638 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.388229 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.388863 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:10.389412 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:10.389716 13724 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.390007 12013 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.391645 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.394114 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.401273 11867 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.406987 13654 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.414053 11872 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:10.416795 13724 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:10.417397 13724 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.420123 11867 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.423228 12013 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:10.426563 13724 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:10.424996 13806 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:10.424962 13842 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:10:10.428330 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.428887 13761 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:10.429807 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.371050 13751 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.370085 13747 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.442340 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:10.439514 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.443056 11870 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:10.328120 13539 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.443476 11870 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.459242 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.449790 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.462667 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.450155 11871 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:10.468335 12018 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:10.471987 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.489117 11864 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:10.492544 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.374599 13740 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:10:10.490981 12017 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:10.500891 13804 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:10:10.506336 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.519488 13809 raft_consensus.cc:993] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:10.526286 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.526939 11869 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.527185 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.527788 11946 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:10.525091 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:10.549492 13809 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:10.469326 13751 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:10.520804 13811 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.568012 13539 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:10.552884 11870 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.550282 13809 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.606156 11868 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.606340 13809 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:10.608482 11870 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:10.608386 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:10.609509 13740 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.610071 13740 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:10.611028 13747 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.611627 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.612838 13811 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:10.614822 13811 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.611057 13740 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.618012 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.618707 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.619711 11868 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:10.620790 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.628104 11868 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:10.543145 13733 raft_consensus.cc:1081] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:10.630851 11869 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:10.613312 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.651986 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.653663 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.654071 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.661218 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.655413 11870 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:10.665931 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:10.668385 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.668713 13811 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:10.669775 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.670356 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.670197 13751 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.671839 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.672708 11872 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:10.669788 12611 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 2 LEARNER]: Advancing to term 4
W20260709 12:10:10.674319 13844 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:10.680338 11941 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:10.681354 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.682215 11872 raft_consensus.cc:2376] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4. Re-sending same reply.
I20260709 12:10:10.685778 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.689867 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.691103 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.691697 11868 raft_consensus.cc:2376] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6. Re-sending same reply.
I20260709 12:10:10.693163 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.694376 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.631552 13734 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.698401 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.701301 11868 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:10.698882 12611 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.718743 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:10.726742 11870 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:10.702028 11869 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.726064 11941 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:10.725096 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:10.697950 13762 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.658177 13839 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:10.759346 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:10.651087 13765 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:10.742568 13835 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.762027 13764 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.768149 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:10.765564 13435 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:10.790777 13747 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.830029 11944 raft_consensus.cc:2368] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:10.831491 11870 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.789239 13647 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.842108 11870 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:10.835081 13435 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.793150 13835 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.854666 11870 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:10.848383 13838 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:10:10.857234 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 258934us
I20260709 12:10:10.866631 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:10.795455 13764 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.871634 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:10.920297 11871 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:10.859275 11870 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.874212 13837 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:10.876668 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.887673 12014 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.925927 13837 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.888818 12016 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.928957 13837 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:10.889382 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.891494 12018 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.889390 13671 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.930943 11871 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.932916 11871 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:10.914017 11839 leader_election.cc:400] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:10.933553 11839 leader_election.cc:403] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:10.934602 13762 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.893970 11864 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.939298 13761 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.941749 11871 pending_rounds.cc:85] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
I20260709 12:10:10.942204 11871 pending_rounds.cc:107] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:10.944231 11871 raft_consensus.cc:2889] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:10.945926 12015 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.946872 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:10.947443 12611 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.942659 13761 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.952772 11864 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:10.909711 12022 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.018s
W20260709 12:10:10.956703 12022 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.018s
I20260709 12:10:10.956833 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:10.898530 13776 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:10.909803 13806 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.853832 13435 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:10.980948 12611 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:10.966354 13734 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:10.917868 13664 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:10:10.999082 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.017s	sys 0.012s
I20260709 12:10:10.969107 13776 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:11.005836 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.017s	sys 0.012s
W20260709 12:10:10.991483 13491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.022s	sys 0.028s
I20260709 12:10:11.001000 11870 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:11.022883 11870 pending_rounds.cc:85] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
I20260709 12:10:11.023315 11870 pending_rounds.cc:107] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 12:10:10.999496 13825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.005s	sys 0.034s
I20260709 12:10:11.023663 11870 raft_consensus.cc:2889] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.047662 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:11.051342 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:11.054733 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:10.995548 13823 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:10.992514 13806 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:11.026947 13491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.022s	sys 0.028s
I20260709 12:10:11.081948 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:11.076252 13825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.005s	sys 0.035s
W20260709 12:10:11.078884 13757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:11.060405 13839 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:11.061197 13740 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.060631 13811 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.147003 11941 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.078999 13754 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.081288 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.112143 13820 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.154348 13839 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.160292 13751 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.163300 13740 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:11.166800 13835 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.163130 13754 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.205435 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:11.207015 11873 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.183116 13764 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.207566 11873 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.151111 13776 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.198865 13762 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:11.163790 13820 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:11.250274 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 264385us
W20260709 12:10:11.269299 13860 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:10:11.199867 13740 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:11.281980 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 176872us
W20260709 12:10:11.282896 11988 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.743s (SENT)
I20260709 12:10:11.283442 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.230619 13435 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:11.272373 13859 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:10:11.296881 11873 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:11.298898 13776 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.231356 13611 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:10:11.316483 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.294615 13751 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.317473 11867 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:11.323719 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:11.326041 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.327980 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45129.5us
I20260709 12:10:11.331485 11873 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:11.334380 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:11.335459 12608 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.309921 13806 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:11.331048 13865 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
I20260709 12:10:11.329437 13751 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.363471 13751 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.364985 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1470) took 1632 ms. Trace:
I20260709 12:10:11.365427 11865 rpcz_store.cc:276] 0709 12:10:09.733025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.735694 (+  2669us) service_pool.cc:224] Handling call
0709 12:10:09.736111 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.750003 (+ 13892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.750056 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.750773 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.421251 (+670478us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b1800364060. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:10.776993 (+355742us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:10.777103 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.777219 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.364546 (+587327us) raft_consensus.cc:1685] finished
0709 12:10:11.364577 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.364857 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364286,"raft.queue_time_us":46416,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":14416,"spinlock_wait_cycles":6351616,"thread_start_us":355494,"threads_started":1,"wal-append.queue_time_us":1226859}
I20260709 12:10:11.392925 13837 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.393594 13837 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:11.394672 13837 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:11.396363 13837 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.403146 11946 raft_consensus.cc:606] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:11.330614 13861 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:11.350306 13868 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:10:11.351233 13877 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:10:11.424037 13854 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 12:10:11.358012 13839 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:11.340641 11988 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.181s (SENT)
I20260709 12:10:11.440881 12608 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:11.354389 13820 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.375697 13754 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.466876 13761 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:10:11.467487 13761 raft_consensus.cc:1068] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:11.458482 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 117875us
W20260709 12:10:11.460585 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 251901us
I20260709 12:10:11.483723 11867 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:11.487166 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.490041 13743 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.479799 13861 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:11.537508 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:11.538360 11943 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.538722 11943 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:11.539624 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59730.6us
I20260709 12:10:11.540609 11988 leader_election.cc:400] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:11.540714 11943 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.540973 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:11.541703 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.541998 11941 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
W20260709 12:10:11.542222 13878 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:11.542804 13861 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.544118 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.546118 13861 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.546857 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:11.547580 12019 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.549430 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.552162 13861 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.552364 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1237) took 1027 ms. Trace:
I20260709 12:10:11.552867 11868 rpcz_store.cc:276] 0709 12:10:10.525526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.719808 (+194282us) service_pool.cc:224] Handling call
0709 12:10:10.720173 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.129753 (+409580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.129810 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.130509 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.428005 (+297496us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:11.455993 (+ 27988us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.479121 (+ 23128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.479205 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.552086 (+ 72881us) raft_consensus.cc:1685] finished
0709 12:10:11.552119 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.552289 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22064,"prepare.queue_time_us":26272,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":44099,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"spinlock_wait_cycles":11860864,"thread_start_us":620072,"threads_started":2,"wal-append.queue_time_us":346175}
I20260709 12:10:11.555485 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.529013 13740 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.559250 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.564175 12019 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:11.561420 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:11.559053 13839 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:11.571514 13839 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.574869 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.559139 13861 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.577507 13654 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.572877 13724 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.599647 12013 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.610426 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:11.603415 13654 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:11.617089 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50503.8us
I20260709 12:10:11.604554 13435 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.605679 13734 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:11.629019 13734 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.631135 13734 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.622412 13896 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.633833 13896 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.626289 13435 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.636168 13896 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.636348 13435 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.640128 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:11.611719 13733 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.620038 13746 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.649170 13896 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.649314 13734 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.610466 13861 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:11.656878 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.659814 12022 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:11.626685 13654 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.657065 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.658447 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:11.657146 12021 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.661350 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:11.664395 12022 raft_consensus.cc:2368] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:11.666656 12015 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.669193 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.670002 12018 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:11.671954 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61634.7us
I20260709 12:10:11.672894 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:11.673177 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:11.673476 12015 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.660427 13896 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.675097 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:11.677033 13896 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.675446 13884 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:11.677624 13896 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:11.678057 13896 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:11.678258 13881 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.678455 13896 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.677632 13884 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:11.678956 13881 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:11.680824 13884 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.681159 13881 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:11.674140 13743 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.683455 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:11.683808 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:11.690480 13757 raft_consensus.cc:476] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:11.691490 11864 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.705081 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.708948 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.709901 11864 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:11.693332 12015 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:11.662225 13734 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.695271 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.715692 11868 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:11.696414 11867 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.696460 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.697459 11872 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.698300 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.654764 13733 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.721042 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.706965 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.701242 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:11.711829 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.724483 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:11.724758 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.729087 13733 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.729849 13746 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.700893 13839 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:11.724334 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.732077 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.732882 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.734965 12016 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.735831 11873 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:11.746819 11870 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:11.747443 11870 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:11.748485 11870 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.750263 11870 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.767751 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.774706 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:11.730821 13809 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:10:11.788337 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 81513.2us
I20260709 12:10:11.797413 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:11.797963 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:11.798556 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:11.798761 11872 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:11.766352 13746 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:11.804931 11870 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:11.805475 11870 pending_rounds.cc:85] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:11.805814 11870 pending_rounds.cc:107] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:11.806120 11870 raft_consensus.cc:2889] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.775914 13743 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.824296 11945 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:11.833032 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:11.837404 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 44723.3us
W20260709 12:10:11.827747 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.813442 13861 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.817806 13806 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:11.817626 13893 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:11.884598 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89083.8us
I20260709 12:10:11.896154 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:11.898931 13904 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.894101 13806 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.912593 13909 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:11.899438 13893 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.856431 13654 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.905449 13861 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:11.921309 13806 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.924255 13893 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:11.942610 13837 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.009s
I20260709 12:10:11.957909 11770 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 3, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:11.960177 11770 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 4, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:11.918781 13746 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:11.980352 13907 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:10:11.982762 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 167013us
I20260709 12:10:11.984122 13761 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:11.978202 13906 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 12:10:11.983039 13861 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:11.988687 13896 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:11.999579 13896 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.002127 13806 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.004648 13806 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.003275 13909 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:12.005754 13909 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.006714 13734 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.025461 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:12.028285 12611 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.031629 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:12.039494 13630 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.011785 13896 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.043888 13630 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.044075 13870 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.056933 13761 raft_consensus.cc:993] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:12.060527 13837 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.052836 13630 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.057478 13761 raft_consensus.cc:1081] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:12.083240 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:12.086081 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:12.062255 13491 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.053562 13896 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.090564 13734 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.090996 13734 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.091354 13734 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.091634 13893 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.064983 13837 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.093829 13893 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.094198 13837 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.094615 13822 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.091974 13896 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.069954 13654 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:12.103083 13746 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:12.106446 13724 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.065259 13913 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:12.081018 13909 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.115952 13694 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:12.119395 13724 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:12.120986 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.063700 13870 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.128928 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:12.111021 13746 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.135497 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:12.137621 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.134208 13732 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:12.143196 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.101207 13491 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.126048 13913 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:12.149775 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 111264us
I20260709 12:10:12.148149 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1495) took 1072 ms. Trace:
I20260709 12:10:12.151536 13539 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:12.152631 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:12.145843 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:12.146175 13654 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:12.151672 11871 rpcz_store.cc:276] 0709 12:10:11.075278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.076556 (+  1278us) service_pool.cc:224] Handling call
0709 12:10:11.076962 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.198160 (+121198us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:11.214074 (+ 15914us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.426283 (+212209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.426370 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:11.426447 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.956832 (+530385us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b1800364180. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419
0709 12:10:12.147853 (+191021us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001b4c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:12.147915 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.148048 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21502,"prepare.queue_time_us":74613,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":1326,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6301,"spinlock_wait_cycles":280552576,"thread_start_us":210337,"threads_started":1,"wal-append.queue_time_us":266954}
I20260709 12:10:12.138890 13746 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:12.137252 13761 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.166960 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.170751 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.171438 11871 raft_consensus.cc:2376] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4. Re-sending same reply.
I20260709 12:10:12.170747 11866 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:12.173133 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.173934 11871 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.179986 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.179986 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.181815 11873 raft_consensus.cc:2376] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6. Re-sending same reply.
I20260709 12:10:12.183058 13724 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:12.184792 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.154559 13733 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.153785 13747 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.183192 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.149029 13913 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:12.187605 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.206928 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.195151 12021 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.188742 13757 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:12.200686 13902 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.216180 13902 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:12.143600 13909 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:12.154160 13811 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:12.175837 13881 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.175063 13813 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.187225 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.207371 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.208415 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.209977 12014 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:12.212785 11867 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.192358 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.215335 13630 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.148236 13910 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:12.189445 11839 leader_election.cc:400] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
W20260709 12:10:12.242254 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52939.8us
I20260709 12:10:12.243304 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:12.185645 11872 raft_consensus.cc:2376] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4. Re-sending same reply.
I20260709 12:10:12.189929 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:12.245136 12016 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.228895 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.247124 11867 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:12.237104 12013 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:12.249425 13757 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.184954 13911 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:10:12.251286 13902 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.252692 13902 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.259294 12016 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:12.240468 11871 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:12.251684 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:12.207129 13896 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.203832 13491 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.205008 13870 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:12.295768 11945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1237) took 1536 ms (client timeout 1894 ms). Trace:
I20260709 12:10:12.263392 13757 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.265158 13664 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:12.296401 11945 rpcz_store.cc:269] 0709 12:10:10.739126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.739263 (+   137us) service_pool.cc:224] Handling call
0709 12:10:11.639958 (+900695us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:12.275183 (+635225us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002e5ed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:12.275315 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308843008}
I20260709 12:10:12.306934 11770 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 3 to 5, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:12.309171 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:12.310232 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:12.313400 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43716.4us
I20260709 12:10:12.272394 13870 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:12.329146 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 183389us
I20260709 12:10:12.316902 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:12.318030 11946 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:12.219435 13747 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.235632 13811 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.314653 11770 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 2 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:12.322182 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.330081 11771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 221) took 4585 ms. Trace:
I20260709 12:10:12.316182 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.342995 11945 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:12.287729 13776 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.333904 11943 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.267449 13896 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.341454 11771 rpcz_store.cc:276] 0709 12:10:07.744566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.744773 (+   207us) service_pool.cc:224] Handling call
0709 12:10:12.330013 (+4585240us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.320027 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.320704 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.320743 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:09.320764 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:09.321767 (+  1003us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.321853 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.321892 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:09.322657 (+   765us) tablet.cc:701] Row locks acquired
0709 12:10:09.322678 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:09.322834 (+   156us) write_op.cc:270] Start()
0709 12:10:09.322979 (+   145us) write_op.cc:276] Timestamp: P: 1783599009322790 usec, L: 0
0709 12:10:09.323008 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.374972 (+ 51964us) log.cc:844] Serialized 3258 byte log entry
0709 12:10:09.594353 (+219381us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.829328 (+234975us) write_op.cc:301] APPLY: starting
0709 12:10:09.829422 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.829699 (+   277us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.829846 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.830781 (+   935us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.830988 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:09.831031 (+    43us) write_op.cc:312] APPLY: finished
0709 12:10:09.831337 (+   306us) log.cc:844] Serialized 65 byte log entry
0709 12:10:09.831533 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.831670 (+   137us) write_op.cc:454] Released schema lock
0709 12:10:09.831719 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.832110 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.832137 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117916,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":223020,"apply.run_cpu_time_us":2737,"apply.run_wall_time_us":2738,"num_ops":8,"prepare.queue_time_us":122956,"prepare.run_cpu_time_us":4683,"prepare.run_wall_time_us":55329,"replication_time_us":253104,"thread_start_us":193075,"threads_started":2}]]}
I20260709 12:10:12.300033 13913 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.441046 13758 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.442242 13913 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.445287 13903 raft_consensus.cc:1064] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:10:12.445941 13776 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.319453 13826 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:12.243024 13813 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:12.431892 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 100898us
I20260709 12:10:12.342533 13733 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.451599 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.431895 11941 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:12.348552 11944 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:12.491143 13934 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:12.491830 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 240187us
I20260709 12:10:12.493261 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:12.496901 13936 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.497404 13936 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.458379 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:12.459597 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 128937us
I20260709 12:10:12.449640 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:12.431250 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.491744 13934 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.504076 13937 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:12.471390 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:12.508823 13491 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.511595 11942 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.515383 11943 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:12.515484 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:12.515991 11943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1236) took 1777 ms (client timeout 1775 ms). Trace:
I20260709 12:10:12.516358 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.517463 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.518224 11864 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:12.516396 11943 rpcz_store.cc:269] 0709 12:10:10.738602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.739321 (+   719us) service_pool.cc:224] Handling call
0709 12:10:11.537254 (+797933us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:12.160200 (+622946us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b18002aa320. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba6e646 00007f1f1b9a858e 00007f1f1ba29f9e 00007f1f1ba2b7de 00007f1f1ba3727c 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c
0709 12:10:12.333643 (+173443us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b58001b6ed0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba29fe7 00007f1f1ba2b7de 00007f1f1ba3727c 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c
0709 12:10:12.515927 (+182284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591379968}
I20260709 12:10:12.520951 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.520766 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.522128 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.318377 13664 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.527480 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:12.528736 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:12.532881 12019 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.529361 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:12.529806 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 77244.1us
I20260709 12:10:12.314761 13757 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.534143 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:12.540144 12017 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.450081 13811 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.535669 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.537595 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:12.550345 11864 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.538337 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.551811 11871 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:12.553155 11942 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:12.535086 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:12.541805 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:12.545177 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.554744 11873 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.546806 11872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:12.509861 13938 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:12.448410 13776 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.447664 13903 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.499672 13936 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.488934 13733 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.523926 13839 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:12.503742 13934 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.577889 11867 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:12.595399 11865 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.598692 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:12.601270 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:12.603392 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 102363us
I20260709 12:10:12.608152 12020 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.573144 12019 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:12.633205 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:12.634271 12611 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
I20260709 12:10:12.644395 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:10:12.605818 13898 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:12.647040 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:12.602548 13733 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.657692 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.660988 11945 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:12.665220 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.567205 13870 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:10:12.667371 11945 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.658658 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:12.659282 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.657488 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.657927 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:12.679481 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 145404us
I20260709 12:10:12.680478 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:12.489813 13826 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.610845 13911 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:10:12.640164 13811 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.656641 13936 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.697667 13936 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.700080 13936 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:12.700490 13924 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:10:12.702538 11864 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:12.703874 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:12.710801 11873 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:12.708283 12017 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:12.676003 13630 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.625653 13839 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.688228 13743 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.706401 13909 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.702934 13813 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.712122 13747 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.757139 13938 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.766825 13938 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.768740 13826 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.769521 13938 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.737591 13811 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:12.776611 13811 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:12.784858 13746 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.005s
W20260709 12:10:12.785996 13925 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:10:12.785656 13746 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.787055 11948 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:10:12.773133 13734 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.001s
I20260709 12:10:12.761569 13813 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:12.788049 13813 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:12.790380 13813 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:12.791038 13734 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.792272 11939 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:12.774647 13757 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.775199 13839 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:12.794693 13902 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:10:12.795289 12016 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:12.793310 13734 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.765089 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:12.802608 13664 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.803754 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:12.740113 13912 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:12.738409 13743 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:12.739063 13936 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:12.804816 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 47183.2us
I20260709 12:10:12.752506 13909 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:10:12.826871 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.828711 13826 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:12.834719 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.835279 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.803915 13896 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.815949 13743 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.800401 13733 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.814450 13912 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:12.841220 13746 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.841849 13912 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.832741 13936 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.749302 11941 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:12.843185 13912 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.844730 13936 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.833760 13909 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.848115 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:12.850853 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:12.830014 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:12.811909 13491 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:12.861158 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.873199 13826 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:12.894212 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 64288.8us
I20260709 12:10:12.842249 13733 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:12.896296 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:12.924834 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74058.1us
I20260709 12:10:12.898866 13750 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.927394 13654 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.930068 13913 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.933099 13761 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.899194 13491 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:12.935999 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:12.939162 11946 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:12.945117 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.576s (SENT) [suppressed 25 similar messages]
I20260709 12:10:12.948415 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:12.949765 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 270731us
I20260709 12:10:12.937245 13942 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.938246 13913 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:12.946616 13654 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:12.963438 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:12.951309 13733 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.957954 13942 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.959326 13913 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.974269 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:12.995075 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.000713 12611 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.943666 13826 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:12.967620 13936 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:13.055683 12611 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:13.050997 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 515956us
W20260709 12:10:13.056342 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53281.4us
W20260709 12:10:13.056941 12574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.019s	sys 0.011s
I20260709 12:10:12.976511 13942 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:13.061640 12574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.019s	sys 0.011s
I20260709 12:10:12.975512 13732 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:13.065999 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.013s	sys 0.027s
W20260709 12:10:13.067560 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.013s	sys 0.027s
I20260709 12:10:13.068293 11872 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:13.068710 11872 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:13.070775 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.074920 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:13.054548 13937 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:13.077843 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.082353 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:13.083721 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:13.086246 11871 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:13.070385 13754 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:13.096808 12021 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:13.078827 13630 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.080852 13813 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.090497 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:13.100962 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.096441 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.110754 11865 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:12.986171 13491 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.098830 13937 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.107203 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:13.079375 13902 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:13.125379 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:13.101662 13746 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.109349 12014 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:13.114300 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:13.114811 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:13.113660 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:13.103931 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:13.109711 11869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.011s	sys 0.022s
I20260709 12:10:13.067626 13936 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.088572 13724 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:10:13.112602 13939 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:10:13.150617 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.152138 13881 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.152782 13881 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.157351 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.138768 11872 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.132977 11839 leader_election.cc:400] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:13.083041 13732 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:13.136822 11869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.011s	sys 0.023s
I20260709 12:10:13.136945 11871 raft_consensus.cc:2393] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:13.137959 11865 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:13.082126 13743 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.101598 13949 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.142482 13724 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:13.142700 13950 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:13.143024 13829 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.143178 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:13.113341 13908 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:13.144042 13936 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.163187 11839 leader_election.cc:403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:13.172932 11871 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:13.079597 13654 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.134047 13813 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:13.137570 13746 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:13.119135 13754 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:13.194970 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62142us
I20260709 12:10:13.126125 13902 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.202746 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.204118 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.206821 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.206965 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.208330 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:13.198859 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 253761us
I20260709 12:10:13.140096 13822 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:13.177846 13724 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:13.180923 13829 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.220999 11865 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:13.222194 11869 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:13.203209 13746 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.186154 13961 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:13.201936 13936 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:13.225342 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.205777 13811 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.224418 13915 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.228503 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.228713 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.229557 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.214371 13757 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.230245 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.268658 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.226868 11940 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.244095 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.245491 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.222025 13829 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.253417 11868 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:13.213950 13934 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.221072 13822 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.323665 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.222738 13958 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.216868 13870 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:13.326835 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.411772 11943 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:13.336503 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.322494 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:13.338580 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.416411 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:13.331858 13951 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:13.419096 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.407018 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:13.331633 13941 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:10:13.422454 12014 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 12:10:13.331434 12603 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:13.331431 13952 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:13.410697 13926 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.852s	user 0.000s	sys 0.009s
I20260709 12:10:13.243060 13961 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.242550 13732 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.473104 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.474071 12017 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
W20260709 12:10:13.442684 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.520503 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.409898 13936 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:13.553283 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:13.462399 13948 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 12:10:13.324455 13915 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.566891 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.577520 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.426116 13953 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.555665 13881 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.582309 13965 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.586344 13956 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:10:13.569891 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:13.588543 13953 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:13.599318 13962 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.420s	user 0.000s	sys 0.003s
I20260709 12:10:13.562131 13952 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.424602 13813 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:13.615046 13954 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:13.572526 13936 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:13.602911 13909 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
I20260709 12:10:13.593745 13743 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.612890 13953 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.618067 13964 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:10:13.621397 13966 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:10:13.606272 13970 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:10:13.620157 13754 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.638953 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1614) took 1113 ms. Trace:
I20260709 12:10:13.597705 13965 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.664875 12022 rpcz_store.cc:276] 0709 12:10:12.519157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.519271 (+   114us) service_pool.cc:224] Handling call
0709 12:10:12.519602 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:12.519959 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.519988 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:12.529383 (+  9395us) log.cc:844] Serialized 52 byte log entry
0709 12:10:12.812261 (+282878us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:12.812338 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.812456 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.632529 (+820073us) raft_consensus.cc:1685] finished
0709 12:10:13.632559 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.632728 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11269,"raft.queue_time_us":5063,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11888,"thread_start_us":274894,"threads_started":1,"wal-append.queue_time_us":422226}
I20260709 12:10:13.637940 13909 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.643656 13936 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.644306 13822 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:13.644968 13959 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 12:10:13.626070 13910 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.667497 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1615) took 1148 ms. Trace:
W20260709 12:10:13.664844 13913 consensus_meta.cc:287] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
I20260709 12:10:13.689172 11873 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.682381 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.693897 12013 rpcz_store.cc:276] 0709 12:10:12.519417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.522451 (+  3034us) service_pool.cc:224] Handling call
0709 12:10:12.522879 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:12.530382 (+  7503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.530413 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:12.530959 (+   546us) log.cc:844] Serialized 52 byte log entry
0709 12:10:12.849497 (+318538us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800386740. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:13.130167 (+280670us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:13.130252 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.130393 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.667014 (+536621us) raft_consensus.cc:1685] finished
0709 12:10:13.667052 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.667410 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7004,"raft.queue_time_us":14243,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":54816,"spinlock_wait_cycles":8597760,"thread_start_us":274853,"threads_started":1,"wal-append.queue_time_us":598114}
I20260709 12:10:13.699931 12015 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.702105 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1319) took 1265 ms. Trace:
I20260709 12:10:13.702491 11948 rpcz_store.cc:276] 0709 12:10:12.434654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.437374 (+  2720us) service_pool.cc:224] Handling call
0709 12:10:12.437690 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.787664 (+349974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.699840 (+912176us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400240c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:13.700056 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802562944}
W20260709 12:10:13.698578 13942 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 12:10:13.707070 13973 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.707602 13915 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.707827 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1619) took 1187 ms. Trace:
I20260709 12:10:13.708981 13961 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.708254 12018 rpcz_store.cc:276] 0709 12:10:12.520479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.526206 (+  5727us) service_pool.cc:224] Handling call
0709 12:10:12.526566 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:12.733467 (+206901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.733515 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:12.740050 (+  6535us) log.cc:844] Serialized 52 byte log entry
0709 12:10:13.110677 (+370627us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:13.112466 (+  1789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.112737 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.707589 (+594852us) raft_consensus.cc:1685] finished
0709 12:10:13.707620 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.707765 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68765,"raft.queue_time_us":47583,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":14095,"thread_start_us":512465,"threads_started":2,"wal-append.queue_time_us":413029}
W20260709 12:10:13.712672 13972 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:10:13.701272 13747 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:13.715058 13955 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:13.715438 13747 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.716349 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1539) took 1093 ms. Trace:
I20260709 12:10:13.716754 11864 rpcz_store.cc:276] 0709 12:10:12.627299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.713377 (+ 86078us) service_pool.cc:224] Handling call
0709 12:10:12.714073 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.741326 (+ 27253us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:10:12.741370 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.741900 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.066259 (+324359us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:13.066302 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.066369 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.716090 (+649721us) raft_consensus.cc:1685] finished
0709 12:10:13.716115 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.716282 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32890,"raft.queue_time_us":7137,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7444,"thread_start_us":323623,"threads_started":1,"wal-append.queue_time_us":851706}
I20260709 12:10:13.717954 13747 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.698518 13811 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:13.699993 13937 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:13.729589 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:13.702304 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:13.730331 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 152898us
I20260709 12:10:13.703933 13837 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.739598 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:13.714556 13912 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.007s
I20260709 12:10:13.705943 13952 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.699177 13913 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:13.712709 13960 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:10:13.741220 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:13.775565 13913 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.776564 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1538) took 1168 ms. Trace:
I20260709 12:10:13.737500 13733 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:13.778934 12016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 1622) took 1232 ms (client timeout 1613 ms). Trace:
I20260709 12:10:13.777019 11873 rpcz_store.cc:276] 0709 12:10:12.607793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.711640 (+103847us) service_pool.cc:224] Handling call
0709 12:10:12.737397 (+ 25757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.697339 (+959942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.776262 (+ 78923us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54002f5b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:13.776488 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188352768}
W20260709 12:10:13.780470 12016 rpcz_store.cc:269] 0709 12:10:12.527702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.529109 (+  1407us) service_pool.cc:224] Handling call
0709 12:10:13.759466 (+1230357us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002675d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:13.759650 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601420544}
I20260709 12:10:13.714397 13942 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.750057 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1313) took 1419 ms. Trace:
I20260709 12:10:13.750519 13945 raft_consensus.cc:2764] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:13.763103 13915 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.764541 13912 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.736426 13811 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.796761 12020 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:13.799221 13909 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:13.747323 13837 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:13.801028 13746 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:10:13.801864 13965 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.801811 13837 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.801790 13746 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.806466 13746 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.807251 13942 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:13.740950 13937 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:13.788931 11939 rpcz_store.cc:276] 0709 12:10:12.328245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.333139 (+  4894us) service_pool.cc:224] Handling call
0709 12:10:12.442403 (+109264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.792685 (+350282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.727772 (+935087us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54000a0fd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:13.747112 (+ 19340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803930880}
I20260709 12:10:13.858407 13902 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:13.798383 13915 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:13.874344 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 128128us
I20260709 12:10:13.878360 13809 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:13.889274 13915 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:13.891362 13724 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.892589 13724 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.876942 13829 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.897096 13829 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:13.898641 12608 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4.
I20260709 12:10:13.899020 13811 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.908056 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.908388 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.909655 13937 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:13.910662 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.913034 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.914100 11940 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:13.915406 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.915696 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.917096 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.920176 11912 leader_election.cc:400] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4.
I20260709 12:10:13.920679 11912 leader_election.cc:403] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:13.924196 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.925375 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.952508 11940 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:13.954444 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.930487 13776 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.929791 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:13.957120 13722 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:13.965729 13722 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:13.968315 13722 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:13.969940 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:13.970903 12603 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:13.984304 11872 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:13.994674 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 211657us
I20260709 12:10:14.007668 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36510 (request call id 1532) took 1447 ms. Trace:
I20260709 12:10:14.008214 11872 rpcz_store.cc:276] 0709 12:10:12.546476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.546680 (+   204us) service_pool.cc:224] Handling call
0709 12:10:13.982496 (+1435816us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54001603d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2aa3d 00007f1f209facd0 00007f1f19f7f254 00007f1f19f7f1e2 00007f1f19f7f111 00007f1f19f7f08c 00007f1f19f7e342 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:13.994033 (+ 11537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178930560}
I20260709 12:10:14.046746 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.047664 11939 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:14.048024 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.048684 11943 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:10:14.063768 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.064160 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:14.065110 11944 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:14.065587 11944 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:14.066118 11943 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.066772 11944 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.080736 11944 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.023659 13822 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.086795 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:14.084352 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.085407 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.088613 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:14.090394 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:14.091068 11943 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.094811 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:14.013687 13915 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:10:14.054076 13958 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.098845 13975 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.078493 13990 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:14.114365 13996 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:10:14.101080 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:14.098269 13976 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.103626 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.108347 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.114020 11945 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.126322 13912 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.101351 13937 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:14.100800 13654 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.102093 13822 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.105402 13811 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:14.101784 13733 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:14.129892 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:14.134021 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1282) took 1024 ms. Trace:
I20260709 12:10:14.049504 13971 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:14.146813 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.134987 11944 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:14.140604 11869 rpcz_store.cc:276] 0709 12:10:13.109764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.162443 (+ 52679us) service_pool.cc:224] Handling call
0709 12:10:13.221936 (+ 59493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.222644 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.133837 (+911193us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54002d9450. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:14.133962 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135784192}
I20260709 12:10:14.042292 13861 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:10:14.154109 13861 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.101558 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.054963 13953 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.131094 13912 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.138628 13975 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.117802 13976 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.154543 13861 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:14.131544 13937 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:14.136281 13811 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.135134 13822 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.165860 13912 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.169381 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.170148 12607 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:14.167696 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.149789 13945 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.224967 11837 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.154910 13733 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.171190 12609 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:10:14.227664 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 132272us
I20260709 12:10:14.155380 13996 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:14.167476 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.182268 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.131906 13654 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.230620 13733 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.161273 13975 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.162370 13937 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:14.165928 13811 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:14.123275 13958 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.183597 13952 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.191774 13912 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.200925 13776 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4.
I20260709 12:10:14.202852 13953 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.167644 13971 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.192112 13813 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.218323 13936 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.225968 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.301157 11947 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.216281 13747 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.163880 13861 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:14.229770 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.269488 11942 raft_consensus.cc:1813] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Handling vote request from an unknown peer 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:14.309582 11942 raft_consensus.cc:2410] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:14.270224 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:14.232024 13996 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:14.299489 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 74930.1us
I20260709 12:10:14.231894 13945 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.287812 13934 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:14.317154 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84141.8us
I20260709 12:10:14.319072 14004 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.319700 14004 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.333142 12016 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.341431 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:14.344082 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.300880 13971 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.347752 13999 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.348343 13999 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.348850 13999 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.350157 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.309123 13936 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.299093 13976 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.360471 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:14.364610 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.365896 12019 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:14.368206 12018 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:14.368574 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.369625 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.359326 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:14.370896 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.370811 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.371929 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:14.372471 12017 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.302799 13813 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.373656 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.290515 13952 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.369834 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.312539 13747 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.293465 13912 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.445413 13896 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.445726 11946 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.446215 13896 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.446797 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1329) took 1221 ms. Trace:
I20260709 12:10:14.448002 13958 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.447559 11946 rpcz_store.cc:276] 0709 12:10:13.225860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.226302 (+   442us) service_pool.cc:224] Handling call
0709 12:10:14.445223 (+1218921us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:14.445474 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.446501 (+  1027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.446737 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310976}
I20260709 12:10:14.297851 13811 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.455279 12017 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:14.449438 13996 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.460366 13996 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.365027 13654 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.464898 14002 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.375473 13934 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.467761 13978 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:14.469717 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:14.431363 13971 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.451741 13813 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.478817 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:14.485455 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 166766us
I20260709 12:10:14.314922 13937 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.469792 13942 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.490327 11837 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.465577 14002 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.498196 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.491120 14006 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.479621 13811 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.488008 13733 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.499874 13654 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.500758 13747 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.501116 13936 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.502039 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.504225 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.504609 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:14.484673 13893 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.511845 13883 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.512528 13883 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.492055 14004 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.475613 13934 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.515805 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.495818 13776 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.518280 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.506884 13937 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.521912 13893 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.522186 13733 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:14.526574 13754 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:14.533267 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.506589 13435 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.535358 13754 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:14.535789 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.536558 11943 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:14.536460 13754 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.503206 14007 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.522473 13883 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:14.528425 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50949us
I20260709 12:10:14.529702 13722 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.530195 13936 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.530457 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.516623 13976 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.531023 14004 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.531396 13901 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.516809 13747 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.477283 13978 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.540318 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.515575 13952 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.552040 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.552699 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.503845 13971 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:10:14.543175 13947 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.420s	user 0.009s	sys 0.011s
I20260709 12:10:14.543576 11873 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.553875 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.543776 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.555255 11866 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:14.504824 13942 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.564314 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.566123 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.537636 14007 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:14.532810 13776 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.558012 13952 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.566257 13747 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.581588 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.563328 13819 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:14.575776 13945 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.576010 13893 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.575757 13881 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.577073 13896 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.583686 14010 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.579910 14004 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.580278 13912 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.583257 13936 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.606480 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:14.592695 14003 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:14.620007 13978 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.620559 14002 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.621440 13944 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.621716 13747 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.586555 14008 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:10:14.622804 13942 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.622908 13776 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.623569 14004 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.623847 13934 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.608038 13936 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.591161 13881 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.590996 13893 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.599081 14010 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:14.626955 13912 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.629700 13971 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.606808 13945 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.632474 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:14.634671 13975 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.598682 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:14.667040 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68509.4us
I20260709 12:10:14.643700 11864 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:14.640280 14011 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.651909 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.641300 13996 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.647707 14012 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.665400 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.678833 11864 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:14.671022 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89526.3us
I20260709 12:10:14.680238 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.681421 13945 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.683019 13936 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.684633 13881 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.657766 13949 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:14.684918 14008 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.685441 13949 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.656231 14004 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.687706 13949 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.688639 14004 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.689930 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.690366 14007 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.647133 13944 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.695360 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.657338 13942 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.674542 13978 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.684671 13945 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.667394 13971 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.667124 13912 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.713181 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.676584 14011 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.715372 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:14.713644 14012 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.715875 13757 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:14.694026 13996 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.727218 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.728502 12016 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:14.723069 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.730429 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.709380 13754 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.731246 11865 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:14.737356 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:14.738286 12019 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:14.702344 13942 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.737233 13949 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:14.704154 14010 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.740492 13822 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:14.742704 13971 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.742636 13881 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:14.743873 13975 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:14.745122 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.747031 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.748576 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:14.731285 13754 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:14.769699 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.773682 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60561.4us
I20260709 12:10:14.780965 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.789757 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:14.792625 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.791239 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:14.795830 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:14.793478 12020 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:14.798852 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.799568 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:14.800486 11912 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:14.728317 13999 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.801832 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.802605 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.803184 13999 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:14.803771 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.805083 11941 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.784530 11865 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:14.780488 13944 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.745903 13896 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:14.811770 11865 pending_rounds.cc:85] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
I20260709 12:10:14.782080 14014 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.791713 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.817525 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.790583 14010 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.796947 13811 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.814769 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.806363 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.812614 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.816587 12018 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 12:10:14.824604 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.825340 12018 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:14.826403 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.817672 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 116) took 5407 ms. Trace:
I20260709 12:10:14.792068 13435 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.795894 13913 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.813894 11865 pending_rounds.cc:107] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:14.818583 12020 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.832857 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:14.834862 12020 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.806002 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.799429 14012 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.841589 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.811528 13999 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.777331 13949 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.804316 13936 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:14.832010 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:14.836879 11865 raft_consensus.cc:2889] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:14.828246 11770 rpcz_store.cc:276] 0709 12:10:09.410205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.412912 (+  2707us) service_pool.cc:224] Handling call
0709 12:10:14.817598 (+5404686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:12.505696 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:12.506308 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:12.506344 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:12.506363 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:12.507050 (+   687us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:12.507134 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:12.507161 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:12.507554 (+   393us) tablet.cc:701] Row locks acquired
0709 12:10:12.507584 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:10:12.507719 (+   135us) write_op.cc:270] Start()
0709 12:10:12.507834 (+   115us) write_op.cc:276] Timestamp: P: 1783599012507680 usec, L: 0
0709 12:10:12.507858 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:12.676569 (+168711us) log.cc:844] Serialized 1749 byte log entry
0709 12:10:13.667460 (+990891us) op_driver.cc:464] REPLICATION: finished
0709 12:10:13.789959 (+122499us) write_op.cc:301] APPLY: starting
0709 12:10:13.792797 (+  2838us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:13.835271 (+ 42474us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:13.864246 (+ 28975us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:13.864922 (+   676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:13.865177 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:13.865239 (+    62us) write_op.cc:312] APPLY: finished
0709 12:10:13.866685 (+  1446us) log.cc:844] Serialized 41 byte log entry
0709 12:10:13.866962 (+   277us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.867137 (+   175us) write_op.cc:454] Released schema lock
0709 12:10:13.867217 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:13.872396 (+  5179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.873126 (+   730us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1865736,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":88529,"apply.run_cpu_time_us":3756,"apply.run_wall_time_us":84643,"num_ops":4,"prepare.queue_time_us":166843,"prepare.run_cpu_time_us":24648,"prepare.run_wall_time_us":461862,"raft.queue_time_us":78354,"raft.run_cpu_time_us":23991,"raft.run_wall_time_us":32490,"replication_time_us":1159449,"thread_start_us":519221,"threads_started":4,"wal-append.queue_time_us":534217}]]}
I20260709 12:10:14.821262 12611 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.791077 13881 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:14.848790 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e361e6345864efa81f207f2a9dafda0 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36502
I20260709 12:10:14.799597 13975 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:10:14.818061 13978 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.844995 13435 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:14.855010 13747 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.855137 13996 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:14.905742 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.856062 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.856873 13912 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:14.817480 13901 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.875383 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.844972 14012 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:14.822073 13811 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:14.841935 13654 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.882140 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.883491 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:14.884157 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.840996 13913 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:14.886987 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.888494 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.889954 12610 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:14.891175 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:14.891222 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:14.861023 14011 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:14.845166 14001 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:10:14.879424 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:14.906275 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.000820 11943 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 1.
I20260709 12:10:14.892948 13978 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.015918 11940 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:15.017172 13978 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.021710 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1280) took 1796 ms. Trace:
I20260709 12:10:15.022226 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.018160 13733 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:15.019049 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 184383us
I20260709 12:10:15.013957 12607 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 1.
W20260709 12:10:14.906415 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.954563 13953 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.017982 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 126905us
I20260709 12:10:15.025521 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.038936 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.026175 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:15.022126 12021 rpcz_store.cc:276] 0709 12:10:13.225286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.225760 (+   474us) service_pool.cc:224] Handling call
0709 12:10:13.226133 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.628547 (+402414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.628578 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.629209 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.816650 (+187441us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.927811 (+111161us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.928090 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.021307 (+1093217us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400028d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.021357 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.021412 (+    55us) raft_consensus.cc:1685] finished
0709 12:10:15.021493 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.021659 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34733,"prepare.queue_time_us":89829,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":36719,"raft.run_cpu_time_us":5650,"raft.run_wall_time_us":24951,"spinlock_wait_cycles":839029120,"thread_start_us":229564,"threads_started":2,"wal-append.queue_time_us":210111,"wal-append.run_cpu_time_us":3337,"wal-append.run_wall_time_us":1129698}
I20260709 12:10:15.034180 12020 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:15.040512 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.041863 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.042665 11941 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:15.043941 12018 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:15.045938 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:15.039381 12022 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:15.042582 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.050863 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:15.003870 13722 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.064807 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.004273 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.021205 13811 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.008951 13881 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.054440 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.076314 11944 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:15.021072 14012 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.028579 13913 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.070946 13896 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.029266 13654 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.064783 13722 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:15.066306 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.115643 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:15.131465 11944 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:15.134985 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70282.9us
I20260709 12:10:15.049618 13953 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:15.128912 14016 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:10:15.071273 13971 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:10:15.129525 14022 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:15.108747 13942 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:15.128374 14018 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:15.134414 13732 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.118935 14035 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:15.171705 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 132872us
I20260709 12:10:15.079270 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.140533 14011 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.172645 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.156963 13724 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.121043 13896 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.193920 11944 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
W20260709 12:10:15.201838 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 151056us
I20260709 12:10:15.201156 14032 tablet_replica.cc:333] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:10:15.182102 14011 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.218142 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.202435 13949 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.219012 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.208410 13435 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.219940 14011 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.217365 13732 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:15.222813 14030 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:15.284019 13435 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.290251 13724 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.290900 13724 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.220288 13754 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:15.224900 13971 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:15.277952 13996 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.288427 14020 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:10:15.217285 13722 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.286240 13732 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.306746 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82279.7us
I20260709 12:10:15.309157 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:15.311595 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.300457 13724 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.318214 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1248) took 1411 ms. Trace:
I20260709 12:10:15.181842 14035 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.304637 13754 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:15.304380 13971 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.320206 11942 rpcz_store.cc:276] 0709 12:10:13.906938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.181890 (+274952us) service_pool.cc:224] Handling call
0709 12:10:15.317826 (+1135936us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b5400241654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:15.318096 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15210368}
I20260709 12:10:15.309731 13732 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.328145 13990 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.306113 13996 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.349284 14041 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:10:15.337808 14025 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 12:10:15.348579 13654 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:15.355486 14024 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:10:15.358349 13896 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.353197 14041 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.340662 13990 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:15.391902 11942 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:15.391960 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.393141 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.394001 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.354593 13953 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.393339 11940 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:15.394652 11944 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:15.395849 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.358417 13996 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.338124 13754 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:15.409411 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 341046us
I20260709 12:10:15.394196 13990 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:15.417394 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 105844us
I20260709 12:10:15.418540 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:15.418737 12609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 214) took 1913 ms. Trace:
I20260709 12:10:15.419441 12609 rpcz_store.cc:276] 0709 12:10:13.500184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.500360 (+   176us) service_pool.cc:224] Handling call
0709 12:10:13.500760 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.231730 (+730970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.413399 (+1181669us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54006702d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.413718 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541243136}
I20260709 12:10:15.429522 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.428189 13902 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.436051 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.423941 14041 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.432240 13902 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:15.440891 11944 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:15.413822 14035 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.454468 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:15.456549 13732 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.458854 13732 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.461871 14026 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.439255 14041 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:15.474022 13732 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.472690 14041 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.485219 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1561) took 1145 ms. Trace:
I20260709 12:10:15.486070 11868 rpcz_store.cc:276] 0709 12:10:14.340209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.341653 (+  1444us) service_pool.cc:224] Handling call
0709 12:10:14.342017 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.429371 (+ 87354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.429425 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.429493 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:14.429559 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.484834 (+1055275us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54001b5154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.484913 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.485111 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200091904}
W20260709 12:10:15.490188 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 354442us
I20260709 12:10:15.490048 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1257) took 1574 ms. Trace:
I20260709 12:10:15.491765 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.492030 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.492841 12016 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:15.491575 11947 rpcz_store.cc:276] 0709 12:10:13.916033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.917642 (+  1609us) service_pool.cc:224] Handling call
0709 12:10:13.918029 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.301644 (+383615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.489638 (+1187994us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400311354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.489929 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880519552}
I20260709 12:10:15.494460 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.496073 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.470865 14012 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.468663 13971 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.504994 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1647) took 1176 ms. Trace:
I20260709 12:10:15.505457 12015 rpcz_store.cc:276] 0709 12:10:14.328354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.331824 (+  3470us) service_pool.cc:224] Handling call
0709 12:10:14.332199 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.379565 (+ 47366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.379607 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.379664 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:14.379713 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.504748 (+1125035us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54000532d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.504783 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.504934 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108243840}
I20260709 12:10:15.500190 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.508384 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.512094 13976 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.512554 13976 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:15.513067 13913 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.518996 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.530284 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.530534 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:15.528695 13819 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.517742 14046 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:15.539388 13819 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:15.541132 13909 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.543829 13909 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.540988 14046 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.528852 13754 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:15.537598 13942 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.537061 14048 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:15.550396 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.548681 14012 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.552053 14048 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.513451 13976 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.564594 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.552546 14048 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:15.547843 13811 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:15.569000 14019 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.610s	user 0.001s	sys 0.002s
I20260709 12:10:15.578567 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.579440 13909 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.579967 13811 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:15.564862 13754 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:15.567530 13913 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.579475 11939 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:15.583626 13754 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.584465 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.585175 11939 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:15.585958 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.586098 13754 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.586268 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.587152 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.587608 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.588192 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.544338 13819 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.590039 14046 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:15.590447 14049 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:15.590054 13819 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.593618 11940 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.589269 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.614773 13893 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:15.626346 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.634219 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.641348 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.634927 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.622643 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.646559 12016 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:15.647387 14032 raft_consensus.cc:2243] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:15.647796 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.648524 12608 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:15.649647 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.612262 13754 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:15.650347 12019 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:15.617897 13912 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.658286 13912 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:15.659377 13912 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.660560 13912 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.664572 13861 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.623210 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.672392 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:15.677846 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.678560 12022 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.678601 12016 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:15.615710 14011 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.682543 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.683295 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.686347 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:15.690364 12015 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:15.693243 12608 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:15.702939 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.623396 14048 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.712016 14048 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.734678 12016 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:15.680163 13978 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.701635 13999 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.729501 12022 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:15.745476 11912 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:15.746819 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.670647 13754 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:15.750736 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.701754 13733 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:10:15.707990 13761 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:15.740458 13978 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:15.748467 13999 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.760844 12014 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:15.762080 12019 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:10:15.762439 12019 pending_rounds.cc:85] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 2
I20260709 12:10:15.762662 12019 pending_rounds.cc:107] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:10:15.762874 12019 raft_consensus.cc:2889] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:15.752277 13913 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:15.769032 14050 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:10:15.769460 14009 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.919s	user 0.005s	sys 0.000s
I20260709 12:10:15.760207 13978 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.771413 14044 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:15.760417 13999 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.790227 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:15.791306 14047 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.791823 14047 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:15.795661 14047 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.796072 14011 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:15.807215 13990 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.775302 14041 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.810870 14041 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:15.811022 13990 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:15.810787 14047 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.854900 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.858527 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:15.861256 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.864686 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.799120 13754 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.792359 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:15.876286 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:15.876758 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:15.799170 13945 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.877497 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 85075.1us
I20260709 12:10:15.857263 11945 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:15.886987 12609 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:15.886567 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:15.893194 14035 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:15.894451 14035 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.896179 11947 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:15.889525 13829 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:15.898963 14035 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.899737 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:15.911810 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1573) took 1208 ms. Trace:
I20260709 12:10:15.912104 13829 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:15.916463 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1308) took 1102 ms. Trace:
I20260709 12:10:15.918079 13809 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.918865 13747 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.919404 13809 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:15.919824 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 1.08679e+06us
I20260709 12:10:15.920053 13747 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.917191 12018 rpcz_store.cc:276] 0709 12:10:14.813359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.843402 (+ 30043us) service_pool.cc:224] Handling call
0709 12:10:14.843898 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.044315 (+200417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.915493 (+871178us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000aa854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:15.916136 (+   643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449049344}
I20260709 12:10:15.923295 13934 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.923719 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.923815 13757 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:15.924261 13934 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.922791 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:15.924692 13757 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.926011 13937 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.927428 13936 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:15.925760 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:15.922847 13813 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:15.925935 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.888346 13945 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:15.945351 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.938920 13813 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.934056 13936 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.950119 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:15.951251 12014 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.951522 14032 raft_consensus.cc:2272] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:15.948779 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.963291 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:15.964357 11871 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:15.970615 14032 ts_tablet_manager.cc:1916] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:15.971192 13747 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.973997 13757 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:15.979754 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58272.5us
I20260709 12:10:15.979481 13902 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.981926 14014 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:15.983009 14014 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.984786 13829 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.985931 14012 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:15.989037 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.989044 14010 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:15.990022 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.991509 14010 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:15.994755 14010 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.995404 13747 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.996326 13747 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:15.990381 13902 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.007483 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.016497 13934 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.007023 14014 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.028129 14042 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.028388 13722 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.028949 14042 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:16.012933 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:16.030516 14042 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:16.034309 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 98991.8us
I20260709 12:10:16.034528 12610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 218) took 1217 ms. Trace:
I20260709 12:10:16.036288 14026 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.038594 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40986 (request call id 407) took 1207 ms. Trace:
I20260709 12:10:16.039217 13809 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.039171 12604 rpcz_store.cc:276] 0709 12:10:14.831023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.848900 (+ 17877us) service_pool.cc:224] Handling call
0709 12:10:16.036060 (+1187160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.036583 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.036612 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.036675 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.036714 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.036804 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.038172 (+  1368us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400650250. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:16.038359 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728822528}
W20260709 12:10:16.002420 14051 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.255s	user 0.000s	sys 0.004s
I20260709 12:10:16.043726 13976 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.049914 13945 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:16.035200 12610 rpcz_store.cc:276] 0709 12:10:14.816592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.816719 (+   127us) service_pool.cc:224] Handling call
0709 12:10:16.034008 (+1217289us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b5400650254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:16.034300 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153518336}
I20260709 12:10:15.913923 11866 rpcz_store.cc:276] 0709 12:10:14.703134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.703280 (+   146us) service_pool.cc:224] Handling call
0709 12:10:14.716648 (+ 13368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.716941 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:14.730347 (+ 13406us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.817062 (+ 86715us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.820055 (+  2993us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.467294 (+647239us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:15.550773 (+ 83479us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b180032e960. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:15.908474 (+357701us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b180032e960. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:10:15.910535 (+  2061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.910695 (+   160us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:15.910877 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.911064 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.911389 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1094540,"prepare.queue_time_us":27761,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":128,"raft.queue_time_us":1098653,"raft.run_cpu_time_us":566,"raft.run_wall_time_us":4252,"spinlock_wait_cycles":387785600,"thread_start_us":84591,"threads_started":1,"wal-append.queue_time_us":127279}
I20260709 12:10:16.058755 12022 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:16.052019 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:15.997419 13813 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:15.999974 13747 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.126770 12014 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:16.138057 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62763us
W20260709 12:10:16.140301 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 159471us
I20260709 12:10:16.146245 14047 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:16.145710 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.140076 13936 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.151155 13936 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.152093 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.121179 13999 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.155545 13999 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.156136 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:16.153478 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.158385 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.159202 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.160036 13747 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:16.160550 13985 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.160948 13747 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.162388 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.161365 13957 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.163766 14036 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.164311 14036 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.164686 14036 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.145865 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.166244 12018 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:16.168493 12019 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:16.161275 13985 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:10:16.145682 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.165639 13747 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.189735 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.198336 12017 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:16.198537 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 45787.4us
I20260709 12:10:16.200840 11872 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.202323 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50477.1us
I20260709 12:10:16.205348 13985 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.206787 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.207446 11868 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:16.216672 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:16.217981 11944 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:16.220978 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.196388 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.197062 13976 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.250627 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:16.252367 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.248718 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.261933 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:16.262832 11945 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:16.262943 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.249460 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:16.250146 13813 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.277809 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.279903 11986 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.285919 13976 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.286458 13976 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:16.286872 13976 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.288798 13945 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.291057 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.296550 11944 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.271768 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.273864 13965 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.299141 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:16.311120 13965 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:16.311599 13965 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.299243 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.300295 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:16.314692 11870 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:16.301335 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.302109 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:16.303179 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57763.6us
I20260709 12:10:16.297214 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.315744 11864 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:16.249396 13936 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.322981 11868 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:16.325233 13819 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.014s
W20260709 12:10:16.330154 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 140670us
I20260709 12:10:16.323076 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.329699 11866 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:10:16.339017 11941 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.340672 13776 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.341128 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.341580 13776 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:16.343128 13776 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.343984 13747 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:16.352038 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 61084.3us
I20260709 12:10:16.345928 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.359109 13942 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.360471 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 114711us
I20260709 12:10:16.361177 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:16.354081 13945 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.369555 11871 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:16.381210 11986 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.382093 14032 ts_tablet_manager.cc:1929] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:16.382685 14032 log.cc:1199] T 3e361e6345864efa81f207f2a9dafda0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/3e361e6345864efa81f207f2a9dafda0
W20260709 12:10:16.385682 13978 consensus_meta.cc:287] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.008s
W20260709 12:10:16.387063 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64074.6us
I20260709 12:10:16.369076 13813 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.389649 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.383203 13932 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:16.386358 13978 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.399236 11948 raft_consensus.cc:2393] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:16.399586 14062 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 12:10:16.391336 13910 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.401093 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:16.414551 11941 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:16.405014 13942 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.415889 13976 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.418217 13936 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.418704 13936 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:16.420869 13976 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.427481 11872 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:10:16.429478 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:16.431903 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.432950 12014 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.437955 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.420809 13936 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.440543 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:16.443614 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 62528.4us
I20260709 12:10:16.442278 12019 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:16.438504 13732 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.454391 13813 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:16.462371 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:16.439880 14036 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.463088 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:16.463876 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.464354 13932 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.464843 13932 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:16.465303 13932 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.466535 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.467631 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.472580 13910 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.472641 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.473271 13910 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.473657 13910 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.475068 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.465126 14036 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.477708 12014 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:16.476434 14047 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.494423 14035 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.494964 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:16.496582 14010 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:16.497051 14066 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 12:10:16.497054 14010 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.499511 14010 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.505761 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.506989 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:16.507973 12018 raft_consensus.cc:606] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.508325 12018 raft_consensus.cc:614] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.507375 13942 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.486002 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:16.480729 13976 raft_consensus.cc:2764] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:10:16.521690 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.480274 13978 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.475159 13732 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:16.537356 13732 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.505100 13965 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.494975 14035 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:16.481590 13813 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:16.480890 13985 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:16.559592 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:16.568359 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.606333 14035 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.608270 12022 raft_consensus.cc:2393] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:16.611074 11768 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 2 to 3, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.612761 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.615444 14032 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36502 (request call id 73) took 1769 ms. Trace:
I20260709 12:10:16.620656 13932 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.554723 13942 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.623725 13893 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:16.624739 13809 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.625522 13965 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.627194 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:16.629130 13910 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.671373 12019 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.632890 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.670945 11941 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.635139 13813 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.640225 13936 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.648671 13747 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:16.615635 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.677055 12020 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.648651 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4084746649998579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22540000000000002s for a response
W20260709 12:10:16.657133 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.659528 13757 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:16.678301 13809 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.678746 13757 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.681058 13809 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.681635 13910 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:16.681751 13747 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.684146 13747 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:16.662914 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60261.3us
I20260709 12:10:16.686165 13936 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.687034 13932 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.686872 13813 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.688441 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.689210 12018 raft_consensus.cc:2393] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:16.565719 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.689967 13942 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:16.690199 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 126513us
I20260709 12:10:16.690747 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.691874 13942 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.666723 14032 rpcz_store.cc:276] 0709 12:10:14.830069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.830312 (+   243us) service_pool.cc:224] Handling call
0709 12:10:15.178199 (+347887us) ts_tablet_manager.cc:1151] Deleting tablet 3e361e6345864efa81f207f2a9dafda0
0709 12:10:15.200781 (+ 22582us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:16.197238 (+996457us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:16.381915 (+184677us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:16.588676 (+206761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724184,"tablet-delete.queue_time_us":277113,"thread_start_us":169307,"threads_started":1}
I20260709 12:10:16.676645 11768 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.690106 14035 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.697561 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:16.698279 12018 raft_consensus.cc:606] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.697757 11768 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 1 to 2, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 2 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.681376 13757 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.704967 11768 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 1 to 3, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:16.706247 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.700073 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.689147 13813 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.706532 11768 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.708119 11768 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.711784 13942 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.713245 13942 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.709228 13936 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:16.714934 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:16.715543 12018 raft_consensus.cc:606] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.715421 13936 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.717761 13936 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.713773 13757 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.718616 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:16.718573 13757 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.719334 12018 raft_consensus.cc:606] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.719695 12018 raft_consensus.cc:614] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.720957 13757 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.714392 13813 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.721660 13813 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.722596 12022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:16.723336 12022 raft_consensus.cc:606] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.723909 13813 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.724936 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:16.726384 13893 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.726996 13893 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.727871 13942 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.729596 13747 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.730268 13747 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.730821 13893 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.732501 13747 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.708865 11941 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:16.734589 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.739419 12019 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:16.722513 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.741957 12020 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
W20260709 12:10:16.745291 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58175.3us
I20260709 12:10:16.746542 13757 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:16.746634 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet 3e361e6345864efa81f207f2a9dafda0 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:10:16.747290 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:16.747359 13757 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.747830 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.748162 11948 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:16.749111 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.749902 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:16.751643 13757 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:16.752839 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:16.756968 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.760277 14047 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.760923 14047 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:16.762113 14047 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.760912 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.764040 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.765398 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.765641 13747 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.766352 13747 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.767088 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.768610 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.763700 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:16.768872 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46539.7us
I20260709 12:10:16.768652 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.766348 12014 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:16.765457 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.774067 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.774478 12013 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:16.765789 13945 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.773393 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.768858 13747 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.768987 13893 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.780787 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.776028 13910 raft_consensus.cc:993] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:16.783061 12014 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:16.782768 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.781301 13932 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.788779 13910 raft_consensus.cc:1081] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:16.789059 13932 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:16.775739 13945 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.784885 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:16.789637 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:16.790102 13932 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.791468 13945 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:16.791831 13910 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.786633 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.792225 13910 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.779234 13813 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.792593 13910 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.793144 13813 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.789510 13743 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.794445 13747 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.787417 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.778429 13757 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.793874 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.801189 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.722604 14010 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.803772 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.807461 13757 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.810310 13829 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:16.810976 13829 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:16.812057 13829 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.814402 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.816289 13819 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.824540 13913 raft_consensus.cc:993] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:16.825073 13913 raft_consensus.cc:1081] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:16.800011 13893 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.826197 13893 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.841653 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:16.842306 12020 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.843432 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49710.7us
I20260709 12:10:16.850375 11948 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:16.851090 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.852667 13813 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.858767 12603 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.861002 13757 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.861958 13757 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.862306 13757 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:16.863143 13757 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.858963 12015 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:16.865211 12015 pending_rounds.cc:85] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 4
I20260709 12:10:16.871296 12015 pending_rounds.cc:107] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:16.877626 12015 raft_consensus.cc:2889] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:16.881728 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 91082.9us
I20260709 12:10:16.865063 13757 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.886124 12608 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.877261 14036 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:16.890872 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:16.889513 12020 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:16.896010 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:16.897119 13965 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.893376 14010 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:16.898792 13965 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:16.900202 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.904044 11944 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.899873 13965 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.905848 13732 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.906215 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.908593 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:16.909792 13913 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.910163 13732 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.910251 13913 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:16.910889 13732 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:16.911499 13732 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.910960 13913 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.916399 14010 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:16.917309 14010 consensus_queue.cc:1243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:16.918288 13813 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.918658 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.918666 13813 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:16.920537 13747 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.920171 13813 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:16.922070 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.922812 13813 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.923483 13809 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.923678 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:16.925968 13809 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:16.926952 13809 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.927423 13910 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.929701 13985 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.930114 13910 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:16.936671 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:16.936969 13990 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.937670 13990 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:16.938122 13990 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.938894 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:16.920162 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.950218 13776 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.953913 13942 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.955448 12022 raft_consensus.cc:2368] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:16.956326 13893 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:16.957461 11941 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.964248 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44207us
I20260709 12:10:16.965737 13776 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.969883 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:16.975526 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:16.975883 12014 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.975764 11872 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.978787 13819 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.962792 14010 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.987306 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.990840 11865 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:16.996277 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.997686 12014 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.995664 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:16.999162 12016 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.999680 12022 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.963968 13910 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:17.003472 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:16.996954 12013 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:17.004449 11866 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.989426 13747 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.010874 11869 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.018743 11944 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:17.021641 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.025142 11945 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:17.006095 11865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:17.028028 11865 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:17.028575 11865 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.034204 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:17.018657 11872 raft_consensus.cc:2955] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:17.049515 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.053082 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:17.051105 13936 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.017386 13732 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.081869 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:17.091219 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49573us
I20260709 12:10:17.092150 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:17.098109 13819 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:17.098842 13819 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.101027 13819 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.101951 13819 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.102741 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.103459 11945 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:17.104305 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.104673 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.066716 13936 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.108243 13936 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.108035 13819 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.108476 14076 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.093897 13893 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.109102 14076 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.110679 11940 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:17.111657 14076 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:17.114840 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.125089 11865 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.145884 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.152303 13819 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:17.154639 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62554.6us
W20260709 12:10:17.161608 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.188351 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.154294 13945 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.194883 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.195544 13945 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.196316 11942 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:17.199213 11865 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.150226 13936 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.225725 13936 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:17.226356 13936 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.239770 13913 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.242926 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.244690 13913 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.247575 13942 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:17.248292 13945 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:17.250480 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.253595 13743 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.254021 13743 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:17.254837 13743 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.256031 13743 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.260638 12603 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.261605 11945 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.268795 13936 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:17.272663 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.274825 13732 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:17.301801 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:17.302958 13936 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.303269 12013 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.305521 13965 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:17.305866 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 154429us
I20260709 12:10:17.306996 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:17.309296 13893 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:17.309757 13893 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.310110 13893 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.317286 11945 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.326033 13893 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.326483 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.327332 11945 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:17.328590 13893 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.331473 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.331869 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.332381 11945 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:17.334363 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.334633 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.335302 11867 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.335557 11866 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:17.331480 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.338022 11945 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.339016 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.340171 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:17.340747 11945 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.342110 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.342855 12015 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:17.346364 14047 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.349387 12016 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:17.351469 11870 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.354223 13932 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 12:10:17.373840 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.221239 13990 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:17.376066 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 67592.3us
I20260709 12:10:17.388814 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:17.400738 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.401604 11872 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:17.403676 11946 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:17.411197 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67171.5us
I20260709 12:10:17.419945 11946 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:17.415123 11939 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.422776 11939 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:17.423931 11939 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.425238 11939 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:17.431932 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.425880 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.436825 13743 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:17.438354 13945 raft_consensus.cc:3055] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.438726 13945 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:17.441136 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.441529 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:17.416430 13776 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.447327 13776 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:17.448375 13776 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.448978 11939 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:17.449486 11939 pending_rounds.cc:85] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
I20260709 12:10:17.439776 13945 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.449604 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:17.519212 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.496821 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84823us
I20260709 12:10:17.499698 11945 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
W20260709 12:10:17.489681 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48306.3us
I20260709 12:10:17.450109 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.502274 12016 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:17.522694 11939 pending_rounds.cc:107] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:17.525147 11864 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:17.524417 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:17.526564 11945 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:17.525713 11939 raft_consensus.cc:2889] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.497409 14076 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.525998 13910 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.549213 13910 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.524928 13990 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.551457 13910 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:17.554325 13829 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:17.547097 13945 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.546600 14076 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:17.562436 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.547456 13942 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.564685 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:17.572494 13942 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.579794 13942 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.579820 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.587366 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.588201 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:17.589812 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.589337 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.553637 13893 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:17.590922 11866 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:17.591861 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 67505.2us
I20260709 12:10:17.592876 11864 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.552027 13985 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:17.595714 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.596655 11869 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:17.573213 14076 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.625330 14026 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.643558 14026 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:17.625854 13985 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:17.633936 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.634305 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:17.574235 13932 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:10:17.659324 14026 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.660856 14026 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.669755 13910 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.669883 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.670463 13910 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:17.670765 11945 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:17.671546 13976 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:17.672389 13976 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.645771 13985 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:17.674219 13985 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.675374 13976 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:17.675585 13985 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.678846 13942 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.682595 11945 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:17.701843 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 143307us
I20260709 12:10:17.715963 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:17.716668 11945 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:17.737613 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:17.746445 13945 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.671607 13910 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:17.766629 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 197187us
I20260709 12:10:17.777912 14105 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:17.771852 13945 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.779407 13945 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.761478 14108 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:17.782249 13942 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:17.783013 13942 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.783355 13942 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:17.784385 13942 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.796999 11868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
W20260709 12:10:17.797737 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.803298 13936 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:17.807936 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.825301 11865 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:17.808148 14076 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.800953 11868 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:17.801426 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.806905 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.806043 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.823962 13936 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.804605 11770 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:17.802062 14010 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:17.887907 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.835500 14093 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:10:17.897130 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 171) took 9747 ms. Trace:
I20260709 12:10:17.924350 14111 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.922899 11770 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:17.860615 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.934888 14111 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:17.926586 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.925470 14010 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.926992 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.936096 14111 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.937119 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.937790 14111 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.937912 14010 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.938418 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.939493 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.939334 11770 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:17.940240 11866 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:17.927304 11868 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.927779 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.940968 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.941893 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.931247 14076 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:17.828681 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53150us
I20260709 12:10:17.835009 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.942703 11869 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:17.942945 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 198310us
W20260709 12:10:17.953138 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 218457us
I20260709 12:10:17.934046 14118 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:17.917903 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.935781 11865 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:17.926898 11871 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:17.941946 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.928673 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.954923 11866 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:17.934619 11870 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.875710 13945 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.933157 13910 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:17.956169 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.961884 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.962546 13910 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.963052 14114 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:17.963645 14114 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.965899 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.966508 11866 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.940927 11770 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:17.956723 11873 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:17.957345 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:17.957476 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:17.958942 14105 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:17.958667 14118 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:17.975353 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:17.960088 13932 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:17.960391 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:17.980094 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.980468 11869 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:17.981510 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.981671 14105 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.977437 11770 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:17.983675 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.984794 11870 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:17.978015 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:17.986140 12018 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:17.978739 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.959667 13942 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.923832 13936 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:17.975924 11868 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:17.998143 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:17.989967 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:17.982934 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:17.999365 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:17.999398 11872 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.994143 11770 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:17.996459 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:17.998800 11864 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:18.008033 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.047936 11873 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.010043 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:18.112408 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.985414 14010 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.268947 13932 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.934682 11768 rpcz_store.cc:276] 0709 12:10:08.149519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.149780 (+   261us) service_pool.cc:224] Handling call
0709 12:10:08.230093 (+ 80313us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b540010ff90. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890f0b2 00007f1f21888759 00007f1f21820a76 00007f1f217f1d58 00007f1f218f004e 00007f1f1fdb12a4 00007f1f1fdb1232 00007f1f1fdb1161 00007f1f1fdb10dc
0709 12:10:17.897023 (+9666930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:16.889749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:16.890592 (+   843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:16.890651 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:16.890692 (+    41us) tablet.cc:662] Decoding operations
0709 12:10:16.891742 (+  1050us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:16.891875 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:16.891913 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:16.892604 (+   691us) tablet.cc:701] Row locks acquired
0709 12:10:16.892655 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:16.892870 (+   215us) write_op.cc:270] Start()
0709 12:10:16.893077 (+   207us) write_op.cc:276] Timestamp: P: 1783599016892792 usec, L: 0
0709 12:10:16.893113 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:10:16.914530 (+ 21417us) log.cc:844] Serialized 2482 byte log entry
0709 12:10:17.450609 (+536079us) op_driver.cc:464] REPLICATION: finished
0709 12:10:17.576665 (+126056us) write_op.cc:301] APPLY: starting
0709 12:10:17.576779 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:17.576997 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:17.577157 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:17.578229 (+  1072us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:17.578531 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:17.578582 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:17.578897 (+   315us) log.cc:844] Serialized 53 byte log entry
0709 12:10:17.579109 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.579245 (+   136us) write_op.cc:454] Released schema lock
0709 12:10:17.579323 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:17.579790 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.579823 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"spinlock_wait_cycles":52753024,"child_traces":[["op",{"apply.queue_time_us":91487,"apply.run_cpu_time_us":3115,"apply.run_wall_time_us":3114,"num_ops":6,"prepare.queue_time_us":147492,"prepare.run_cpu_time_us":21898,"prepare.run_wall_time_us":117099,"raft.queue_time_us":314633,"raft.run_cpu_time_us":28258,"raft.run_wall_time_us":167689,"replication_time_us":522902,"thread_start_us":511164,"threads_started":4,"wal-append.queue_time_us":133083}]]}
W20260709 12:10:18.386665 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.302474 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:17.991201 13976 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.388339 13976 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:17.986160 12577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.189s (SENT) [suppressed 14 similar messages]
I20260709 12:10:18.389199 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:18.389444 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.389930 11941 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.011556 13910 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.092885 12016 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:18.009212 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:18.392405 11870 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.978694 14076 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.395403 12022 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:18.395979 14076 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.396485 14076 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.042296 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.369577 12021 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:17.978754 14094 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.118573 13743 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.399916 14094 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.303346 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.400751 14094 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.400527 13743 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.401021 11867 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:18.010501 13945 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.051505 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.405930 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:18.406422 11864 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:18.408290 13893 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.052785 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:18.384121 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:18.097783 11868 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.385152 13902 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.384270 12020 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.033293 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:18.426587 11872 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 2: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:18.385319 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.385823 14010 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:18.385949 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.427995 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.428898 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.411931 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:18.412819 13910 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.386183 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:18.386590 13932 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.080024 12013 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:18.415313 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.418025 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.432576 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.434152 11941 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:18.428022 11870 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:18.437428 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.438508 11869 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:18.439131 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:18.451982 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.482785 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:18.493343 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:18.482484 13910 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.500301 13910 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.437960 13902 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.502722 13902 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.500859 13910 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.503619 11865 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:18.503405 13910 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.504354 14010 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.505096 11865 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.506913 13910 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:18.507664 14119 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:10:18.508008 11865 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.509193 11865 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:18.513722 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.514701 11865 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.515090 11865 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:18.515830 11865 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.516808 11865 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.518999 13932 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.488754 14111 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:18.520391 14116 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.520926 14116 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.523099 14116 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.523545 14107 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.530057 12020 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:18.533565 11865 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:18.291131 14114 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.545836 11865 pending_rounds.cc:85] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 1
I20260709 12:10:18.546238 11865 pending_rounds.cc:107] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:18.546577 11865 raft_consensus.cc:2889] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.558849 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:18.562709 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 576543us
I20260709 12:10:18.535686 13936 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.548138 14010 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.553984 14105 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.590977 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:18.591701 14121 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:10:18.600162 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.583362 14010 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.604514 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:18.583360 14120 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.607342 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:18.612183 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.604982 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:18.615594 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.617414 11872 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:18.597857 13965 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:18.618351 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.603507 14105 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.581429 13936 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.622570 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.620569 14114 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.626536 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:18.632279 14116 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.614511 14120 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.610901 12604 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.636722 13743 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.644598 14094 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.647029 13976 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.647683 14118 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.647373 13965 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.647363 11867 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
W20260709 12:10:18.655898 11866 consensus_meta.cc:287] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.001s
I20260709 12:10:18.684453 11866 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:18.653189 14076 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:18.677639 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57293.7us
I20260709 12:10:18.690518 11865 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:18.691232 11873 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:18.660254 13902 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.675319 14116 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:18.667336 14010 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.695027 11944 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:18.675364 14105 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:18.697273 11839 leader_election.cc:400] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:18.695962 13902 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.699973 13965 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.675428 14114 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.711411 11839 leader_election.cc:403] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:18.701025 14116 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.722749 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 228729us
I20260709 12:10:18.724406 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:18.726038 14094 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.728102 14076 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.688310 14093 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:18.706056 14118 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:18.731134 13902 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.731139 14118 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.732455 14114 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.734053 14120 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.736138 13936 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.719246 14010 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.719204 14111 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.744668 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.741526 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:18.722633 13976 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:18.747403 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 145475us
I20260709 12:10:18.754252 14105 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.757692 14118 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.758412 13976 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:18.763952 13942 consensus_meta.cc:287] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.001s
I20260709 12:10:18.770908 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.771621 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:18.745867 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:18.761397 13976 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.758457 14107 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.780652 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.784029 13936 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.785308 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.792299 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.769444 14125 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.773686 14127 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.752461 14111 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.788403 13819 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.813246 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:18.795135 13936 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:18.814451 13936 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.815961 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:18.816648 12019 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:18.795231 14118 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.782644 14107 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:18.819118 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.793565 13976 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:18.825106 13942 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.825398 14136 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:18.819604 13819 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.826871 13819 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.830204 14107 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.832108 14107 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.832737 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:18.834442 13976 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.836853 13976 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.841877 14118 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:18.842514 14118 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.844789 14118 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:18.850265 14111 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.850939 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:18.841271 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.864930 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.866194 12018 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:18.911152 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:18.911240 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46613.3us
I20260709 12:10:18.912674 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.877969 14130 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:18.926774 14129 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.927356 14129 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:18.861824 14116 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.928190 14129 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.889806 13976 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.942988 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.917906 14125 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:18.949920 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 155878us
I20260709 12:10:18.958364 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:18.960722 14026 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.937038 13976 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.961985 13976 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.930837 14116 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:18.929517 14129 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.940220 14010 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:10:18.941718 14105 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.963886 13942 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.978113 14125 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.939117 13819 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.966980 13990 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:18.967175 14026 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:18.982934 14026 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:18.983398 13819 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:18.984817 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 192620us
I20260709 12:10:18.986593 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:18.988695 12018 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.984200 13976 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:18.989849 14126 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.991016 14126 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:18.992988 14106 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:18.993397 14106 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:18.993870 12019 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:18.994290 14106 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:18.998392 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.002031 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.010775 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:18.997207 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.001451 14116 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.013723 12022 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:19.014232 13990 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:19.018577 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.028241 12018 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:19.019546 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.022521 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.025027 14107 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.029557 12019 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.029706 11867 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.032052 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.032708 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.029762 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.000313 14106 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.034430 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.035491 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.037467 11945 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:19.037786 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.039592 14144 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.045620 14118 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.996037 14010 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:19.042543 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.042953 11940 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:19.042059 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.048286 11942 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:19.044674 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:19.015786 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46147.3us
I20260709 12:10:19.052807 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.054248 11948 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:19.054108 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.054872 11866 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.057482 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.058101 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.058677 11869 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.059623 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.060196 11867 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:19.060484 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.060737 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.061681 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.061969 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.063221 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.063329 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.063750 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.064289 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.064687 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.065237 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.065568 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.066334 11945 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.066571 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.027842 13990 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:19.068130 11871 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:19.068351 11867 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:19.063951 11872 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:19.065307 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.084905 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.085955 11873 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:19.090082 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.090466 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.090869 11870 raft_consensus.cc:2376] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4. Re-sending same reply.
I20260709 12:10:19.091444 11867 raft_consensus.cc:2376] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5. Re-sending same reply.
I20260709 12:10:19.092610 11869 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:19.093762 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.093890 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.095103 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.095389 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.096207 11942 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:19.076736 14144 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:10:19.097692 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.098332 14144 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.098752 14144 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:19.099610 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.049757 14105 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.038661 14116 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.099653 14144 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.104229 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.104681 14144 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.104918 11873 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:19.105402 12019 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:19.101717 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.049829 13976 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:19.111128 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 107194us
I20260709 12:10:19.097784 14138 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.118252 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:19.037803 14107 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.083463 11866 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:19.113435 14126 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:19.106524 14010 consensus_queue.cc:1175] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "189a165e6619406382914fe3075dd436" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:10:19.130187 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.143930 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.126120 14148 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:19.124884 13976 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.126832 13990 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:19.139254 12577 leader_election.cc:336] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.617s (SENT)
I20260709 12:10:19.149896 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.149590 11944 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:19.149663 14116 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:19.151890 14116 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.154263 14116 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.154346 14111 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:19.155390 11945 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:19.158088 13976 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.160115 14107 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.149212 14127 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:19.162062 14127 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.112612 14105 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.140614 14130 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.172298 14105 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:19.148299 14120 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.174371 14120 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:19.174755 14120 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:19.176101 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62196.9us
I20260709 12:10:19.147897 14126 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:19.178401 14126 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.179651 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.178380 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.180457 14117 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.168762 14130 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:19.184926 14130 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.188531 14127 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.189363 13819 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:19.185176 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.190043 13819 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:19.168581 14114 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.176501 14136 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.194706 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.149384 14148 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.226435 14139 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.227025 14139 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.229182 14139 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.213018 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.238425 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.213217 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:19.183527 14117 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:19.202984 13942 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:19.193138 14105 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.213018 13902 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.239902 12018 raft_consensus.cc:606] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.222209 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.240427 12018 raft_consensus.cc:614] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.240561 14105 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.224982 13990 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.239923 14117 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.241668 13942 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.242059 13942 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:19.242864 13942 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.244282 13942 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.246016 13902 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:19.247426 13902 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.229636 14148 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.210917 13819 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.254295 11941 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:19.231763 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.232339 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.262128 11866 raft_consensus.cc:2376] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4. Re-sending same reply.
I20260709 12:10:19.234293 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.239709 13976 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:19.268505 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.269917 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.270859 14154 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:19.273875 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.269781 14105 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.271489 12604 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 1.
I20260709 12:10:19.296020 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:19.299142 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:19.299826 12018 raft_consensus.cc:606] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.300176 14154 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:19.301653 14114 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:19.294807 13976 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:19.294498 14107 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:10:19.306677 14120 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.307176 14148 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.308370 14136 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.308764 14136 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:19.301332 14154 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.309860 14136 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.296311 13990 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:19.311801 14136 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.313967 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:19.314658 11941 raft_consensus.cc:606] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:19.315140 11941 raft_consensus.cc:614] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.319749 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:19.323204 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.323101 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.326932 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.329087 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.333014 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.330042 13932 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.395965 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69098.6us
I20260709 12:10:19.451005 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.334379 13932 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.330113 13902 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.328671 14148 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.331465 14139 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.420147 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.455412 11839 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:19.455902 11839 leader_election.cc:403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.456250 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.429452 14158 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.438088 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:19.437832 14144 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:19.439394 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 107043us
I20260709 12:10:19.322729 14114 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.447594 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.448302 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.473794 12020 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:19.453851 13902 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:19.459667 12018 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.479665 12018 raft_consensus.cc:614] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.473876 12014 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:19.456916 11871 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:19.457114 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.458760 14139 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.449661 14120 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:19.471882 13976 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.464707 13942 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:19.464210 14127 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.470709 14010 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:19.454623 14106 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.449451 14130 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.497505 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:19.484764 14114 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.538945 12018 raft_consensus.cc:606] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:19.539728 12018 raft_consensus.cc:614] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.498347 14129 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:19.513290 14154 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:19.497777 14137 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:19.546043 14141 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.546663 14141 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.486128 14139 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.548878 14141 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.550702 14154 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.553227 14154 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.452078 14117 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.553830 14148 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.555212 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:19.505782 13902 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.557961 14117 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.557739 11769 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.499022 13932 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:19.562042 11769 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 5 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:19.563728 11769 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.520246 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 117) took 3643 ms. Trace:
W20260709 12:10:19.518723 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67790.4us
I20260709 12:10:19.500336 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.568946 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:19.500787 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:19.572352 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 71641.7us
I20260709 12:10:19.520653 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:19.575290 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 75018.6us
I20260709 12:10:19.576285 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.591404 12014 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:19.609189 12022 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:19.577756 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57180.9us
I20260709 12:10:19.610852 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.594055 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.485123 14111 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:19.613523 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.620574 12019 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:19.573371 14114 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.486227 14126 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.520931 14107 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:19.634400 14107 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.628126 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.500494 14144 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:19.566344 11770 rpcz_store.cc:276] 0709 12:10:15.841638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.842150 (+   512us) service_pool.cc:224] Handling call
0709 12:10:19.484544 (+3642394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:18.630478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:18.631019 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:18.631053 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:18.631071 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:18.752382 (+121311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:18.766042 (+ 13660us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:18.766094 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:18.766645 (+   551us) tablet.cc:701] Row locks acquired
0709 12:10:18.766663 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:18.766823 (+   160us) write_op.cc:270] Start()
0709 12:10:18.766954 (+   131us) write_op.cc:276] Timestamp: P: 1783599018766773 usec, L: 0
0709 12:10:18.766977 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:18.790870 (+ 23893us) log.cc:844] Serialized 2892 byte log entry
0709 12:10:19.214830 (+423960us) op_driver.cc:464] REPLICATION: finished
0709 12:10:19.406200 (+191370us) write_op.cc:301] APPLY: starting
0709 12:10:19.406310 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:19.406576 (+   266us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:19.406719 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:19.430271 (+ 23552us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:19.430469 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:19.430512 (+    43us) write_op.cc:312] APPLY: finished
0709 12:10:19.430765 (+   253us) log.cc:844] Serialized 53 byte log entry
0709 12:10:19.430954 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.431062 (+   108us) write_op.cc:454] Released schema lock
0709 12:10:19.431106 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:19.431488 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.431515 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":191047,"apply.run_cpu_time_us":3025,"apply.run_wall_time_us":25275,"num_ops":6,"prepare.queue_time_us":349908,"prepare.run_cpu_time_us":11278,"prepare.run_wall_time_us":256072,"raft.queue_time_us":140571,"raft.run_cpu_time_us":10728,"raft.run_wall_time_us":106557,"replication_time_us":431531,"thread_start_us":535859,"threads_started":4,"wal-append.queue_time_us":170233}]]}
I20260709 12:10:19.627487 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.640359 12015 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:19.627813 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.485242 14116 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:19.573925 14120 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.493062 14125 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:19.634815 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.608569 14010 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.620061 14127 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:19.633646 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.533836 14106 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.647207 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.638942 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.647794 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.585747 13990 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.666435 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.643020 14116 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:19.498817 14145 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 12:10:19.655261 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.656427 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.672200 12021 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 2: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:19.656773 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.659005 11769 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.645385 14111 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:19.652923 14158 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.668596 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.577730 13932 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.628517 14141 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:19.676443 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.661250 14106 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.651187 14120 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:19.643906 14126 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.694031 14127 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:19.695349 12606 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:19.695896 11769 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.701812 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.705700 12015 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:19.705832 14136 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.707582 14126 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.707319 11769 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.651575 14125 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.710448 14125 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.708177 14141 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.670949 14107 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.687465 13932 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:19.712527 14129 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.727106 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.704034 14139 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:19.726042 14116 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.728004 13932 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.875214 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.881067 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.735582 14120 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.738333 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.884670 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:19.795837 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 105722us
I20260709 12:10:19.885875 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.740631 14111 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.886500 14116 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.831151 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.739065 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.825474 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.893786 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.895156 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.896667 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.899348 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.833935 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.899971 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.900648 11864 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:19.770023 14127 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.835965 14106 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.880472 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.732833 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:19.881989 11868 raft_consensus.cc:2368] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:19.905916 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.906086 12603 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:19.799921 11942 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:19.849068 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.908175 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:19.855618 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.857386 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.909143 12019 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 2: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:19.910086 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.910378 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.911381 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:19.912214 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.912005 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:19.913075 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:19.913620 14106 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.914529 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:19.915237 11871 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:19.915725 11864 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:19.916100 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.920673 12014 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:19.912019 12019 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:19.886976 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.924275 12015 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:19.738188 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:19.933490 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47672.7us
I20260709 12:10:19.936527 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.937744 14171 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:19.936444 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 254338us
I20260709 12:10:19.935191 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.939507 11939 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:19.802031 14130 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.933115 11944 raft_consensus.cc:2368] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3.
I20260709 12:10:19.731454 14129 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:19.940943 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.941812 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.938911 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.842681 14144 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:19.949442 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:19.833882 14141 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:19.943226 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:19.943943 11942 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:19.889627 14010 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:19.935220 14139 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:19.954958 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.955857 14168 raft_consensus.cc:476] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Not starting pre-election -- already a leader
W20260709 12:10:19.961853 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 278488us
I20260709 12:10:19.956657 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:19.957419 14010 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.942648 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:19.971496 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:19.974126 11941 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:19.978087 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.975718 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:19.980217 12020 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:19.980317 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:19.982323 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.983078 12021 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:19.837808 13902 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:19.984639 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:19.948599 14094 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.963807 14127 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.005237 11942 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:20.007465 11942 pending_rounds.cc:85] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 2
I20260709 12:10:20.007742 11942 pending_rounds.cc:107] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:20.008004 11942 raft_consensus.cc:2889] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:20.008173 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.009209 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.010947 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.013085 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.013824 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:20.014514 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:19.986575 12604 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.017091 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.017947 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.018824 12018 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:20.022960 12018 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:20.020089 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.023788 11948 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:20.003618 14094 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:20.020632 11946 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:20.027484 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:20.029323 11871 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:20.030669 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:20.031602 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:20.032871 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:20.033444 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.034458 11947 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:20.037343 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.038218 11869 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:20.002553 14174 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.008980 13893 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.067474 12021 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:20.077557 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44178.8us
I20260709 12:10:20.033469 11868 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:20.012943 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:20.089928 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.084735 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:20.091672 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.092495 14158 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.093755 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.095667 14158 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.037019 14094 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.102069 11864 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:20.079341 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:20.101372 11871 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:20.104084 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.068528 13942 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.067351 14164 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.103688 12603 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:20.074347 14129 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.084579 14127 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.110510 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.105508 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.106853 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:20.085510 13893 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.135324 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.135985 12022 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.110977 11864 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.106405 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.113390 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.114823 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:20.118371 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 133802us
I20260709 12:10:20.143589 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.144485 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.145323 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.120040 12020 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:20.106103 14144 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.122258 14114 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.111552 14148 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.124500 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.125123 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.160255 12015 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.120499 12017 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.119486 12014 raft_consensus.cc:2393] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:10:20.151649 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45336.8us
I20260709 12:10:20.131484 13893 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.150766 13942 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.182917 12022 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:20.184104 12013 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:20.153947 14117 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.161128 14174 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.153435 14158 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.166795 14148 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.160985 14164 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:20.105453 14179 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:20.091818 14184 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.121526 14169 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.121935 14178 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.120450 14176 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.236083 12015 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:20.171249 14177 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:20.240093 14181 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:10:20.204210 14148 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.122960 14173 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.260s
I20260709 12:10:20.250067 13902 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:20.251808 13932 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.301249 11865 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.308434 14127 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.308629 13932 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.270802 14176 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.309799 12603 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.310010 14114 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:20.315644 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.316404 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:20.325745 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:20.326894 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:20.320972 11864 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:20.322227 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 171744us
W20260709 12:10:20.337123 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 188805us
I20260709 12:10:20.339300 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.339582 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.346395 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.353488 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.344889 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.359026 11872 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:20.358209 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.366051 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.356055 14116 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.371510 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.356549 14127 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.398595 14158 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:20.400416 14158 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.400810 14158 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.401144 14158 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.382961 11865 raft_consensus.cc:2410] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.371119 14190 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.385142 12604 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:20.386380 14010 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.363693 13902 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.360994 14114 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.420975 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 89052.9us
I20260709 12:10:20.418694 13902 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.422546 14154 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.422883 13902 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.430217 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:20.422155 14188 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:10:20.435382 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 63948.6us
I20260709 12:10:20.438536 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.439095 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.440997 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.441856 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.444348 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:20.444509 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.445008 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.445775 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.435406 14136 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.440599 14114 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:20.448030 14148 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.449561 14094 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.449939 14026 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:20.450989 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.451735 14094 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:20.451653 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:20.446380 12021 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4. Re-sending same reply.
I20260709 12:10:20.453800 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.454294 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.455013 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.452293 12606 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:20.457108 11988 leader_election.cc:400] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:20.466624 11988 leader_election.cc:403] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.464820 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:20.456171 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.419111 14010 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.442370 14107 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.470456 14107 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.470877 14107 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.474819 14127 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.468688 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:20.463011 14144 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.463239 14177 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.480085 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.453192 14184 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.468195 14179 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.469136 14111 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.468667 14196 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.487354 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:20.489498 14189 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:20.489218 13976 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.478108 14127 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:20.505582 14111 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.505491 14127 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.506667 14111 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.510090 14196 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.511085 14196 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.519129 12014 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:20.491570 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.491536 14190 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.494359 14198 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:20.502174 14141 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:20.502919 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.502604 13893 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.486353 13942 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.504220 14148 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:20.482220 14114 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.507850 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.535573 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.538959 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.548542 11940 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:20.548573 11873 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.549285 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:20.550203 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.550352 14153 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.550992 14200 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.551663 14093 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:20.551862 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:20.552359 14179 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.556795 14184 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.553264 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.544970 13976 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.581319 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.582054 12015 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:20.583940 14026 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:20.589890 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.593068 14010 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.573860 14168 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:20.600773 14026 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.600546 13902 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.603039 13902 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:20.605273 14158 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.605701 14106 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:20.605993 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.606825 11870 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:20.606920 14106 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:20.607319 14106 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.607432 14158 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:20.608250 14106 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.610620 14129 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.612998 11867 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:20.614203 14094 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.614418 11866 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:20.614755 14094 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.601405 14026 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:20.616169 14026 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.615729 14094 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.617098 14094 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:20.622014 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.608265 14107 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.622699 14106 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.626291 12016 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:20.627135 13893 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.581755 14116 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:20.628365 14116 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.628849 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:20.630103 12608 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.630427 14116 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.579490 14177 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:20.631268 14177 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.632719 14107 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.633248 14177 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.582156 14144 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.586710 14141 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.638232 12577 leader_election.cc:400] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3.
I20260709 12:10:20.639006 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.642691 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.645949 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.646112 12014 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:20.655804 11865 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:20.646150 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56362.8us
I20260709 12:10:20.660156 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.655907 11866 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.660921 12022 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.580711 14184 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.648357 11873 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:20.649093 14174 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.649180 14168 consensus_queue.cc:1243] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:20.656589 12577 leader_election.cc:403] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.658510 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.665939 14200 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:20.666519 13990 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:20.668995 11864 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:20.671835 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:20.680716 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 139038us
I20260709 12:10:20.660372 14093 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.699182 14184 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.722858 14093 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:20.707042 12020 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:20.703935 11865 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:20.706358 14174 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:20.724938 12014 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:20.725031 14174 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.725217 14168 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.705436 12022 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:20.736204 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 57997.5us
W20260709 12:10:20.736358 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52888.9us
W20260709 12:10:20.738708 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 100636us
I20260709 12:10:20.723394 14093 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.742614 11866 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:20.748072 11869 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:20.748541 11869 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:20.750216 14026 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.756969 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.758836 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.759992 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.763204 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.749368 11869 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.765322 11869 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.766396 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.767632 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.765139 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.776559 11867 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:20.777496 12021 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:20.779400 12013 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:20.726369 14168 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.781370 11869 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:20.740419 14137 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3.
I20260709 12:10:20.782481 11869 pending_rounds.cc:85] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:20.787096 11869 pending_rounds.cc:107] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:20.740199 14171 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:20.762750 14116 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.791191 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.773695 14198 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.787567 11869 raft_consensus.cc:2889] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:20.777066 13893 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:20.777635 14144 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.801752 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:20.805274 14173 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:10:20.823868 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70124.5us
I20260709 12:10:20.786742 14177 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:20.801049 13893 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.791923 14141 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:20.840768 14206 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.822362 14196 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.850980 14196 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.844650 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:20.862253 12604 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:20.864177 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.864159 13893 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.867172 13893 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.787415 14205 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:10:20.835546 14171 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:20.870648 14093 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.873485 14093 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:20.825052 14153 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:20.884351 14026 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.889577 13819 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.890461 13819 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.891652 13819 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.893808 14196 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:20.895473 14196 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.899721 14176 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:20.900979 14168 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:20.910383 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:20.918167 14125 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.919575 14111 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:20.877146 14184 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.924996 12610 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:20.925348 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:20.926692 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:20.926828 12608 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.933686 14026 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.934320 14026 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.934379 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:20.935163 12603 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:20.935519 14026 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.887843 14214 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.937069 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:20.938215 14120 raft_consensus.cc:993] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:20.938763 14120 raft_consensus.cc:1081] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:20.940068 14106 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:20.934639 14125 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.942320 14125 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:20.943354 14125 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:20.951628 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.952498 12021 raft_consensus.cc:2393] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:20.954203 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:20.970026 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.970793 11940 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:20.972772 11868 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:20.976907 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:20.997463 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:20.998251 12018 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:20.969278 14168 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.962549 14214 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:20.969254 14173 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:21.035465 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.974799 14200 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:21.047640 11942 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.048849 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:20.982633 14205 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:21.050853 11939 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:21.008177 14168 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.055068 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.058104 11947 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:21.039744 14171 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.068785 14168 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.026060 14174 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.095542 12604 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:21.098505 14219 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:21.112970 11866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:10:21.113767 11866 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:21.114140 11866 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.041913 14173 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.119352 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:21.121727 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:21.130062 14094 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.513s	user 0.016s	sys 0.000s
I20260709 12:10:21.132758 14168 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.135677 12610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 247) took 1030 ms. Trace:
I20260709 12:10:21.136097 12610 rpcz_store.cc:276] 0709 12:10:20.104919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.106516 (+  1597us) service_pool.cc:224] Handling call
0709 12:10:21.135497 (+1028981us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540059fbd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:21.135589 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811304320}
I20260709 12:10:21.137372 11872 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.155807 14168 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.157305 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:21.157930 14172 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.158187 12604 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.158649 14172 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.159089 14172 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.082602 14171 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:21.165704 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 44097.6us
W20260709 12:10:21.166337 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.166534 14170 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:21.167172 14170 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:21.168094 14170 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:21.178153 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 137872us
I20260709 12:10:21.176273 14184 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:21.187597 14215 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:10:21.173846 14026 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:21.217337 14107 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.224228 14174 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.226236 14120 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.257560 14145 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:21.266567 11866 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.237957 14107 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:21.270661 14145 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.120355 14214 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.271554 14171 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.241591 14026 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:21.279268 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 100323us
I20260709 12:10:21.280690 11866 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.259613 14120 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.289654 14145 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.290638 14107 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.292578 14173 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.296049 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:21.309490 14107 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.329730 14120 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.331538 14120 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.317623 14116 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.344672 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.345933 11944 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:21.345970 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.346635 11939 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.348062 11942 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.348820 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:21.350934 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 282563us
I20260709 12:10:21.359613 14114 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.361805 14130 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:21.365836 14172 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.370847 14172 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.382391 14205 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:21.383030 14205 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.385490 14205 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:21.393988 14233 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.394649 14233 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:21.395138 14234 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:21.366719 12014 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.396862 14233 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.397650 14236 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.400159 12604 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:21.400488 14236 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.361107 14190 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:10:21.402598 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57979.7us
I20260709 12:10:21.414510 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.418274 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:21.431710 11865 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:21.434942 11939 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:21.427917 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:21.439896 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.444921 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:21.452853 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:21.453231 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:21.454856 12020 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:21.458101 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54650.8us
I20260709 12:10:21.427681 14184 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.474192 14184 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.476418 14184 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.450453 14179 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.478755 14179 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:21.479744 14179 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.455911 14190 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:21.401803 14116 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.482035 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.483078 12016 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:21.463049 14158 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.470455 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.471099 14236 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.442775 14205 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:21.486562 11867 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:21.489604 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.520079 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.527693 11867 pending_rounds.cc:85] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
I20260709 12:10:21.528520 11867 pending_rounds.cc:107] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:21.517881 12016 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:21.529045 11867 raft_consensus.cc:2889] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:21.529814 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 73326.8us
I20260709 12:10:21.530926 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.527693 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.528450 12015 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:21.492383 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.462962 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.484023 14116 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.518728 11869 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:21.541477 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 78603.6us
I20260709 12:10:21.542285 12017 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.458439 14168 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:10:21.552878 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.446115 14130 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:10:21.566044 14242 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.527590 14205 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.571187 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.540985 14158 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.462997 14206 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:10:21.581969 12020 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:21.574731 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.558387 14216 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.549386 14173 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.589248 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:21.596370 12013 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.604341 12013 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.605348 12013 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.581813 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:21.556994 14184 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:21.561935 14116 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:21.612346 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.620061 12013 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.623643 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.587190 14010 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:21.608866 14242 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.629978 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:21.648202 14247 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:21.648811 14247 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.620047 12604 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:21.485284 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:21.645434 14158 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.634747 14139 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:21.663990 14139 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.666067 14139 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.671561 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:21.675436 14232 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 12:10:21.677165 14177 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.677814 14177 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.678164 14177 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.632345 14242 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.684041 11867 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:21.692088 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:21.692996 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:21.696923 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:21.690480 14242 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.702636 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:21.703329 12017 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.706022 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.625659 14205 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.707129 14205 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:21.716689 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 86780.6us
W20260709 12:10:21.713220 14164 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:21.714093 14184 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.719532 12017 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:21.741813 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:21.733337 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:21.750802 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.751689 14176 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:21.725397 14251 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.186s	user 0.002s	sys 0.000s
I20260709 12:10:21.724449 14026 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.758771 12603 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.719918 14237 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.760490 14184 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:21.761495 14184 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.765038 14247 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:21.767125 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.772500 14216 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.773132 14216 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.774216 14216 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.767215 11864 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.782431 14154 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.785038 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:21.787246 14145 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.787820 14145 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:21.788754 14145 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:21.796082 14252 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.259s	user 0.003s	sys 0.000s
I20260709 12:10:21.807221 14120 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.807996 14120 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:21.817035 12018 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.831048 14237 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:21.832791 14237 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.835438 14256 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.843724 11948 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.846057 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.846863 11944 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.849759 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.854295 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.855252 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.855881 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.850904 11946 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.853521 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.858172 11943 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:21.860069 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.860476 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.864120 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:21.866874 12021 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.870976 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:21.871218 12014 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:21.873845 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.881747 11946 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:10:21.871238 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:21.888230 11864 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:21.892941 11944 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:21.893755 14244 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.894217 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.893926 14120 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:21.895450 14120 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.896593 14245 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.897230 14245 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.896611 12020 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.902139 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:21.903043 14026 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.903419 14026 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.903762 14026 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:21.905778 14254 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.365s	user 0.003s	sys 0.003s
W20260709 12:10:21.850862 14248 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.313s	user 0.005s	sys 0.000s
W20260709 12:10:21.916684 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.928417 14245 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:21.929920 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:21.930686 12020 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:21.935663 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:21.939129 14176 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.939677 14176 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.940069 14176 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.942843 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:21.943660 11939 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:21.958132 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:21.966112 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:21.967619 14217 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.970299 14217 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.970836 14217 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.971535 14217 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.945164 14177 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:21.983485 14094 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.029563 11871 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.052372 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:22.043591 14217 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.059023 14217 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.041713 12604 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.071909 14010 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:22.072748 14010 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.075541 14010 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.086671 14094 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.087854 14239 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:22.089977 14239 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.088002 14153 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:22.091081 14235 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.091452 14235 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:22.092280 14235 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:22.094611 14260 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:22.096124 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:22.097266 14010 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.097740 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:22.098745 14010 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.100647 14177 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:22.101125 14244 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.101176 14010 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:22.102180 14242 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.103775 14235 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.111552 12018 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:22.112355 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:22.113464 14010 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.120944 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:22.121834 11947 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:22.120997 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.120942 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:22.128516 11869 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:22.140868 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:22.144620 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.152463 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.162240 14214 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.143841 14244 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:22.164448 14139 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.211280 14244 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:22.211990 14244 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:22.213196 14244 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.215262 14244 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.176489 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:22.184880 14242 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:22.233886 14265 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:10:22.191850 14026 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.183806 14239 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:10:22.265913 14176 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:22.274166 14253 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.562s	user 0.000s	sys 0.007s
I20260709 12:10:22.282465 14242 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:22.193778 14214 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.299510 11947 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:10:22.294977 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.300014 11947 pending_rounds.cc:85] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
I20260709 12:10:22.300819 11947 pending_rounds.cc:107] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:22.301200 11947 raft_consensus.cc:2889] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.301709 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.305167 12019 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:22.300412 14093 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:22.322438 11947 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:22.333978 14120 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.341679 14214 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.295990 14242 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.352707 14242 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:22.354254 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:22.357278 11872 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.373454 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:22.379544 14176 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:22.389328 14250 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.743s	user 0.005s	sys 0.000s
W20260709 12:10:22.399624 14263 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 12:10:22.405408 14256 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.406184 14256 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.408797 14256 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:22.416290 14026 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:22.420382 11769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 190) took 12593 ms (client timeout 15000 ms). Trace:
I20260709 12:10:22.425606 11866 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:22.426157 11866 pending_rounds.cc:85] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:22.426437 11866 pending_rounds.cc:107] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:22.426715 11866 raft_consensus.cc:2889] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.432763 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:22.434886 14200 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.435501 14200 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.439710 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:22.441947 14200 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:22.421015 11769 rpcz_store.cc:269] 0709 12:10:09.826740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.828029 (+  1289us) service_pool.cc:224] Handling call
0709 12:10:22.420274 (+12592245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:20.037193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:20.266918 (+229725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:20.269310 (+  2392us) write_op.cc:435] Acquired schema lock
0709 12:10:20.270420 (+  1110us) tablet.cc:662] Decoding operations
0709 12:10:20.411216 (+140796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:20.420127 (+  8911us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:20.422008 (+  1881us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:20.446254 (+ 24246us) tablet.cc:701] Row locks acquired
0709 12:10:20.446276 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:10:20.446420 (+   144us) write_op.cc:270] Start()
0709 12:10:20.446532 (+   112us) write_op.cc:276] Timestamp: P: 1783599020446373 usec, L: 0
0709 12:10:20.446556 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:20.447215 (+   659us) log.cc:844] Serialized 2482 byte log entry
0709 12:10:20.755155 (+307940us) op_driver.cc:464] REPLICATION: finished
0709 12:10:20.838387 (+ 83232us) write_op.cc:301] APPLY: starting
0709 12:10:20.838482 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:20.838671 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:20.838810 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.839585 (+   775us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.839795 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:20.839847 (+    52us) write_op.cc:312] APPLY: finished
0709 12:10:20.840122 (+   275us) log.cc:844] Serialized 53 byte log entry
0709 12:10:20.840307 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.840429 (+   122us) write_op.cc:454] Released schema lock
0709 12:10:20.840479 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.846476 (+  5997us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.846506 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":199909,"reported_tablets":34,"spinlock_wait_cycles":408448,"child_traces":[["op",{"apply.queue_time_us":78955,"apply.run_cpu_time_us":2529,"apply.run_wall_time_us":8033,"num_ops":6,"prepare.queue_time_us":294101,"prepare.run_cpu_time_us":16055,"prepare.run_wall_time_us":469789,"raft.queue_time_us":166730,"raft.run_cpu_time_us":21797,"raft.run_wall_time_us":149060,"replication_time_us":290636,"thread_start_us":346676,"threads_started":4,"wal-append.queue_time_us":48763,"wal-append.run_cpu_time_us":28328,"wal-append.run_wall_time_us":1350235}]]}
I20260709 12:10:22.461963 14244 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.462890 14244 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:22.463590 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 103067us
I20260709 12:10:22.466830 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:22.467578 12610 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:22.469043 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:22.465468 14244 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:22.475520 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 168203us
I20260709 12:10:22.440496 11768 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.491272 11768 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.466187 14179 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:22.594857 12021 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.596416 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.597653 12019 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:22.602461 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.607242 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:22.608777 12021 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.607375 14256 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:10:22.614229 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 425548us
I20260709 12:10:22.615597 12608 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.594879 11768 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.494026 14244 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.573662 14190 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.618193 11768 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.638833 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:22.629851 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 4 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.649940 11768 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 6 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.652439 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.653105 11947 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:22.655905 11947 pending_rounds.cc:85] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 5
I20260709 12:10:22.653744 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:22.656222 11947 pending_rounds.cc:107] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:22.654057 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:22.656075 11864 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:22.656839 11947 raft_consensus.cc:2889] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.620232 14244 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.663857 12021 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:22.610940 14176 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:22.615464 14120 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:22.607497 14179 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.628450 14190 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.674933 14235 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.689069 14235 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.666437 14274 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:22.695820 14283 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.696507 14283 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:22.697558 11758 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:22.698406 11871 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:22.628016 14281 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:22.666826 14244 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.699522 14281 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:22.699896 14281 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:22.700673 14281 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.691346 14235 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.704852 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:22.705670 11947 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:22.707190 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:22.708585 14164 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.708981 14164 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.709308 14164 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.624230 14216 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:22.715381 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.716821 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.720031 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.658792 14217 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:22.722506 14217 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.722895 14217 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:22.723804 14217 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.662637 13932 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.724997 13932 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.673168 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:22.725418 13932 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.725867 11939 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.720798 13893 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:22.720023 14179 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.731114 14283 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.689695 14190 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:22.734464 14094 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.751466 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:22.752868 14179 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.753392 14179 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:22.753841 14179 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.751715 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:22.731544 14281 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.758209 14190 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.761958 12018 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.763497 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.764508 12018 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:22.769047 14217 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.773020 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4755afb6a253477badd7f673bff77faa"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:22.773898 12018 raft_consensus.cc:606] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.774296 12018 raft_consensus.cc:614] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.781150 11947 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:22.784245 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:22.786257 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:22.789151 11941 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.789016 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:22.790270 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:22.790900 11948 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:22.793278 11944 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.796694 11943 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:22.803659 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.805472 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.808117 11939 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:22.651402 11768 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 5, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.811944 11768 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 6, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.815191 11768 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:22.813618 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60774us
I20260709 12:10:22.821563 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.822295 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:22.823082 12013 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:22.822458 11868 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:22.839028 12022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:22.839820 12022 raft_consensus.cc:606] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.839902 11768 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.842048 11768 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 4 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.827327 14120 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.864226 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 205149us
I20260709 12:10:22.857755 11768 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 2, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 2 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.806000 14164 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.867880 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:22.871992 11768 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 3, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.865118 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:22.877882 11768 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.881997 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.886540 11768 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 1 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:22.836206 13932 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.889982 12018 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:22.877131 14172 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.898957 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:22.864344 14116 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:22.892462 14094 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:22.910087 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82503.4us
I20260709 12:10:22.886826 14235 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:22.872942 14120 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.914072 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:22.918421 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:22.924789 14295 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:22.925945 14010 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.926349 14010 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:22.926728 13932 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:22.927285 14010 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:22.928574 14010 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.930751 14244 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:22.932421 11867 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:22.940881 11939 raft_consensus.cc:606] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:22.941403 11939 raft_consensus.cc:614] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.943653 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:22.946671 11942 raft_consensus.cc:2410] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:22.947327 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:22.912510 14154 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.943059 14172 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:22.949040 14247 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:22.959528 14295 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.954805 14010 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.959775 14154 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.984897 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:22.954769 14242 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:10:22.994823 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 43998.7us
I20260709 12:10:22.958416 14244 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:22.975639 14184 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:23.009137 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:23.010149 11865 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.986289 14295 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:22.986073 14154 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.016345 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:23.017086 11939 raft_consensus.cc:606] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:23.011742 14295 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.973037 14275 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:10:23.024056 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 95457.2us
I20260709 12:10:23.032434 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:23.037516 14233 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.076057 14164 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:23.085186 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:23.085609 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:23.086658 11867 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:23.087829 14164 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.088449 14164 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.090559 14164 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:23.102180 14296 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.004s
W20260709 12:10:23.045329 14290 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:10:23.123911 14164 raft_consensus.cc:993] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:23.124428 14164 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:23.125034 14216 raft_consensus.cc:1081] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:23.125465 14158 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:23.125867 14158 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:23.126814 14158 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.127811 14158 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.128268 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:22.986672 14247 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.170641 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:23.183698 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 175642us
I20260709 12:10:23.174238 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:23.184607 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.184711 11867 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:23.176456 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:23.179353 11869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:10:23.185974 11869 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:23.186373 11869 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.006196 14010 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:23.011988 14291 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:10:23.031140 14289 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:10:23.202019 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:23.211943 11869 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.222620 11865 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:23.015460 14184 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.199572 14206 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:23.242511 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:23.249769 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:23.250487 12022 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.250751 12020 raft_consensus.cc:606] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:23.251296 12020 raft_consensus.cc:614] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.260841 11867 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:10:23.262777 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58579.3us
I20260709 12:10:23.229054 14116 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.273783 11869 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:23.276949 14300 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:10:23.022691 14172 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.250922 14120 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:23.339488 11867 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:23.249797 14206 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.344484 12022 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:23.372674 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:23.183025 14303 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.276s
I20260709 12:10:23.258968 14190 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.428150 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 55635.9us
W20260709 12:10:23.432277 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 168337us
W20260709 12:10:23.453682 11945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.001s	sys 0.009s
W20260709 12:10:23.454279 11945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.001s	sys 0.009s
I20260709 12:10:23.504463 14303 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.505093 14303 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:23.523015 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 89714.2us
I20260709 12:10:23.390959 14206 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:23.595875 14179 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.842s	user 0.006s	sys 0.004s
I20260709 12:10:23.596676 14179 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.505971 14235 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:23.636513 14307 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:23.320564 14116 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.506963 14010 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.445446 14190 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:23.791455 12019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.098s	sys 0.148s
W20260709 12:10:23.676359 11837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.006s	sys 0.003s
W20260709 12:10:23.860854 12019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.101s	sys 0.155s
W20260709 12:10:23.860944 11837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.008s	sys 0.008s
W20260709 12:10:23.818676 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.691s (SENT) [suppressed 10 similar messages]
I20260709 12:10:23.667714 14247 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:23.865494 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:23.866451 12604 raft_consensus.cc:2368] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:23.656419 14235 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.652629 14120 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:23.870390 14120 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.662644 14184 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:23.877658 12575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.027s	sys 0.063s
W20260709 12:10:23.878382 12575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.027s	sys 0.064s
I20260709 12:10:23.880040 14242 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:23.882679 14242 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:23.884891 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 66273.5us
I20260709 12:10:23.885258 14242 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:23.879900 14304 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:23.885987 14304 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.888038 14236 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.888608 14236 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.890609 14236 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:23.888129 14304 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:23.893972 11837 leader_election.cc:400] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:23.894487 11837 leader_election.cc:403] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.897756 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:23.900038 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:23.910413 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:10:23.838626 14233 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.800s	user 0.006s	sys 0.011s
I20260709 12:10:23.657897 14179 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:23.925624 14236 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.930435 14291 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:23.789203 14256 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:23.935655 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:23.940407 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:23.941349 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:23.951061 11868 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:23.813473 14244 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:23.946985 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 65616.4us
W20260709 12:10:23.953032 11758 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:23.897889 14247 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.934408 14233 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:23.958699 14217 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.189s	user 0.014s	sys 0.000s
I20260709 12:10:23.953995 14010 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:24.000936 11947 raft_consensus.cc:2410] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:24.001852 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.028s	sys 0.037s
W20260709 12:10:24.002274 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.028s	sys 0.037s
I20260709 12:10:23.965957 14291 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:23.792284 14303 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.953964 14236 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:23.657953 14307 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.961956 14244 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.048623 11939 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:24.049319 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 126981us
I20260709 12:10:23.959630 14256 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:23.966650 14247 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.071065 14120 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:24.073455 14314 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:24.074817 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 318) took 1194 ms. Trace:
I20260709 12:10:24.075291 11945 rpcz_store.cc:276] 0709 12:10:22.880085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.880293 (+   208us) service_pool.cc:224] Handling call
0709 12:10:22.888720 (+  8427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.915574 (+ 26854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.915608 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.916113 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.947332 (+ 31219us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18000e3140. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:23.454781 (+507449us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.454830 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.881746 (+426916us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54002b3754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:23.881818 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.074481 (+192663us) raft_consensus.cc:1685] finished
0709 12:10:24.074507 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.074699 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4139,"raft.queue_time_us":4374,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":24508,"spinlock_wait_cycles":59803392,"thread_start_us":507156,"threads_started":1,"wal-append.queue_time_us":1021492}
I20260709 12:10:24.078255 14190 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.078969 14236 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.082432 14291 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.087862 14307 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.088419 14247 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.090466 14244 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.067714 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:24.127257 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:24.227144 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:24.240712 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.251071 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 301349us
I20260709 12:10:24.235646 14120 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.241406 14247 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.238993 14236 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:24.241884 14310 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.245103 14179 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.249486 14244 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.312091 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:24.259886 14307 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.447836 14242 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.448414 14217 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.323484 14309 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.323294 14190 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.452379 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:24.464504 11944 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.455109 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:24.455979 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.458284 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.455256 14026 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.461457 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1458) took 1369 ms. Trace:
I20260709 12:10:24.484220 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.476513 11939 rpcz_store.cc:276] 0709 12:10:23.084582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.084790 (+   208us) service_pool.cc:224] Handling call
0709 12:10:24.344873 (+1260083us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540013d8d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:24.454103 (+109230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110153984}
I20260709 12:10:24.494042 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.317143 14120 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.436251 14315 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.326241 14310 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.336045 14179 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.322876 14235 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.458851 14233 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.363227 14307 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.483933 14158 consensus_meta.cc:287] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.356s	user 0.010s	sys 0.010s
I20260709 12:10:24.451260 14304 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.455585 14171 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:24.323764 14236 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.518481 11944 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:24.320706 14247 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.342738 14244 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.510016 14295 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.479s	user 0.013s	sys 0.001s
I20260709 12:10:24.540792 12021 raft_consensus.cc:2410] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:24.502236 14308 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.502493 14316 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:24.538302 14154 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.515s	user 0.009s	sys 0.005s
I20260709 12:10:24.485067 14217 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.494658 14026 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.495400 14010 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:24.557289 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 217788us
I20260709 12:10:24.485705 14242 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.496564 14309 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.567386 14317 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:10:24.527966 14256 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.564815 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:24.541049 14312 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:24.496778 14190 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.609833 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 151133us
I20260709 12:10:24.611032 11946 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:24.616070 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.560624 14158 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.542515 14304 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.537523 14233 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.545908 14295 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.542382 14171 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.635416 14324 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.515234 14315 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.619059 14256 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.644915 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.646060 11946 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:24.560770 14154 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.572078 14010 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.650408 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.555335 14308 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.652995 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:24.558255 14316 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.641364 14327 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.637898 14158 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.702024 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.661393 14323 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.618863 14312 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.649435 14324 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.714430 14320 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:10:24.832131 14304 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.668480 14326 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.868135 14333 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:24.874220 11944 raft_consensus.cc:2410] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:24.875144 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1382) took 1703 ms. Trace:
I20260709 12:10:24.736392 14242 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.741745 14339 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:24.735180 14307 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.875944 12018 rpcz_store.cc:276] 0709 12:10:23.171727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.171908 (+   181us) service_pool.cc:224] Handling call
0709 12:10:23.172360 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.258197 (+ 85837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.258234 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.850745 (+592511us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.955580 (+104835us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:23.955614 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.955689 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.874870 (+919181us) raft_consensus.cc:1685] finished
0709 12:10:24.874896 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.875073 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28498,"raft.queue_time_us":56155,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12575,"thread_start_us":92715,"threads_started":2,"wal-append.queue_time_us":604970}
I20260709 12:10:24.737300 14295 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.737970 14217 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.817425 14345 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.738190 14190 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.746306 14347 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:24.880312 14345 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.748544 14337 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:24.818390 14158 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.881398 14347 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.881887 14337 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.882344 14323 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.882958 14345 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.688390 14327 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.884202 14347 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.819024 14308 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.812765 14338 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:24.816777 14120 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:24.841524 11947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1339) took 2057 ms (client timeout 1691 ms). Trace:
I20260709 12:10:24.891705 14338 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:24.892145 11947 rpcz_store.cc:269] 0709 12:10:22.783835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.783961 (+   126us) service_pool.cc:224] Handling call
0709 12:10:24.841250 (+2057289us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003d5254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:24.841444 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795261184}
I20260709 12:10:24.815210 14236 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:24.895481 14299 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.610s	user 0.014s	sys 0.011s
I20260709 12:10:24.830729 14315 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.742542 14310 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:24.695463 14319 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:10:24.819640 14206 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.182s	user 0.011s	sys 0.003s
I20260709 12:10:24.816599 14010 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.868129 14256 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:24.737753 14328 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:10:24.811187 14179 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.819343 14244 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.736361 14316 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.734946 14233 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.842831 14154 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.875373 14333 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.744086 14171 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.889822 14304 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.877763 14339 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.880679 14312 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.888593 14327 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.895586 14338 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.853628 14247 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.810937 14309 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:24.877679 14242 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:24.914667 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 254279us
I20260709 12:10:24.915326 14206 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.012297 14242 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:24.874881 14326 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:24.918968 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 208) took 1032 ms. Trace:
I20260709 12:10:24.865237 14116 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.884706 14323 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:24.870388 14352 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:24.967674 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 408387us
I20260709 12:10:25.007635 14346 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:25.009935 14339 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.013585 12015 raft_consensus.cc:2368] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8.
I20260709 12:10:24.920310 14337 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:24.919581 14179 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:25.018831 11864 rpcz_store.cc:276] 0709 12:10:23.886515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.888395 (+  1880us) service_pool.cc:224] Handling call
0709 12:10:23.888724 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.889058 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.889085 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.889556 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.952881 (+ 63325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.952923 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.952988 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.918719 (+965731us) raft_consensus.cc:1685] finished
0709 12:10:24.918753 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.918902 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32509,"raft.queue_time_us":2763,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":248,"thread_start_us":62572,"threads_started":1,"wal-append.queue_time_us":359734}
I20260709 12:10:25.082962 14352 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.099859 14206 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.100512 14346 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.133662 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.182099 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:24.977923 14304 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.180366 14343 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.195132 14343 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.198901 14242 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.138566 14179 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.200424 12604 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:25.200951 14304 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.190414 14256 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.203478 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 322) took 1304 ms. Trace:
I20260709 12:10:25.198975 14352 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.206769 14326 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.208122 14333 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.208526 11942 rpcz_store.cc:276] 0709 12:10:23.899315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.899574 (+   259us) service_pool.cc:224] Handling call
0709 12:10:23.899971 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.087217 (+187246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:24.087259 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.087708 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.326248 (+238540us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.326305 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.203034 (+876729us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540013d3d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:25.203089 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.203141 (+    52us) raft_consensus.cc:1685] finished
0709 12:10:25.203153 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.203413 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1018,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":429651200,"thread_start_us":236192,"threads_started":1,"wal-append.queue_time_us":440788}
W20260709 12:10:25.211530 11758 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:25.212571 14179 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:25.195190 14305 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 1.805s	user 0.019s	sys 0.018s
I20260709 12:10:25.215493 12608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 253) took 2267 ms. Trace:
I20260709 12:10:25.215906 12608 rpcz_store.cc:276] 0709 12:10:22.951154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.951295 (+   141us) service_pool.cc:224] Handling call
0709 12:10:22.951725 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.959148 (+  7423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.959186 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.966067 (+  6881us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.008796 (+ 42729us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:23.008838 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.008904 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.179583 (+2170679us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:25.215119 (+ 35536us) raft_consensus.cc:1685] finished
0709 12:10:25.215170 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.215405 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2342,"raft.queue_time_us":9815,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5936,"spinlock_wait_cycles":217789824,"thread_start_us":14756,"threads_started":1,"wal-append.queue_time_us":249460}
I20260709 12:10:25.219013 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1767) took 1361 ms. Trace:
I20260709 12:10:25.220708 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.221781 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 364) took 2319 ms. Trace:
I20260709 12:10:25.221957 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1766) took 1365 ms. Trace:
I20260709 12:10:25.222295 11866 rpcz_store.cc:276] 0709 12:10:23.856131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.856350 (+   219us) service_pool.cc:224] Handling call
0709 12:10:23.856740 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.091376 (+234636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.091423 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.091479 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:24.091525 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.221727 (+1130202us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000951d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:25.221776 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.221906 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538995584}
I20260709 12:10:25.219502 11872 rpcz_store.cc:276] 0709 12:10:23.857240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.857400 (+   160us) service_pool.cc:224] Handling call
0709 12:10:23.857757 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.085955 (+228198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.086013 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.086075 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.086122 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.218776 (+1132654us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002f6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:25.218817 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.218953 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524136192}
I20260709 12:10:25.222199 12013 rpcz_store.cc:276] 0709 12:10:22.874936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.875093 (+   157us) service_pool.cc:224] Handling call
0709 12:10:22.875448 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:22.875825 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.875862 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:22.880879 (+  5017us) log.cc:844] Serialized 52 byte log entry
0709 12:10:23.006805 (+125926us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.006846 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.006914 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.894536 (+1887622us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:25.138267 (+243731us) raft_consensus.cc:1685] finished
0709 12:10:25.138293 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.193806 (+ 55513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1287,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5921,"spinlock_wait_cycles":126413056,"thread_start_us":104670,"threads_started":1,"wal-append.queue_time_us":292115}
W20260709 12:10:25.249792 12574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.042s	sys 0.065s
W20260709 12:10:25.250281 12574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.042s	sys 0.065s
I20260709 12:10:25.252246 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:25.254326 11944 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
W20260709 12:10:25.264433 12021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1381) took 2096 ms (client timeout 2643 ms). Trace:
W20260709 12:10:25.265128 12021 rpcz_store.cc:269] 0709 12:10:23.167938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.170230 (+  2292us) service_pool.cc:224] Handling call
0709 12:10:25.264117 (+2093887us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400178754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:25.264306 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118995328}
I20260709 12:10:25.248032 14236 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.267876 14236 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.278795 14337 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:25.279577 14337 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:25.281121 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.229647 14346 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.283622 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.283823 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.285486 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:25.346136 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.011s	sys 0.022s
I20260709 12:10:25.284927 11865 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:25.370612 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.012s	sys 0.026s
W20260709 12:10:25.344796 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 113981us
I20260709 12:10:25.372859 14357 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.373664 14357 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.376693 14357 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.381179 14333 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.382321 11864 raft_consensus.cc:2410] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:25.381970 14333 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.384821 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.386080 14184 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.387223 14184 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.388810 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.389642 12610 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:25.390439 14179 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.391234 14179 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.392985 14333 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.393842 14304 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:25.394424 14304 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.394773 14184 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.401495 14333 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:25.402406 14333 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.405824 14333 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.406148 14352 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.407064 14352 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:25.301119 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 195266us
I20260709 12:10:25.471163 14304 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.473851 14358 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.474354 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.474551 14358 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.475903 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1346) took 1026 ms. Trace:
I20260709 12:10:25.476356 11945 rpcz_store.cc:276] 0709 12:10:24.449862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.451619 (+  1757us) service_pool.cc:224] Handling call
0709 12:10:24.505406 (+ 53787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.913579 (+408173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.913618 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.974243 (+ 60625us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.258676 (+284433us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.258711 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.259337 (+   626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.475699 (+216362us) raft_consensus.cc:1685] finished
0709 12:10:25.475720 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.475848 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10652,"raft.queue_time_us":128083,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3878,"thread_start_us":583129,"threads_started":2,"wal-append.queue_time_us":448904}
I20260709 12:10:25.476893 14358 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.255584 14247 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.378793 14357 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.369262 14235 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.487771 14236 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.482865 14184 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.488147 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.488710 14184 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.489856 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:25.490978 14184 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.491849 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.492306 14337 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.492537 14343 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.494277 14316 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.493434 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.366684 14303 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.503007 14026 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.503551 14333 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.503728 14357 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.504122 14333 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.497908 14367 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:25.498252 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.506531 14367 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.507018 14309 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.507584 14309 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.508847 14367 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.510479 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.481081 14326 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.491016 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.499123 14352 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.519800 14352 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.499789 14337 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.500663 14242 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.500617 14304 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.506124 14333 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.517127 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:25.496408 14247 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.509668 14338 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.519157 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.494963 14316 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.529840 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:25.511273 14369 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:10:25.521239 14326 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.531598 12609 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:25.486342 14206 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.520371 14352 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.495723 14312 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.509487 14367 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.516772 14116 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.524135 14256 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.541285 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:25.538758 11837 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:25.536018 14309 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.545523 14116 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.546073 14179 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.546595 14179 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.547061 14179 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.548148 14116 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.548703 14116 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.549227 14179 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.533031 14339 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.556365 14339 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.557107 14352 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.537758 14338 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.559263 14339 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.559538 14338 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.559976 14339 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.560604 14339 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.532817 14242 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.563009 14357 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:25.563323 14242 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.564069 14242 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.544881 14312 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.554864 14324 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.541225 14206 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.532756 14304 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.532588 14337 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.549144 14116 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.542831 13819 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.569269 13819 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.569759 13819 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.571240 14362 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.571645 14326 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.552601 14367 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.564553 14242 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.573827 14242 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.577986 14304 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.554843 14247 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.579928 14206 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.590765 14339 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.629945 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:25.611325 12015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 1895) took 1672 ms (client timeout 2053 ms). Trace:
W20260709 12:10:25.660815 12015 rpcz_store.cc:269] 0709 12:10:23.939404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.940165 (+   761us) service_pool.cc:224] Handling call
0709 12:10:25.610967 (+1670802us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000474d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:25.611227 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422837504}
I20260709 12:10:25.632280 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.665596 12021 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:25.669353 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.670051 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:25.671458 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.671788 12015 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:25.669632 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.678133 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.893352 11865 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 1.
W20260709 12:10:25.834087 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 295358us
I20260709 12:10:25.843392 11769 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 5, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.895797 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:25.762974 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 389538us
I20260709 12:10:25.892364 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:25.724195 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.902362 12019 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:25.901571 11869 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:25.905313 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.904162 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.904383 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.904553 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.903563 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.907321 12017 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:25.907367 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:25.909080 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.909711 12020 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:25.657994 14116 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.901726 12021 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.915386 12021 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:25.917037 12016 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:25.922389 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:25.672147 14172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.387s	user 0.030s	sys 0.033s
I20260709 12:10:25.937158 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.603348 14312 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.931774 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:25.935105 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:25.718150 14351 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.618s	user 0.000s	sys 0.005s
I20260709 12:10:25.952414 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.952558 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.953045 11864 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:25.919468 12021 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.661736 14179 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.960413 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:25.596625 14337 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:25.824036 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:25.941476 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.942806 11769 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 4, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.962150 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 222) took 7321 ms. Trace:
I20260709 12:10:25.962491 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.906339 14352 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:25.963944 14352 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.943445 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.965866 12018 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:25.966166 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:25.966673 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.967689 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.968612 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.969305 14303 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:25.936566 14172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.651s	user 0.039s	sys 0.037s
W20260709 12:10:25.974725 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56311.3us
I20260709 12:10:25.944872 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.947194 12013 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.661851 14206 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.950831 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.951069 14378 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.870679 14242 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.953110 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.975622 12016 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:25.987509 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:26.009410 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.953879 12021 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.713989 14184 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.989007 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.954844 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:26.012851 11867 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.721475 13819 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:25.955816 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:25.957806 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:25.957862 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.016997 11869 raft_consensus.cc:2410] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:26.018193 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:25.961231 11942 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.672499 14326 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.655606 14339 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:25.925997 14316 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:25.963112 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:25.944168 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.984589 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.926198 14375 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:25.595989 14256 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.009922 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.039162 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.939541 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.953872 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.040457 11873 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:26.040395 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.010614 12014 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:26.037567 12019 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:26.041858 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.042414 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.042764 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.043360 12019 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:26.011089 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:25.962546 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 5, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.954193 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.006325 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.005169 14337 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.018961 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.041013 12017 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:26.019708 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.021184 11867 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:26.023546 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:26.048985 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.049599 11946 raft_consensus.cc:2368] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:26.049714 12017 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:26.049882 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.028810 12013 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:26.047693 11872 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:26.051846 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.045627 11769 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 2 to 5, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:26.053179 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.055125 11944 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:25.969866 14116 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:26.015232 14354 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:26.036288 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.037932 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:26.054322 11769 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.054800 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.073017 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.054383 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.059530 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.074038 12018 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:26.074344 12020 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:26.075057 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.012372 14154 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.073670 12013 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:25.988693 14303 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.066615 12022 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:26.066721 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 103694us
I20260709 12:10:26.071455 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:26.057072 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 106944us
I20260709 12:10:26.075129 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.082106 12020 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:26.085052 14352 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.087453 14242 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.033926 12021 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:25.975634 14179 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.007499 14206 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.064173 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.077745 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.014902 14184 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.041440 14326 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.033674 14378 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.049489 14339 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.061951 14337 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.055446 14375 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:25.962564 11768 rpcz_store.cc:276] 0709 12:10:18.621277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.626852 (+  5575us) service_pool.cc:224] Handling call
0709 12:10:25.942462 (+7315610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.297694 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.298503 (+   809us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.298564 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:23.298590 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:23.312167 (+ 13577us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.312267 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.312309 (+    42us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:10:23.428954 (+116645us) tablet.cc:701] Row locks acquired
0709 12:10:23.434660 (+  5706us) write_op.cc:260] PREPARE: finished
0709 12:10:23.558158 (+123498us) write_op.cc:270] Start()
0709 12:10:23.611784 (+ 53626us) write_op.cc:276] Timestamp: P: 1783599023529805 usec, L: 0
0709 12:10:23.637746 (+ 25962us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.842211 (+204465us) log.cc:844] Serialized 5970 byte log entry
0709 12:10:24.920755 (+1078544us) op_driver.cc:464] REPLICATION: finished
0709 12:10:25.345983 (+425228us) write_op.cc:301] APPLY: starting
0709 12:10:25.347308 (+  1325us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:25.347860 (+   552us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:25.348025 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:25.499552 (+151527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:25.499857 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:10:25.499908 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:25.500286 (+   378us) log.cc:844] Serialized 107 byte log entry
0709 12:10:25.500480 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.500690 (+   210us) write_op.cc:454] Released schema lock
0709 12:10:25.500748 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:25.501181 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.501209 (+    28us) write_op.cc:454] Released schema lock
0709 12:10:25.739635 (+238426us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba3032a 00007f1f1b9b5f14 00007f1f1b9b5ec3 00007f1f1b9b5e38 00007f1f1b9b5df3 00007f1f1b9b50dc 00007f1f1b9dee16 00007f1f1b9c6cbb 00007f1f1b9b139d 00007f1f1b9b4d75
Metrics: {"mutex_wait_us":924,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":333742,"apply.run_cpu_time_us":5326,"apply.run_wall_time_us":181200,"num_ops":15,"prepare.queue_time_us":348214,"prepare.run_cpu_time_us":25578,"prepare.run_wall_time_us":693015,"raft.queue_time_us":302807,"raft.run_cpu_time_us":13108,"raft.run_wall_time_us":868056,"replication_time_us":1262592,"spinlock_wait_cycles":63783808,"thread_start_us":739308,"threads_started":4,"wal-append.queue_time_us":401217}]]}
I20260709 12:10:26.070617 11769 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.091266 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:26.507078 11864 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.015s	sys 0.037s
W20260709 12:10:26.519685 11864 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.016s	sys 0.042s
I20260709 12:10:26.519941 11942 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:26.522250 11947 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:26.522504 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.523809 11945 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:26.524042 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.525116 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:26.526467 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.535076 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.518481 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1348) took 2065 ms. Trace:
I20260709 12:10:26.522558 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.540689 12013 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:26.542869 14111 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:26.545367 13819 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.421586 14367 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:26.560338 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:26.560945 14338 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.466831 14303 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.562439 14338 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.570039 14111 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.536247 11769 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 3, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 3 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:26.526343 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 435299us
I20260709 12:10:26.093058 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:26.615671 14303 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.616878 11865 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:26.618419 14339 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.619014 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:26.621773 14326 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:26.622107 14338 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.623397 12015 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:26.551393 11943 rpcz_store.cc:276] 0709 12:10:24.453155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.453314 (+   159us) service_pool.cc:224] Handling call
0709 12:10:24.495210 (+ 41896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.654836 (+159626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.654910 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.656029 (+  1119us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.976709 (+320680us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.977116 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.977380 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.977474 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.717370 (+739896us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:26.517363 (+799993us) raft_consensus.cc:1685] finished
0709 12:10:26.517651 (+   288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.518172 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11248,"prepare.queue_time_us":231,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":65994,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":38678,"spinlock_wait_cycles":77231360,"thread_start_us":396383,"threads_started":2,"wal-append.queue_time_us":411443}
I20260709 12:10:26.624567 14377 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.626731 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:26.628337 14206 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:26.629319 14303 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.630236 14303 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.631825 14378 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.628499 14337 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.169821 14256 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:26.635075 11870 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.633139 14303 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.079265 14358 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.611724 14111 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.077333 14354 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.644598 14358 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:26.659945 11868 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:26.660969 14367 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.653680 14206 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.662202 14367 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.662483 14206 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.665840 14358 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.666054 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:26.670886 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.672706 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.674829 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.675005 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.678087 14367 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.678967 14321 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:26.680284 14321 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.680758 14321 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:26.684634 14375 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.067529 14116 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.687849 14116 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.687965 14354 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.689090 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.693255 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.727610 14179 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.691687 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.694073 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.082958 14154 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.744320 12602 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:26.759884 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.764355 14321 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.765312 11939 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:26.766601 14321 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.764420 14206 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.783037 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.784425 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.784894 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.786669 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.788407 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.762252 14377 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:26.806164 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:26.806854 11758 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:26.807866 14377 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.820390 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.829700 14206 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:26.830646 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.830802 14206 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:26.831852 12021 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:26.833794 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1786) took 1164 ms. Trace:
I20260709 12:10:26.834290 11868 rpcz_store.cc:276] 0709 12:10:25.670647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.671211 (+   564us) service_pool.cc:224] Handling call
0709 12:10:26.833515 (+1162304us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400400954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:26.833713 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253438208}
I20260709 12:10:26.836926 14184 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:26.837859 14206 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:26.838919 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.841864 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:26.842646 12022 raft_consensus.cc:2376] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5. Re-sending same reply.
I20260709 12:10:26.844688 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.846652 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:26.849170 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.849985 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.852631 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:26.864850 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.875466 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.878397 14390 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:26.895733 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:26.896920 11944 raft_consensus.cc:2376] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5. Re-sending same reply.
I20260709 12:10:26.903971 11865 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.904970 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:26.905566 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:26.895948 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49638.6us
I20260709 12:10:26.893560 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:26.880748 14206 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.907164 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:26.900880 14358 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:26.929029 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.917670 14206 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.944352 14206 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.932366 14390 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:26.954509 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.955448 11865 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:26.954689 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:26.958353 11866 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:26.962786 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:26.943470 14389 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:26.953277 14390 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:26.974673 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 62962.8us
I20260709 12:10:26.977317 14154 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:26.979369 14379 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.984301 12609 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.988564 11870 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:27.005738 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.009326 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.017657 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.018493 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.019284 14358 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:27.024362 12607 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:10:27.028931 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85619.5us
I20260709 12:10:27.041821 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.044178 14326 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.045615 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.046566 11867 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:27.049067 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1797) took 1097 ms. Trace:
I20260709 12:10:27.049454 11870 rpcz_store.cc:276] 0709 12:10:25.951676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.955598 (+  3922us) service_pool.cc:224] Handling call
0709 12:10:27.048841 (+1093243us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54001a7a54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:27.049013 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422660352}
I20260709 12:10:27.050634 11869 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:27.052754 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:27.057772 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:27.058923 14390 raft_consensus.cc:2764] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:27.053572 11872 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.053428 11839 leader_election.cc:400] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:27.062389 11839 leader_election.cc:403] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:27.053726 14398 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:10:27.093950 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 110444us
W20260709 12:10:27.092903 11914 connection.cc:256] RPC call timeout handler was delayed by -1.1184352829998261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 12:10:27.097868 14325 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:27.099633 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46460.6us
I20260709 12:10:27.100618 12609 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:27.098558 14325 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.104563 14325 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.105455 14390 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:27.115669 14280 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:27.116650 14280 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.119290 14280 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:27.120617 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.124984 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.129096 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.129432 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.137650 14390 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.138177 14390 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:27.130208 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 121030us
I20260709 12:10:27.137876 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.138665 14390 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.148586 11872 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:27.135429 14280 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.135654 14154 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:27.152000 14154 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:27.153183 14154 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.154464 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.155542 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.151211 14303 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.160068 14303 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.160295 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.160539 14303 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.166558 14400 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:27.167049 14400 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:27.167390 14400 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.133714 14206 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.170912 14325 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.171746 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:27.172119 14206 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:27.172987 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.177274 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.171825 14325 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.178049 14325 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.178488 14325 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.180069 13819 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:27.181849 14354 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:27.182250 14354 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.182544 14354 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.183022 14111 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:27.185963 14280 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.186488 14280 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:27.187507 14280 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.177601 14242 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:27.189023 14280 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.188766 14242 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.191280 14242 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:27.193616 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.174547 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:27.175745 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.174108 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.205703 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.206625 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.207389 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.209286 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.211414 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.214109 11944 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.216504 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.219828 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:27.220541 11944 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.227424 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.227514 14377 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.228111 14377 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:27.228523 14377 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.228736 14179 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.229677 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.229887 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.230846 11940 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:27.231869 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.234038 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.241979 11946 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:27.243060 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.246585 14377 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.247897 14390 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.249101 14179 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.251789 11839 leader_election.cc:400] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:27.276618 11839 leader_election.cc:403] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:27.278132 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.257398 13819 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:27.280964 13819 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.285573 14337 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:27.286469 14337 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.288169 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.288941 14242 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.291370 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.292284 14337 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.292744 14337 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.293094 14337 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.257717 14354 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.261003 14303 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.262183 14325 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.315379 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.316700 14303 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.316943 14325 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.265714 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.225126 14400 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:27.269230 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 90490.1us
I20260709 12:10:27.318889 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.321949 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.322796 11941 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:27.273245 14390 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.313627 11944 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:10:27.330060 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.311960 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44142.1us
I20260709 12:10:27.336548 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.340081 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.342234 14377 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.343770 12609 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:27.344919 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.352852 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.354370 11939 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:27.353016 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.354362 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:27.356527 12609 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
W20260709 12:10:27.372182 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50680.6us
I20260709 12:10:27.387333 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.388358 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.357734 14400 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.391754 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.396817 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.400655 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:27.403749 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.404784 11939 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.400220 14325 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.405501 14325 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:27.416677 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.405939 14325 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.423152 14354 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.425668 14206 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.426909 14206 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:27.427309 14206 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:27.428381 14206 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.429869 14206 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.431044 14337 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.433166 14337 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.438511 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.440150 14358 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.452569 14358 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.445722 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:27.460825 14206 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.461278 14206 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.461632 14206 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.467700 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.468690 14377 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.471310 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:27.472642 14325 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.474766 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.478209 14206 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:27.482193 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 83716.2us
I20260709 12:10:27.482367 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.483501 14303 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:27.483963 14361 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:27.484623 14361 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:27.485683 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.485651 14361 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.486476 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 118) took 4868 ms. Trace:
I20260709 12:10:27.486785 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.487839 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.489004 14415 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.491314 11914 leader_election.cc:400] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8.
I20260709 12:10:27.484536 14206 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:27.492063 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.497277 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:27.498021 12609 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.486912 11769 rpcz_store.cc:276] 0709 12:10:22.617796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.622394 (+  4598us) service_pool.cc:224] Handling call
0709 12:10:27.486393 (+4863999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:27.004349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:27.005311 (+   962us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:27.005386 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:10:27.029705 (+ 24319us) tablet.cc:662] Decoding operations
0709 12:10:27.086457 (+ 56752us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:27.086580 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:27.086628 (+    48us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:27.120083 (+ 33455us) tablet.cc:701] Row locks acquired
0709 12:10:27.120137 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:10:27.120364 (+   227us) write_op.cc:270] Start()
0709 12:10:27.120591 (+   227us) write_op.cc:276] Timestamp: P: 1783599027120298 usec, L: 0
0709 12:10:27.120612 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:27.121518 (+   906us) log.cc:844] Serialized 3340 byte log entry
0709 12:10:27.259790 (+138272us) op_driver.cc:464] REPLICATION: finished
0709 12:10:27.410512 (+150722us) write_op.cc:301] APPLY: starting
0709 12:10:27.442510 (+ 31998us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:27.450569 (+  8059us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:27.450719 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:27.451867 (+  1148us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:27.452267 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:27.452334 (+    67us) write_op.cc:312] APPLY: finished
0709 12:10:27.452719 (+   385us) log.cc:844] Serialized 65 byte log entry
0709 12:10:27.452913 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.453071 (+   158us) write_op.cc:454] Released schema lock
0709 12:10:27.453141 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:27.469722 (+ 16581us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.469763 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158049,"reported_tablets":10,"spinlock_wait_cycles":21504,"child_traces":[["op",{"apply.queue_time_us":132307,"apply.run_cpu_time_us":3523,"apply.run_wall_time_us":55368,"num_ops":8,"prepare.queue_time_us":54295,"prepare.run_cpu_time_us":28227,"prepare.run_wall_time_us":244482,"raft.queue_time_us":26365,"raft.run_cpu_time_us":60300,"raft.run_wall_time_us":95434,"replication_time_us":138990,"spinlock_wait_cycles":24320,"thread_start_us":300880,"threads_started":4,"wal-append.queue_time_us":88869}]]}
I20260709 12:10:27.511047 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.512902 12609 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:27.516227 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.516417 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.519690 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:27.519822 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.520531 14206 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:27.521039 14206 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:27.513985 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.514830 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.522118 11941 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:27.515431 14303 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.522334 14206 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.523074 14303 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.523455 14367 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.523578 14303 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.521278 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:27.526546 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.491614 11914 leader_election.cc:403] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:27.527428 14367 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.527697 14354 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8.
I20260709 12:10:27.533627 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.535071 14354 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.535140 14303 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.540910 14303 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.541940 12018 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:27.488022 14325 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.568902 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.575351 14303 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.576673 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:27.581176 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47681.2us
I20260709 12:10:27.582015 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.583242 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.584044 14354 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.584497 14354 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:27.584838 14354 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.588153 14409 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.590669 14405 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:27.591209 14405 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:27.591599 14405 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.597391 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:10:27.601749 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85708.1us
I20260709 12:10:27.578697 14338 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.617709 14332 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:27.622828 11770 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.627331 14332 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:27.627501 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.628890 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.628515 14332 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:27.631255 14303 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.633034 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.635169 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.636009 13819 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.636853 13819 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.631270 14337 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.638307 14337 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.631696 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.630030 11770 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 7, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.645049 14377 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.633085 14303 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.645520 14377 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.645802 14303 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.646034 14377 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.655409 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.641644 14337 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.643358 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.682200 14390 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:27.683322 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:27.696683 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 120126us
I20260709 12:10:27.698930 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.685860 11770 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.709321 11770 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.708382 14179 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.713778 14354 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.714226 14377 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.715956 14354 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.694650 14405 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.717103 14377 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.717926 14337 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.718571 14405 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:27.705912 14390 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.719384 14390 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.720074 14337 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:27.728933 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45689.4us
I20260709 12:10:27.729868 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.719726 11770 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.732893 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:27.733304 14303 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.733847 11943 raft_consensus.cc:606] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.734200 11943 raft_consensus.cc:614] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:27.731384 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.736060 14303 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.736341 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:27.737008 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 93754.5us
I20260709 12:10:27.741602 14361 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.741827 14377 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.742906 14337 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.744057 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:27.736202 11770 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.750124 11943 raft_consensus.cc:606] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.750542 11943 raft_consensus.cc:614] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:27.752163 14179 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.755478 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:27.756436 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.757261 14242 raft_consensus.cc:2764] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:27.752483 14390 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.761066 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:49616
I20260709 12:10:27.761271 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.761706 12018 raft_consensus.cc:606] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.762300 14361 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.751628 14405 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.764021 14390 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.751665 14377 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.764873 14377 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.766697 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:27.767311 11943 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.751825 14337 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:27.768846 14337 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.772085 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:27.772750 11943 raft_consensus.cc:606] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.774214 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:27.775807 11770 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.778122 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:27.779774 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:27.781867 14242 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.782752 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:27.783756 14303 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.786209 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.786948 11872 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:27.787853 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.788944 11864 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:27.789129 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.790074 11869 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:27.790163 11770 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.791052 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.791803 11870 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:27.792866 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.792569 11770 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.794348 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.795800 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.796518 11872 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
W20260709 12:10:27.791841 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 92987.5us
I20260709 12:10:27.802549 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.803467 14405 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:27.804368 14405 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:27.805572 14405 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.812703 14377 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.818650 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:27.833084 11871 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.818531 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.816752 11988 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:27.837926 11988 leader_election.cc:403] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:27.838127 11872 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:27.820103 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.839248 11873 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:27.839716 14421 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.839179 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.846747 14206 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.848155 14206 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:27.849350 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.850277 14206 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.850813 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.851604 14206 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.852065 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:27.852849 14206 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.822958 14337 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:27.853345 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:27.794106 11770 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.813886 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:27.831902 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.821593 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.857472 14421 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:27.862075 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.873749 11873 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:27.862931 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.864504 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.876825 11869 raft_consensus.cc:2368] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:27.865379 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.866212 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.865371 14377 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.864107 11871 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:27.889245 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.890075 12020 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:27.886113 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.892139 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.869781 14206 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.893661 14206 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:27.894121 14206 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.895452 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.897068 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.870030 11770 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.898600 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:27.899302 12015 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:27.900486 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:27.900265 11770 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.870163 11870 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:27.902102 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.870476 11867 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:27.870759 14408 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:27.903740 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:27.871151 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57392.9us
I20260709 12:10:27.871567 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.906356 11866 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:27.906616 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.872228 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.907904 12017 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:27.871523 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.872473 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.909343 12019 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:27.872709 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.871183 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.910998 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.872360 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.912606 12021 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:27.914319 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.914932 11866 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:27.914768 11770 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.915979 12020 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.916041 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.916916 11865 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:27.918569 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.919982 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:27.924189 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:27.902710 12015 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:27.916790 11770 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 2 to 5, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:27.925328 12606 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:27.926898 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:27.927568 11943 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.909500 12022 raft_consensus.cc:2410] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:27.934187 11864 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:27.934934 11870 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.935864 11864 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:27.936905 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:27.937578 11867 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.935547 14405 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.867986 14337 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:27.942404 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.947922 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:27.948838 11867 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:27.950142 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:27.950299 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:27.954768 12022 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.961404 11864 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.962755 11873 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.964836 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:27.965839 11940 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.035460 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:28.037837 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:28.038940 11867 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.039654 11872 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:28.054620 11943 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:28.054330 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.058074 11940 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:27.955435 14405 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.059676 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.081768 11869 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:28.090332 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:28.083693 12015 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:28.093756 12021 raft_consensus.cc:2368] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5.
I20260709 12:10:28.095916 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.096709 11943 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:10:28.098821 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.100165 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.110308 11869 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:28.110971 11864 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.111465 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.112289 11939 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:28.112967 14421 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:28.113672 14421 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.115617 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.116021 14421 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:28.117026 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.117113 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.117688 11866 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.119104 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.119374 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.119933 11872 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:28.119782 12022 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:28.122102 11943 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:28.123481 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.123790 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.125073 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.125602 11868 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:28.125806 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.127019 11870 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.129920 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.130689 11943 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:28.134202 11870 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:28.134552 11865 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:28.134357 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.138546 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:28.133796 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.140563 11943 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:28.143633 12020 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:28.144721 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:28.145713 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:28.156245 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:28.080955 14405 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.169165 14206 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.295879 11869 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:28.157485 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:28.336390 11866 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:28.169305 14409 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.341600 11948 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:28.343897 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44836.6us
W20260709 12:10:28.439994 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 282565us
I20260709 12:10:28.441223 11948 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.341336 14409 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:28.445678 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.452968 11873 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:28.454123 11871 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.339236 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:28.460548 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 336460us
I20260709 12:10:28.461444 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:28.478184 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:28.422325 14415 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.503557 14206 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:28.504426 14206 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:28.505055 14206 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:28.504122 14421 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:28.508273 14421 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:28.509330 14421 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.461488 14409 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.496256 14415 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:28.556090 14415 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.568691 13819 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.572034 13819 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.574460 13819 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:28.542173 14325 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:10:28.608914 14424 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.089s	user 0.000s	sys 0.004s
I20260709 12:10:28.568760 12577 leader_election.cc:400] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:28.614533 12577 leader_election.cc:403] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:28.556221 14425 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:28.589844 12606 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:28.621137 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52511.1us
W20260709 12:10:28.631492 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 153387us
W20260709 12:10:28.634210 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62696.9us
W20260709 12:10:28.649690 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 171441us
I20260709 12:10:28.653613 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.631654 14405 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:28.658595 11941 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:28.661212 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:28.662465 11941 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:28.668546 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:28.645260 14321 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:28.617573 14206 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:28.682986 14429 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:10:28.691772 14427 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:28.692535 14427 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:28.697211 14361 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.701221 14361 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:28.702236 14361 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.665758 14337 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.703503 14361 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.646442 14431 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:28.708264 14431 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:28.708797 14431 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:28.715695 13819 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:28.723335 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76849.1us
W20260709 12:10:28.725330 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.726585 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:28.735419 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 81933.3us
I20260709 12:10:28.735440 12021 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:28.736649 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.667253 14425 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:28.744413 14337 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.744625 14431 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.746042 14431 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.746649 14409 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.747905 11940 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:28.749112 14409 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:28.740545 14354 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.750145 14354 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:28.752351 14354 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:28.740999 14427 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.754029 14427 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.754637 14425 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:28.755336 14425 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:28.756620 14425 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.758642 14425 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.764837 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:28.773322 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 108273us
I20260709 12:10:28.776145 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.791779 14444 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:28.792562 14444 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:28.799571 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:28.738847 14440 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:28.739509 14434 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:28.819887 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43874.9us
I20260709 12:10:28.820801 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.821753 14421 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:28.825695 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.828017 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.828413 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.829411 14206 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.830104 14206 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:28.830693 14206 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.814584 14432 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:28.853855 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.795425 14321 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:28.816839 14434 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:28.856441 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 118483us
I20260709 12:10:28.842931 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:28.865760 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 100981us
I20260709 12:10:28.855286 14421 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.859972 14434 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.873647 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.869462 13819 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:28.847517 14354 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:28.894351 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:28.881395 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53080.8us
I20260709 12:10:28.898164 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.875383 12606 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:28.841678 14440 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:28.908051 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:28.879431 14415 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:28.916046 11948 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.921358 14443 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:28.941277 14354 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:28.946399 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48323us
I20260709 12:10:28.942214 14354 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.902657 14409 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:28.957198 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:28.959686 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 91397us
I20260709 12:10:28.904529 14337 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:28.911485 14452 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.947610 14443 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:28.963639 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:28.948362 14415 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:28.959314 14446 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:10:28.923646 14421 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:28.964737 14451 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:28.956863 14354 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.965305 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:28.982643 14427 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:28.979559 14455 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:28.988838 14455 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:28.989254 14455 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.975560 14409 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:28.992623 14409 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.993022 14409 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:28.980044 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.994700 14432 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.993881 14409 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.995043 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.995826 14409 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.996603 14421 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.997088 14421 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:28.980146 14450 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.997443 14421 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.997882 14450 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:28.998047 14443 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:28.988140 14337 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:28.995231 14432 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:28.996685 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.967446 14452 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.979420 14440 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.006456 14452 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.007164 14206 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.005656 14325 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.009960 14432 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.974645 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:29.021335 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46783.5us
I20260709 12:10:29.024859 14463 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.025575 14461 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.031805 14354 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.010540 14325 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.035084 14325 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.036695 14325 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.036356 14444 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:29.039072 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.023701 14440 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.040012 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:29.041742 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45176.5us
I20260709 12:10:29.042613 11988 leader_election.cc:400] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:29.003684 14450 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:29.045467 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 171902us
I20260709 12:10:29.046850 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:29.042899 11988 leader_election.cc:403] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:29.053136 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:29.054154 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:29.055639 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:29.056893 14206 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.057567 14337 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.058297 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.060089 14408 raft_consensus.cc:993] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:29.060215 14439 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:29.067906 14444 raft_consensus.cc:1081] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:29.060827 14280 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.068580 14439 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:29.068905 14280 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.070389 14408 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.069988 14280 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.070408 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.071619 14280 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.072404 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.072526 14460 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.061302 14461 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.068946 14439 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:29.074434 11914 leader_election.cc:400] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5.
I20260709 12:10:29.074868 11914 leader_election.cc:403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:29.049746 12607 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.101912 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:29.104630 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 62132.8us
I20260709 12:10:29.105808 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.104144 14460 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.109424 14415 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.110970 14415 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.110611 14439 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.112020 14439 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.112107 14415 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.109974 14461 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.116150 14452 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.052529 14450 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.109935 14462 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:29.118403 14409 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.119377 14440 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.119287 14409 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.104743 14337 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:29.120478 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 43976.8us
I20260709 12:10:29.126304 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:28.988114 14434 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.138491 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.142009 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:29.049998 14463 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.113003 14421 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.120764 14444 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5.
I20260709 12:10:29.152074 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:29.152714 11868 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:29.151909 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:29.155040 12019 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:29.122684 14337 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.163164 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.165688 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.135110 14405 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.166088 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.166395 11870 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:29.168752 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:29.173097 14421 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.175092 14452 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.150944 14206 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.180032 12020 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.175108 14409 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.197618 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:29.198282 12609 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.201720 14354 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.202088 14463 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.203961 14463 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.164355 14337 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.179167 14455 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.208066 14455 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.210041 12609 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:29.211884 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.212985 14325 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.213572 14325 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.214545 14325 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.194705 14431 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:29.252447 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 180093us
I20260709 12:10:29.262975 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.254068 11867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:29.267668 11867 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:29.268195 11867 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.270287 14434 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.276707 14440 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:29.278481 14452 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.284202 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.298688 11943 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:29.270397 14354 raft_consensus.cc:993] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:10:29.309401 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:29.312987 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:29.335878 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.315310 11948 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.352214 11867 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.301924 14452 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:29.367010 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.316857 14463 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.334369 14280 raft_consensus.cc:1081] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
W20260709 12:10:29.363402 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 210090us
I20260709 12:10:29.348109 14450 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.392861 11867 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:29.395149 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.421840 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.424095 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 71765.3us
I20260709 12:10:29.425154 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.396656 14469 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:29.434454 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49681.7us
W20260709 12:10:29.436607 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.437271 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.441679 14471 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.442381 14471 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:29.444722 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.379135 14460 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:10:29.451303 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.451460 14460 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.452344 14460 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.457896 14450 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.458573 14450 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.378516 14452 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.438843 14469 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:29.464267 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.464592 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.462586 11867 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.468587 11864 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:29.466194 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.473043 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:29.473662 11868 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:29.473070 14440 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.474650 11866 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.475749 14452 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.474198 11871 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:10:29.462662 14470 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:29.482681 11866 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.483428 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.483785 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.483471 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.486496 11943 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.484002 11864 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:29.479972 14440 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.487694 14440 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.488957 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.489704 11948 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.493876 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:29.498394 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.500720 14452 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.502398 14440 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.502437 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.503299 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.504412 14484 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.504994 14484 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.507055 11866 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:29.507755 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.508127 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.509248 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.461525 14450 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.463292 14469 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.465989 14361 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:29.522675 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.514760 11944 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:29.466194 14463 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.515218 11943 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:29.532555 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:29.533413 11943 raft_consensus.cc:606] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.533913 11943 raft_consensus.cc:614] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:29.534688 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 97619.4us
I20260709 12:10:29.535737 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.521984 11940 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:29.539775 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.541520 11948 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:29.541394 14463 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:29.542184 14472 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:10:29.542210 11946 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:29.569998 11940 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.547520 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.507525 14440 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.575142 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.517715 14460 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.580725 14427 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:29.583359 14481 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.583464 14427 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.584002 14481 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:29.584388 14481 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.589118 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.590118 11942 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:29.574630 14432 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.004s
I20260709 12:10:29.590520 11942 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.523021 14439 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:29.595505 11945 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:29.595934 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:29.639730 11873 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.597921 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.605718 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.606567 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.630424 12022 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.630331 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:29.641368 11864 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:29.531132 14337 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.638384 12013 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:29.643620 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50884.5us
I20260709 12:10:29.639206 12020 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.640677 12015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:10:29.603706 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.645226 12015 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:29.645756 12015 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.648098 14463 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.648556 12018 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.649173 14484 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.649842 14484 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:29.649984 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46362.3us
I20260709 12:10:29.650888 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.651795 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.652626 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.652729 14471 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.653391 14450 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:29.653611 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.654830 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.654963 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.655941 11870 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:29.655047 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.582535 14460 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.661329 11868 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.658030 14483 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.662931 14415 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.663508 11869 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:29.664639 11872 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.665336 14415 raft_consensus.cc:993] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:29.665818 14415 raft_consensus.cc:1081] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:29.668627 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.544744 14361 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.667609 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.678879 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:29.722822 11865 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.729847 11941 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:29.635658 14440 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.742210 11940 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:29.654976 11942 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.747833 11942 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.750218 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 82661.1us
I20260709 12:10:29.750612 11873 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:10:29.759029 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 153389us
I20260709 12:10:29.606999 14432 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.760043 11947 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.759940 11939 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:29.681182 14484 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.671669 14452 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:29.779712 14484 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.764636 14469 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.780720 14484 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.679854 14483 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.782248 14483 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.784526 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:29.785686 11864 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:29.765988 14480 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.310s	user 0.000s	sys 0.004s
I20260709 12:10:29.768699 12015 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:29.769891 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.790768 12015 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:29.791102 13819 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:29.762670 14463 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:29.796298 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.771399 11947 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:29.796113 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.776144 14361 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.777734 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:29.826596 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 62845.3us
I20260709 12:10:29.777158 14460 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.828297 14460 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.828409 11942 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:29.760133 14474 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.672410 14471 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.802435 14469 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.804184 14337 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.806150 14481 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.832953 14481 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.834026 12017 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.808338 14432 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:29.809875 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.802708 13819 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.836615 13819 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.839152 14361 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.815439 14475 raft_consensus.cc:2764] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:29.842226 14443 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:29.830823 14471 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.842555 14475 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.843731 14361 raft_consensus.cc:3055] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.830883 14469 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:29.844686 14361 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.845068 14469 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.845757 14361 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.843634 14415 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.849557 13819 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:29.848371 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 94587.6us
W20260709 12:10:29.854277 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 185713us
I20260709 12:10:29.856094 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.858242 13819 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.875798 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:29.876773 11873 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:29.877192 11873 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.878278 12013 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.879680 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:29.880676 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:29.881455 11868 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:29.877363 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.885820 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.885390 11870 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:29.887603 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.851545 14415 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.882340 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:29.893272 12016 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.894261 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:29.894634 12020 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:29.894891 11872 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.853425 14435 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:29.897230 12014 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:29.851650 14481 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:29.899344 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:29.900027 11943 raft_consensus.cc:606] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.900352 11943 raft_consensus.cc:614] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.862713 14337 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.900418 12609 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.897658 12022 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:29.897891 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:29.905555 14489 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.906598 14428 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:29.904847 13819 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:29.910341 14337 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.911290 14337 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.911772 14337 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.912710 14337 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.856796 14461 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:29.914775 14461 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.915153 14461 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.916093 14461 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.918900 14415 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.920186 14415 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.888487 14325 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:29.924319 14325 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.924717 14325 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:29.925573 14325 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:29.926806 14325 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.903471 14469 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:29.934482 14469 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.949004 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.949635 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.948493 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.950819 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:29.917369 14461 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.959180 11872 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:29.957135 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:29.935038 14469 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.976418 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:29.980129 11943 raft_consensus.cc:606] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:29.980487 11943 raft_consensus.cc:614] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.902453 14450 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.951712 14463 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:29.979239 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:29.996028 14361 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.951712 14474 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:29.956154 11873 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.031913 11873 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:30.038040 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.040109 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 212692us
W20260709 12:10:30.042258 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.045997 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:29.997341 14452 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:30.053246 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 155438us
W20260709 12:10:30.051098 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 151887us
I20260709 12:10:30.055976 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:30.056537 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.058059 14440 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.028815 14448 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:30.032931 14280 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:30.036633 14474 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.001362 14409 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:10:30.063261 14489 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:30.058694 14440 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:30.106124 14440 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.071466 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:30.110574 14427 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:30.071821 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:30.111196 14474 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:30.111471 12609 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.090793 14448 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.114768 12602 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:30.115885 14448 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:30.116977 14471 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.117492 14471 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:30.096174 14463 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.118428 14471 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.064316 14469 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.064428 14488 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:30.060758 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:30.126449 11940 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:30.130215 11872 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:30.058698 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.125705 11769 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:30.141145 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 80490.4us
I20260709 12:10:30.138475 11769 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.149991 12609 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:30.152793 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.150661 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:30.150578 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 91969.2us
I20260709 12:10:30.158641 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.161913 13819 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:30.162938 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:30.155468 11769 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:30.145164 14471 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.151401 14488 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:30.183966 14500 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:30.196772 14488 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.199216 14504 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.142995 14462 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:30.151057 14489 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.100526 14450 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.154872 14496 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.211962 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:30.212623 11940 raft_consensus.cc:606] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:30.213020 11940 raft_consensus.cc:614] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.151875 14498 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:30.211301 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52725.4us
W20260709 12:10:30.210826 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.508s (SENT) [suppressed 19 similar messages]
I20260709 12:10:30.219583 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.193207 14510 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.223508 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.211022 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 172) took 5571 ms. Trace:
I20260709 12:10:30.217921 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:30.218305 14509 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.234007 14509 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.144331 14452 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.236523 14509 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:30.237190 14509 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:30.238060 14493 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:10:30.229324 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:30.207212 14500 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:30.231659 14432 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.231807 14475 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:30.232808 14505 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:30.284297 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55051.5us
I20260709 12:10:30.206972 14460 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:30.286908 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.290132 14460 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:30.290760 14500 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.293103 14460 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:30.285960 14496 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.295142 14434 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.295727 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:30.225337 11770 rpcz_store.cc:276] 0709 12:10:24.645172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.649584 (+  4412us) service_pool.cc:224] Handling call
0709 12:10:30.210913 (+5561329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:28.538561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:28.590096 (+ 51535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:28.594786 (+  4690us) write_op.cc:435] Acquired schema lock
0709 12:10:28.596645 (+  1859us) tablet.cc:662] Decoding operations
0709 12:10:28.607431 (+ 10786us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:28.607487 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:28.607512 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:10:28.608568 (+  1056us) tablet.cc:701] Row locks acquired
0709 12:10:28.608588 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:10:28.608746 (+   158us) write_op.cc:270] Start()
0709 12:10:28.608870 (+   124us) write_op.cc:276] Timestamp: P: 1783599028608698 usec, L: 0
0709 12:10:28.608894 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:28.663178 (+ 54284us) log.cc:844] Serialized 5586 byte log entry
0709 12:10:28.987279 (+324101us) op_driver.cc:464] REPLICATION: finished
0709 12:10:29.264860 (+277581us) write_op.cc:301] APPLY: starting
0709 12:10:29.265842 (+   982us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:29.273848 (+  8006us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:29.273988 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:29.275601 (+  1613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:29.275960 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:10:29.276027 (+    67us) write_op.cc:312] APPLY: finished
0709 12:10:29.276445 (+   418us) log.cc:844] Serialized 101 byte log entry
0709 12:10:29.301868 (+ 25423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:29.312877 (+ 11009us) write_op.cc:454] Released schema lock
0709 12:10:29.312940 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:29.313425 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:29.313454 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17459,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":267966,"apply.run_cpu_time_us":4343,"apply.run_wall_time_us":56172,"num_ops":14,"prepare.queue_time_us":364160,"prepare.run_cpu_time_us":33719,"prepare.run_wall_time_us":331719,"raft.queue_time_us":163938,"raft.run_cpu_time_us":58738,"raft.run_wall_time_us":159109,"replication_time_us":378214,"thread_start_us":611354,"threads_started":4,"wal-append.queue_time_us":153954,"wal-append.run_cpu_time_us":39057,"wal-append.run_wall_time_us":1463076}]]}
I20260709 12:10:30.227831 14498 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:30.323263 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99287.6us
I20260709 12:10:30.327240 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:30.334232 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.286186 14509 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:30.337334 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 126533us
W20260709 12:10:30.343446 11839 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.575s (SENT)
I20260709 12:10:30.344033 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.353667 14460 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:30.362653 11839 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.671s (SENT)
W20260709 12:10:30.369874 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.369333 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:30.372895 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 155057us
I20260709 12:10:30.324241 14432 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:30.315137 14496 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:10:30.397130 11839 leader_election.cc:336] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.675s (SENT)
I20260709 12:10:30.397871 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.399220 14511 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:30.399060 14465 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 12:10:30.574462 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.438985 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.399308 14492 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.571619 11864 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:30.576403 11864 pending_rounds.cc:85] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 2
W20260709 12:10:30.531926 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 235208us
I20260709 12:10:30.579460 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.580476 12014 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:30.581722 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.438621 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:30.592213 11871 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.592957 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:30.593845 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 196721us
W20260709 12:10:30.595117 11839 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.687s (SENT)
I20260709 12:10:30.595363 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.595563 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.596416 12022 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:30.590162 11868 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:30.576767 11864 pending_rounds.cc:107] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:30.598619 11864 raft_consensus.cc:2889] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:30.401067 14501 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:30.604485 11947 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:30.579571 14481 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.564586 14515 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.209s
I20260709 12:10:30.607802 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.407541 14504 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.605088 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:30.635934 11940 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.636476 11940 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:30.482331 14509 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:30.597391 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.400460 14498 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:30.674042 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49860.9us
I20260709 12:10:30.650359 11940 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.675726 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:30.406402 14440 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.677861 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.631171 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.400166 14473 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.409772 14462 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.669741 12020 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.670768 11943 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:30.678755 12018 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:30.675952 11940 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.469760 14460 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.683822 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.630211 14481 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:30.686169 12018 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:30.686870 12016 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.564911 14514 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.280s
I20260709 12:10:30.673079 14492 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:30.673731 14511 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:30.699458 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.729310 11865 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:30.730226 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.731093 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.732961 12018 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:30.733475 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.682821 14462 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:30.741870 12015 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:30.742434 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:30.693326 14427 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:30.728993 14425 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:30.754982 11940 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:30.757866 14361 consensus_meta.cc:287] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.005s
I20260709 12:10:30.739742 14434 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.682602 14505 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:30.760382 14462 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:30.772215 14462 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.699075 14510 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.764704 14481 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.774575 14481 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.738492 14525 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:30.403746 14437 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:30.769642 14491 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.780233 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.800486 12018 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6. Re-sending same reply.
I20260709 12:10:30.784040 12020 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:30.744519 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:30.801844 12015 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:30.802548 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.799078 11939 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:30.811029 12018 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:30.815934 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 220818us
W20260709 12:10:30.824667 11839 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.787s (SENT)
I20260709 12:10:30.787487 14415 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.856091 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.817018 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.787750 14427 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:30.859460 12018 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.860805 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.811s (SENT)
I20260709 12:10:30.863940 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.787207 14280 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:10:30.857671 14415 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:30.870271 12015 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.874786 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:30.868031 14450 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.739080 14511 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:30.870766 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:30.801330 14525 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:30.869691 14471 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
I20260709 12:10:30.883642 12022 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.889946 12014 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:30.894429 12018 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:30.876621 14427 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.899330 12016 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:30.814575 14491 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:30.900494 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:30.877928 14415 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.939586 14491 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:30.946081 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 59574.3us
I20260709 12:10:30.875126 14440 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:30.941805 14534 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:10:30.887367 14450 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:30.875715 14461 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:30.940013 14530 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:10:30.947929 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 199822us
I20260709 12:10:30.949429 12015 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:30.955641 14532 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.085809 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:30.956347 12022 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
W20260709 12:10:31.005160 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.101226 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.098397 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:31.104292 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:31.004191 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 681) took 1053 ms. Trace:
I20260709 12:10:31.064011 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1416) took 1113 ms. Trace:
I20260709 12:10:31.122298 11947 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:31.289507 14474 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.327931 14474 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.330852 14474 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.335716 12013 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:31.337677 11870 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.339195 14443 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.339759 14443 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.067677 14503 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.109989 12604 rpcz_store.cc:276] 0709 12:10:29.947052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.947299 (+   247us) service_pool.cc:224] Handling call
0709 12:10:29.947705 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.957964 (+ 10259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.957996 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.977435 (+ 19439us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.205610 (+228175us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:30.266946 (+ 61336us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.316590 (+ 49644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.316678 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.966295 (+649617us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b1800362e60. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:30.969498 (+  3203us) raft_consensus.cc:1685] finished
0709 12:10:31.000432 (+ 30934us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.000635 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35919,"prepare.queue_time_us":199898,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":50975,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":5523,"spinlock_wait_cycles":11809664,"thread_start_us":210329,"threads_started":2,"wal-append.queue_time_us":327164}
W20260709 12:10:31.320675 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 459852us
W20260709 12:10:31.347337 11839 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.813s (SENT)
I20260709 12:10:31.347826 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:31.342372 11939 rpcz_store.cc:276] 0709 12:10:29.950458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.950609 (+   151us) service_pool.cc:224] Handling call
0709 12:10:31.063669 (+1113060us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540014a854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:31.063869 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886374784}
I20260709 12:10:31.342372 14443 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:31.275353 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.102697 14481 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:31.040925 14535 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:31.128960 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.170128 14514 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 12:10:30.998849 14425 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:31.069123 14498 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:31.051642 14447 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.967562 14511 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:31.087901 14525 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:31.357724 11839 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.817s (SENT)
I20260709 12:10:31.040736 14519 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.320341 14499 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.367463 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 351096us
I20260709 12:10:31.100206 14461 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:31.208647 14532 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.405262 14519 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.360620 14425 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:31.358175 14495 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:31.401142 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 43533.3us
I20260709 12:10:31.359323 14538 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.356433 14503 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:31.407097 13819 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.419162 13819 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.399981 14509 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.428331 14425 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.430250 14474 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.375985 14535 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.385207 14498 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.412045 14532 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.394112 14447 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.360940 14481 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.429482 14450 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.441587 14519 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.442543 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:31.443142 14511 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.406066 14461 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.445672 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:31.460069 12019 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.444752 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:31.461241 12013 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.452590 13819 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.464121 13819 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:31.464808 13819 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.453586 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:31.444296 14437 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:10:31.404923 14499 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.457819 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.473199 12018 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:31.474696 12016 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:31.488363 13819 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:31.491482 13819 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.457556 14425 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.472445 14415 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 12:10:31.495317 13819 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.497105 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:31.425338 14538 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:31.536528 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 124442us
I20260709 12:10:31.451931 14474 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.537878 13819 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.539273 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.541445 13819 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.450847 14509 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.541976 13819 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:31.547360 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.555338 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:31.486874 14511 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.536851 14503 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.565371 14452 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:31.565927 14503 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.567101 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.568562 14532 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.569955 14481 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:31.572045 12021 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:31.572192 14538 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.576104 14500 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:31.555902 14528 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.578831 14528 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.587401 14499 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.589470 14447 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:31.562449 14469 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.590806 14469 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:31.591336 14469 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.602435 14498 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.560654 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.562750 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:31.609653 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 47004.8us
I20260709 12:10:31.549301 14495 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.616137 13819 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.628460 14500 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.629261 14500 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:31.557101 14450 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.538693 14415 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.634788 12015 raft_consensus.cc:2410] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:31.647785 12019 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:31.655210 14509 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:31.693416 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:31.694934 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:31.625825 14463 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:31.692701 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 297493us
I20260709 12:10:31.611918 14528 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.633489 14495 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:31.699252 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.818483 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:31.698196 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 296236us
I20260709 12:10:31.819459 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.821709 12021 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:31.822322 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:31.812750 12013 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:10:31.828727 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.829366 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:31.845943 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.841741 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.771612 14553 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.888109 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:31.878121 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.881733 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48739.6us
I20260709 12:10:31.840399 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:31.830088 12013 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.726926 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:31.896518 12604 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:31.724452 14437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36802 (request call id 1) took 2812 ms. Trace:
I20260709 12:10:31.834769 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:31.812911 14415 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.806337 14500 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:31.933837 11873 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 2.
I20260709 12:10:31.777963 14409 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.962678 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:31.967051 12014 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:31.969599 12013 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:31.999189 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 108293us
I20260709 12:10:31.810657 14511 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:32.052090 14546 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.052809 14514 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:31.969374 14452 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.061897 14415 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:32.062484 14415 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:32.062515 14452 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.063725 14415 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.038038 14527 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.066251 14527 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.043632 14435 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.068367 14435 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.072276 14409 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.075374 14409 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.876075 14528 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.078181 14528 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:31.973825 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.212152 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 222367us
I20260709 12:10:31.911573 14481 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.224433 14481 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:31.655900 14450 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.081223 14528 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:32.241617 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.830138 14443 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.885612 14535 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:31.886590 14498 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:31.911933 14489 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.259235 14435 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:31.931442 14532 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.316640 14532 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.319171 14532 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.319902 14532 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.320497 14532 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.052943 14546 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.238659 14511 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.312179 14474 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.235927 14509 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.234834 14496 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:32.330412 11839 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.508s (SENT)
I20260709 12:10:32.311404 14450 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:32.331435 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 279102us
I20260709 12:10:32.330550 14436 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.366910 14463 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:32.314235 14535 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:31.973474 14553 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.327077 14498 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.327373 14489 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.529239 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.533320 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.437647 11940 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:32.526927 11944 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:32.418107 11947 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:32.437347 11942 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:32.561300 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.562265 11946 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:32.564327 11941 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:32.558022 11873 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:32.526631 11943 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:32.565759 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 331698us
W20260709 12:10:32.566970 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 236590us
W20260709 12:10:32.567703 11839 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.582s (SENT)
I20260709 12:10:32.569622 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.569820 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.557879 12019 raft_consensus.cc:2376] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6. Re-sending same reply.
I20260709 12:10:32.570379 11869 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.570883 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.526450 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:31.901898 14437 rpcz_store.cc:276] 0709 12:10:28.942773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.950970 (+  8197us) service_pool.cc:224] Handling call
0709 12:10:29.042920 (+ 91950us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b58007f04d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba2e70a 00007f1f1ba2f76a 00007f1f1ba2e91b 00007f1f1ba3a03c 00007f1f1ba396b3 00007f1f1ba319fa 00007f1f209f94c9 00007f1f19f75c54
0709 12:10:29.139780 (+ 96860us) log.cc:844] Serialized 501 byte log entry
0709 12:10:29.909788 (+770008us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b240030d3e8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f18984fb0 00007f1f1b5fb488 00007f1f1b5fbbe8 00007f1f1b5d3398 00007f1f1b5ce76a 00007f1f1b5cdbb6
0709 12:10:31.724295 (+1814507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1040,"raft.queue_time_us":1323,"raft.run_cpu_time_us":1397,"raft.run_wall_time_us":1397,"spinlock_wait_cycles":78274048,"thread_start_us":59597,"threads_started":1,"wal-append.queue_time_us":112984,"wal-append.run_cpu_time_us":8944,"wal-append.run_wall_time_us":1639893}
W20260709 12:10:32.535332 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.491714 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.575030 11866 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:32.575217 11945 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
W20260709 12:10:32.462858 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 572482us
I20260709 12:10:32.576464 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.577251 11866 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:32.577896 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:32.376914 14511 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.585491 14511 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.574028 11865 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:32.588814 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:32.530151 14545 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:10:32.611877 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.612591 11867 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:32.613570 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.613963 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1998) took 1443 ms. Trace:
I20260709 12:10:32.614385 11867 raft_consensus.cc:2410] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:32.614323 12022 rpcz_store.cc:276] 0709 12:10:31.170115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.170254 (+   139us) service_pool.cc:224] Handling call
0709 12:10:31.170695 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.345392 (+174697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.345440 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.347162 (+  1722us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.696814 (+349652us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.696858 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.696926 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.613715 (+916789us) raft_consensus.cc:1685] finished
0709 12:10:32.613736 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.613877 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10888,"raft.queue_time_us":184202,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":16853,"thread_start_us":295730,"threads_started":1,"wal-append.queue_time_us":859664}
W20260709 12:10:32.530200 14550 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:10:32.616364 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.594537 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.618114 11866 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 12:10:32.594683 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.617472 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.612620 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.597047 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.621502 11939 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:32.621819 11873 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:32.597445 14425 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.063s	user 0.012s	sys 0.001s
I20260709 12:10:32.531102 14532 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.633736 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.603514 14481 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:32.410274 14496 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.416452 14436 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.606389 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.608530 14489 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.610211 14527 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.610309 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.611138 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.611199 14546 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.611667 11870 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:32.531481 14469 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.940s	user 0.010s	sys 0.004s
I20260709 12:10:32.596782 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:32.621263 12022 raft_consensus.cc:2376] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4. Re-sending same reply.
I20260709 12:10:32.620378 11837 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:32.395938 14509 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.619343 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.596293 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.675526 12016 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:32.573966 14415 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.629618 11869 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:32.414914 14463 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.632989 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.571564 14564 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.413280 14450 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.638142 11943 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:32.642993 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.684757 11941 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:10:32.644292 11988 connection.cc:256] RPC call timeout handler was delayed by -1.9855517920000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 12:10:32.646296 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72662.8us
W20260709 12:10:32.690860 11988 connection.cc:256] RPC call timeout handler was delayed by -1.5256517919999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:10:32.651785 11865 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.651885 11947 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:32.619066 14443 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.431280 14535 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.603574 14498 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.618917 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.664225 11756 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:10:32.663457 14437 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.665222 12606 raft_consensus.cc:2410] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:32.665395 14481 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.666326 14527 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.667975 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:32.704553 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.704763 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.705462 12016 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:32.668593 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:32.669363 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:32.670514 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.707368 12022 raft_consensus.cc:2376] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8. Re-sending same reply.
I20260709 12:10:32.671175 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.676821 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.639422 14560 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.632748 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.716804 12019 raft_consensus.cc:2376] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6. Re-sending same reply.
I20260709 12:10:32.679304 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.643971 14511 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.686020 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.693670 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.694423 11873 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:32.697395 11946 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:32.662461 14469 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.737890 14469 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.652992 14528 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:10:32.738507 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.733168 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:32.738991 14528 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.739130 12013 raft_consensus.cc:2376] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5. Re-sending same reply.
I20260709 12:10:32.739495 14528 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:32.739842 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:32.740097 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.740339 14528 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.701215 13819 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.741832 14558 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.741796 13819 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.742345 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:32.742566 14427 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.743016 14427 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.743373 14427 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.743533 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:32.743955 13819 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.746430 14566 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:32.747982 14566 raft_consensus.cc:2764] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:32.746722 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:32.748733 14566 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.749524 14538 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.749969 14538 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.750308 14538 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.754617 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.755823 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:32.757045 11943 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:32.725945 12604 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:32.726229 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.678833 14567 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.728807 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.727115 11870 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:32.729574 14481 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:32.734272 14568 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:10:32.734952 14565 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:10:32.735090 14495 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.735311 14511 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:32.740751 12013 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:10:32.741288 11839 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.680s (SENT)
I20260709 12:10:32.757354 11869 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:32.715097 11756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 59707.6us
I20260709 12:10:32.758376 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.759136 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.719238 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.714069 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.692354 14450 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.701159 14462 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.697940 14473 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.769023 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.697863 14564 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.183697 14461 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.896835 14532 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.169703 14509 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.191592 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.191984 14509 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.191833 14532 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.192821 14509 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.809046 14553 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:32.756239 14560 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:32.812929 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:32.807981 14436 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:32.803118 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.195569 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.196038 11866 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:33.196487 12021 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:33.196943 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:33.183625 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.896329 14500 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:33.198088 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.896632 14498 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.198464 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.198975 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.199330 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1486) took 1144 ms. Trace:
I20260709 12:10:33.199110 14498 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.199762 12013 rpcz_store.cc:276] 0709 12:10:32.054972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.198207 (+1143235us) service_pool.cc:224] Handling call
0709 12:10:33.199263 (+  1056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.704286 14514 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.716276 14547 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.201103 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.190382 14481 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:32.896329 14559 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.200877 14514 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.203253 14559 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.203792 14473 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.206051 14559 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.206347 14473 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.004772 11944 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:32.805925 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.207669 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:32.860234 14566 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.208460 11944 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:32.796041 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.761514 14528 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.715850 14527 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.867530 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.202432 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:32.895955 14280 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:32.794693 14425 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.014773 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.212076 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.960544 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:33.213222 12019 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:32.782806 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:32.897090 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.239423 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:32.742377 14558 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.715535 14437 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.189332 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.214581 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.185127 12014 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:33.193112 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.222481 12016 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:33.209331 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:33.115633 14571 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.215937 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.279660 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:33.201718 14547 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.217434 11941 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:32.866768 14469 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:32.933557 14504 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.227890 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.296233 12021 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:33.229601 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.210584 14548 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.213079 14474 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.266546 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.315719 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.240290 11873 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:32.807457 14535 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.202936 14481 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.347501 14437 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.358333 14481 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.359196 14553 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.359974 12018 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6. Re-sending same reply.
I20260709 12:10:33.359835 14553 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.361352 14547 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.361426 14481 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.190368 14496 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:33.285848 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.291935 11866 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:33.285575 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.022s	sys 0.056s
I20260709 12:10:33.290918 12017 raft_consensus.cc:1217] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-4.3]   Dedup: 3.2->[4.3-4.3]
I20260709 12:10:33.291675 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1491) took 1235 ms. Trace:
I20260709 12:10:33.223227 14495 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.238842 14527 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.308887 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.389809 12017 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:10:33.330751 13819 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.316494 12019 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
I20260709 12:10:33.316465 12013 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:33.325706 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.325119 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.397380 11940 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
W20260709 12:10:33.397626 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52645.4us
I20260709 12:10:33.343880 12021 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:33.390890 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.389322 12014 rpcz_store.cc:276] 0709 12:10:32.056625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.642656 (+586031us) service_pool.cc:224] Handling call
0709 12:10:33.242856 (+600200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.223875 14462 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.346535 11872 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.357111 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 1996) took 2130 ms. Trace:
I20260709 12:10:33.208621 14566 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.252239 14558 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.389318 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.022s	sys 0.056s
I20260709 12:10:33.324676 12609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 685) took 2224 ms. Trace:
I20260709 12:10:33.410511 12013 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:33.395509 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 469714us
W20260709 12:10:33.411084 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 667562us
I20260709 12:10:33.396121 13819 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.400883 12014 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:33.412882 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1475) took 1445 ms. Trace:
I20260709 12:10:33.413319 12014 rpcz_store.cc:276] 0709 12:10:31.967742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.400087 (+1432345us) service_pool.cc:224] Handling call
0709 12:10:33.400479 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.412636 (+ 12157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.412828 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.214044 14500 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.401743 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1471) took 1435 ms. Trace:
I20260709 12:10:33.422152 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.423477 12021 rpcz_store.cc:276] 0709 12:10:31.966549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.343115 (+1376566us) service_pool.cc:224] Handling call
0709 12:10:33.343528 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.398696 (+ 55168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.401653 (+  2957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.423913 11940 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:33.328655 11869 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:10:33.348951 14473 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.305514 14546 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.283826 14509 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.406131 12019 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:33.436486 11865 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.005s
I20260709 12:10:33.437181 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1472) took 1470 ms. Trace:
I20260709 12:10:33.437376 11865 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:33.411392 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1477) took 1443 ms. Trace:
I20260709 12:10:33.362403 14548 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.437820 12019 rpcz_store.cc:276] 0709 12:10:31.966840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.396542 (+1429702us) service_pool.cc:224] Handling call
0709 12:10:33.405200 (+  8658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.436804 (+ 31604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.437031 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.337615 14504 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.410761 12609 rpcz_store.cc:276] 0709 12:10:31.090296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.090520 (+   224us) service_pool.cc:224] Handling call
0709 12:10:31.091003 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.538785 (+447782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.538837 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.539366 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.822776 (+283410us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.822827 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.301059 (+1478232us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54005c8d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:33.301113 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.301161 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:33.301174 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.314655 (+ 13481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52028,"raft.queue_time_us":54428,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":13484,"spinlock_wait_cycles":909530240,"thread_start_us":121523,"threads_started":1,"wal-append.queue_time_us":819771}
I20260709 12:10:33.282346 14503 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.408564 12020 rpcz_store.cc:276] 0709 12:10:31.160851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.162520 (+  1669us) service_pool.cc:224] Handling call
0709 12:10:31.194386 (+ 31866us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:31.347692 (+153306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.347728 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:31.357194 (+  9466us) log.cc:844] Serialized 52 byte log entry
0709 12:10:31.612481 (+255287us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b48000615d8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:10:31.860574 (+248093us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:32.371848 (+511274us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.250976 (+879128us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b1800387100. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287
0709 12:10:33.279549 (+ 28573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.290430 (+ 10881us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.290504 (+    74us) raft_consensus.cc:1685] finished
0709 12:10:33.290528 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.291162 (+   634us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154326,"prepare.queue_time_us":721299,"raft.queue_time_us":383564,"raft.run_cpu_time_us":2311,"raft.run_wall_time_us":290426,"spinlock_wait_cycles":31129344,"thread_start_us":1070427,"threads_started":3,"wal-append.queue_time_us":1196731}
I20260709 12:10:33.443729 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.403059 11945 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:33.325225 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.431823 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.439174 12013 rpcz_store.cc:276] 0709 12:10:31.968434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.402591 (+1434157us) service_pool.cc:224] Handling call
0709 12:10:33.402984 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.411070 (+  8086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.411320 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.795575 14567 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.442472 13819 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.400943 14547 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:33.441818 11873 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.449832 14548 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.447862 12013 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:33.296551 14425 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.283638 14280 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.317350 14571 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.348500 14474 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.457950 13819 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.345206 14469 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.460460 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1488) took 1404 ms. Trace:
I20260709 12:10:33.458519 12016 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.460773 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:33.457064 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.475271 12020 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:33.405859 14495 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.487056 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.488026 12609 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:33.481689 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1478) took 1513 ms. Trace:
I20260709 12:10:33.481781 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1484) took 1427 ms. Trace:
I20260709 12:10:33.479190 12013 rpcz_store.cc:276] 0709 12:10:32.055627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.447010 (+1391383us) service_pool.cc:224] Handling call
0709 12:10:33.447373 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.459491 (+ 12118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.460381 (+   890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.479575 14580 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.492944 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.455088 14450 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.492187 12020 rpcz_store.cc:276] 0709 12:10:32.054302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.444322 (+1390020us) service_pool.cc:224] Handling call
0709 12:10:33.474403 (+ 30081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.481458 (+  7055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.481716 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.490998 12016 rpcz_store.cc:276] 0709 12:10:31.968764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.437450 (+1468686us) service_pool.cc:224] Handling call
0709 12:10:33.455531 (+ 18081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.481359 (+ 25828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.481624 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.490731 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51733.3us
I20260709 12:10:33.480969 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:33.479411 13819 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.497164 11948 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:33.500664 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:33.501623 12022 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:33.497277 13819 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.436940 14481 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:33.437263 14473 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.505779 12016 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:33.511461 12016 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:33.512509 12016 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.513233 14473 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.513665 12016 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.516548 11947 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:33.457800 14498 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.470552 14560 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.442271 14546 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:33.519672 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 128820us
I20260709 12:10:33.477588 14509 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.495759 14496 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.454736 14503 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.523191 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:33.485184 14463 raft_consensus.cc:476] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:33.490294 14553 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.527529 12020 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.494823 14532 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.471635 14547 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.541033 11940 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:33.518011 14577 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.558600 11943 raft_consensus.cc:2368] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:33.559844 13819 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:33.566021 14575 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:10:33.566360 14504 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.567446 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.568203 12020 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:33.568244 14567 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:33.570102 14576 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:10:33.569515 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.577598 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.578208 14566 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.578361 12020 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:33.578941 14566 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:33.579947 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.530431 14509 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.616551 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2003) took 1064 ms. Trace:
I20260709 12:10:33.609808 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.598762 12016 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:10:33.618727 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.686673 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:33.595873 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 79893.6us
W20260709 12:10:33.672873 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 931506us
I20260709 12:10:33.688638 12022 rpcz_store.cc:276] 0709 12:10:32.551922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.728939 (+177017us) service_pool.cc:224] Handling call
0709 12:10:33.616336 (+887397us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54000b5754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.616477 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672015616}
I20260709 12:10:33.683207 12019 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.580689 12020 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:33.681267 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1488) took 1061 ms. Trace:
I20260709 12:10:33.691984 11868 rpcz_store.cc:276] 0709 12:10:32.620262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.295396 (+675134us) service_pool.cc:224] Handling call
0709 12:10:33.389932 (+ 94536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.390150 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.390175 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.390218 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.390258 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.390318 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.681016 (+290698us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54000947d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.681186 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216459008}
I20260709 12:10:33.683040 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:33.626847 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 179738us
I20260709 12:10:33.689455 11865 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:33.696563 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.697971 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.698827 11865 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:33.699870 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:33.705085 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 78797.4us
I20260709 12:10:33.707275 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.622345 14495 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.712237 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.713869 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:33.619287 12015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1464) took 2054 ms (client timeout 2728 ms). Trace:
I20260709 12:10:33.540591 14473 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:33.601624 14415 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.002s
I20260709 12:10:33.721275 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.603895 14577 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.722573 12020 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:33.607395 14571 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.604269 14462 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.609961 14546 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.619933 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1423) took 1217 ms. Trace:
W20260709 12:10:33.757767 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 257166us
W20260709 12:10:33.722548 12015 rpcz_store.cc:269] 0709 12:10:31.564719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.564900 (+   181us) service_pool.cc:224] Handling call
0709 12:10:33.618987 (+2054087us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b5400179154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.619161 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153197312}
I20260709 12:10:33.725729 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.761584 11945 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:33.761844 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:33.726693 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1524) took 1046 ms. Trace:
I20260709 12:10:33.762694 11943 rpcz_store.cc:276] 0709 12:10:32.680125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.243610 (+563485us) service_pool.cc:224] Handling call
0709 12:10:33.726538 (+482928us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400387cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.726641 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596185472}
I20260709 12:10:33.763890 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.727311 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1521) took 1104 ms. Trace:
I20260709 12:10:33.727989 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1434) took 1234 ms. Trace:
I20260709 12:10:33.690621 12016 pending_rounds.cc:85] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 3
I20260709 12:10:33.766189 12016 pending_rounds.cc:107] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:10:33.766508 12016 raft_consensus.cc:2889] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.767371 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2006) took 1161 ms. Trace:
I20260709 12:10:33.767760 12016 rpcz_store.cc:276] 0709 12:10:32.606215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.505270 (+899055us) service_pool.cc:224] Handling call
0709 12:10:33.505638 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.767018 (+261380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.767296 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.606348 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.722298 12022 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:33.675810 14538 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.925s	user 0.003s	sys 0.010s
I20260709 12:10:33.770242 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2013) took 1136 ms. Trace:
I20260709 12:10:33.573635 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.764672 11947 rpcz_store.cc:276] 0709 12:10:32.622764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.211717 (+588953us) service_pool.cc:224] Handling call
0709 12:10:33.727194 (+515477us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003881d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.727266 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542702464}
I20260709 12:10:33.771939 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.727618 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.742949 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.745884 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.746021 11946 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.775679 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.774287 11944 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:33.746573 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.776465 12015 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:33.747785 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:33.748342 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1907) took 1139 ms. Trace:
I20260709 12:10:33.608588 14500 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.749127 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.749550 14547 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:33.749841 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1460) took 2300 ms. Trace:
I20260709 12:10:33.750371 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.746064 11940 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:33.752277 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.608296 14452 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.749563 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.786330 12609 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:33.608141 14280 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.754158 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.754384 12021 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:33.788254 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1479) took 1749 ms. Trace:
I20260709 12:10:33.788564 12021 rpcz_store.cc:276] 0709 12:10:32.038652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.753683 (+1715031us) service_pool.cc:224] Handling call
0709 12:10:33.754039 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.787997 (+ 33958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.788198 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.755570 12014 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:33.790093 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1480) took 1737 ms. Trace:
I20260709 12:10:33.790526 12014 rpcz_store.cc:276] 0709 12:10:32.053135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.754895 (+1701760us) service_pool.cc:224] Handling call
0709 12:10:33.755213 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.789751 (+ 34538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.790025 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.607187 14425 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.794387 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.603217 14564 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.794675 14452 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.625969 14511 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.613749 14503 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.795799 11945 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.796465 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1513) took 1229 ms. Trace:
I20260709 12:10:33.796862 11945 rpcz_store.cc:276] 0709 12:10:32.566908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.783559 (+1216651us) service_pool.cc:224] Handling call
0709 12:10:33.795634 (+ 12075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.796179 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.796393 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.758296 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:33.797396 14452 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.797870 12020 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:33.798743 14509 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.799269 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.759954 11939 rpcz_store.cc:276] 0709 12:10:32.402646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.402827 (+   181us) service_pool.cc:224] Handling call
0709 12:10:32.403166 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.621981 (+218815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.619684 (+997703us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400240754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:33.619867 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501278592}
I20260709 12:10:33.800024 14452 raft_consensus.cc:2764] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:33.800613 11939 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:33.801230 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1518) took 1231 ms. Trace:
I20260709 12:10:33.629923 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:33.802466 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 172632us
I20260709 12:10:33.801834 11872 raft_consensus.cc:2955] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:33.802646 14500 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.803205 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:33.804157 14500 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:33.805019 14427 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.061s	user 0.008s	sys 0.005s
I20260709 12:10:33.765272 11941 rpcz_store.cc:276] 0709 12:10:32.493627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.703784 (+210157us) service_pool.cc:224] Handling call
0709 12:10:33.727798 (+1024014us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540013d8d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.727929 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176733440}
I20260709 12:10:33.770771 12016 rpcz_store.cc:276] 0709 12:10:32.634307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.768906 (+1134599us) service_pool.cc:224] Handling call
0709 12:10:33.769311 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.769776 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.769817 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.769900 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.769956 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.770032 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.770172 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.807178 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.807421 14541 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.808068 14499 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.808454 14499 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.808769 14499 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.746469 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.747877 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1908) took 1138 ms. Trace:
I20260709 12:10:33.774868 14538 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.810314 11864 rpcz_store.cc:276] 0709 12:10:32.609258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.609403 (+   145us) service_pool.cc:224] Handling call
0709 12:10:32.609793 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.289274 (+679481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.289323 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.300704 (+ 11381us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.476430 (+175726us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.476669 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.729743 (+253074us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003043d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:33.729794 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.729836 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:33.729849 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.747779 (+ 17930us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115904,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":357,"spinlock_wait_cycles":1561416576,"thread_start_us":150262,"threads_started":1,"wal-append.queue_time_us":273432}
I20260709 12:10:33.777823 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.812341 14425 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.782657 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1437) took 1288 ms. Trace:
I20260709 12:10:33.812786 14425 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.783777 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.813299 14425 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.801612 11939 rpcz_store.cc:276] 0709 12:10:32.569564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.800010 (+1230446us) service_pool.cc:224] Handling call
0709 12:10:33.800301 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.800980 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.801173 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.818104 14499 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.818217 11939 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:33.819409 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1532) took 1086 ms. Trace:
I20260709 12:10:33.820580 14499 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:33.821782 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.779050 14443 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.822640 14443 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.812947 11940 rpcz_store.cc:276] 0709 12:10:32.494605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.712073 (+1217468us) service_pool.cc:224] Handling call
0709 12:10:33.745698 (+ 33625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.782415 (+ 36717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.782602 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.786600 14571 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.784709 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:33.826073 14571 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.826534 14571 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.821669 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:33.827710 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:33.781229 12017 rpcz_store.cc:276] 0709 12:10:31.449515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.449728 (+   213us) service_pool.cc:224] Handling call
0709 12:10:33.290707 (+1840979us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:33.394898 (+104191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.749654 (+354756us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400179650. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.749783 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4218307968}
I20260709 12:10:33.547384 14514 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.828364 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:33.620790 12018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1474) took 1653 ms (client timeout 1582 ms). Trace:
I20260709 12:10:33.801031 14452 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.829624 14514 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.830086 14514 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.830511 14514 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:33.829073 12018 rpcz_store.cc:269] 0709 12:10:31.967368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.718960 (+751592us) service_pool.cc:224] Handling call
0709 12:10:33.620596 (+901636us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540015d954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:33.620713 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338009984}
I20260709 12:10:33.806823 14546 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.775707 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1512) took 1209 ms. Trace:
I20260709 12:10:33.809872 14469 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.827028 14541 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.777513 11871 rpcz_store.cc:276] 0709 12:10:32.604666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.604828 (+   162us) service_pool.cc:224] Handling call
0709 12:10:32.605178 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.755911 (+150733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.755944 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.755991 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:32.756038 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.743255 (+987217us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003552d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:33.743298 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.743438 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346152320}
I20260709 12:10:33.831054 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2016) took 1170 ms. Trace:
W20260709 12:10:33.839382 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61602.9us
I20260709 12:10:33.839627 12015 rpcz_store.cc:276] 0709 12:10:32.660240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.782901 (+1122661us) service_pool.cc:224] Handling call
0709 12:10:33.830413 (+ 47512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.830651 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.830684 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.830739 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.830777 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.830843 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.830972 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.831573 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.816212 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.805611 14500 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.829398 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:33.819743 11939 rpcz_store.cc:276] 0709 12:10:32.733217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.817347 (+1084130us) service_pool.cc:224] Handling call
0709 12:10:33.817816 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.819179 (+  1363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.819357 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.834558 14437 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.840163 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.838480 11946 rpcz_store.cc:276] 0709 12:10:32.566567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.743531 (+1176964us) service_pool.cc:224] Handling call
0709 12:10:33.745836 (+  2305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.775448 (+ 29612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.775647 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.844812 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:33.829610 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:33.845458 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:33.850283 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:33.776468 14580 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:33.861874 11988 leader_election.cc:400] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:33.862243 11988 leader_election.cc:403] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.862939 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.838804 14474 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.764145 14496 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:33.863837 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:33.812686 14538 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.870369 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.838932 14541 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.878036 14541 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.805467 14427 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.882464 14427 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:33.871491 14597 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:33.872195 14590 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.872547 14511 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.886471 14590 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.887030 14590 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.885246 14580 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.872807 14595 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:33.873528 14509 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.876648 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.886531 14511 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.860936 14452 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.893112 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.896334 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2015) took 1240 ms. Trace:
I20260709 12:10:33.912405 11946 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:33.897516 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.846513 14437 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.913439 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.914609 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.914810 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.915318 11946 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:33.907991 11945 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:33.861459 14542 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.860872 14546 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:33.917029 11940 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:33.920725 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:33.921291 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.866313 14596 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.924988 14595 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:33.925529 14593 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.927205 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:33.907078 14427 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:33.933497 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 69141.3us
I20260709 12:10:33.916419 14511 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.937804 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:33.915822 14437 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.938040 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.938973 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.921989 14538 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.908034 14527 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.927016 14415 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.926610 14503 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.922535 14542 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.892974 14425 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:33.922312 14546 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.945005 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.947702 11945 raft_consensus.cc:1813] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:33.949220 14586 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.986500 14586 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.987078 14586 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.984803 14546 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.950294 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:33.950552 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44913.9us
I20260709 12:10:33.951620 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:33.991982 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1433) took 1498 ms. Trace:
W20260709 12:10:33.971000 11839 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.872s (SENT)
I20260709 12:10:33.992342 11946 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
W20260709 12:10:33.993229 11839 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.892s (SENT)
I20260709 12:10:33.984773 11945 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:33.941583 14462 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:33.998477 14569 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.005s	sys 0.015s
I20260709 12:10:33.998863 14462 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.999325 14462 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.944113 14427 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.994488 11839 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.046s (SENT)
I20260709 12:10:34.001849 14427 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.002403 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.049s (SENT)
I20260709 12:10:34.002907 14503 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:34.003326 14527 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:33.976547 14593 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.977226 14415 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:33.992441 11942 rpcz_store.cc:276] 0709 12:10:32.493287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.712652 (+1219365us) service_pool.cc:224] Handling call
0709 12:10:33.713005 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.713452 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.713490 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.714188 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.918275 (+204087us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:33.918335 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.918436 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.991759 (+ 73323us) raft_consensus.cc:1685] finished
0709 12:10:33.991781 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.991919 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":25844,"thread_start_us":60041,"threads_started":1,"wal-append.queue_time_us":147329}
I20260709 12:10:33.956902 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:34.005136 14415 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.006083 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.009393 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.009904 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:34.010949 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.951429 14538 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.013603 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.013820 14538 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.014868 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.020493 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.944352 14596 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:34.006084 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.022284 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.022782 11872 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:33.941397 14474 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:10:34.023986 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:33.991474 14473 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.024695 11872 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:33.992286 11912 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:33.998978 14569 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.005s	sys 0.016s
I20260709 12:10:33.946933 14597 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.026377 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.022393 14596 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.003392 14503 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.030109 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:34.029947 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.021049 14437 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:33.975589 14496 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.034248 14415 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:34.036090 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 43866.4us
I20260709 12:10:34.036975 14553 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.986421 14592 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:33.982398 14542 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.046703 11940 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:34.048259 11946 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:34.032749 14469 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:34.051275 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 124210us
I20260709 12:10:34.056872 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.017493 14427 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.028442 14473 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.006421 14571 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.063578 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:34.057806 14558 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.008s
I20260709 12:10:34.023876 14595 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.069094 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.054033 14495 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.057040 14553 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.019114 14462 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.076839 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.041394 14546 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.066900 14597 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:34.079092 14509 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:34.076543 14481 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:34.082348 14546 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.083441 14509 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.086019 14593 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.067202 14473 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.085665 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.087374 14593 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.089264 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:34.098402 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.100047 12021 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.057294 14500 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:34.063951 14564 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:34.072548 14577 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.109431 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.110764 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.111418 12014 raft_consensus.cc:2376] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5. Re-sending same reply.
I20260709 12:10:34.059129 14532 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:34.114107 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.114902 12015 raft_consensus.cc:2376] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7. Re-sending same reply.
I20260709 12:10:34.117439 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.118027 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.119405 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.121330 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.123997 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.124987 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.127573 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.128562 12014 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:34.125463 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.129283 12015 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 2.
I20260709 12:10:34.130455 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.090783 14553 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.132632 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.110198 12020 raft_consensus.cc:2376] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6. Re-sending same reply.
I20260709 12:10:34.131192 12015 raft_consensus.cc:2376] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7. Re-sending same reply.
I20260709 12:10:34.143496 12016 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:34.144157 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.142925 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.070427 14592 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.072377 14558 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:34.146777 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 85575.2us
W20260709 12:10:34.148072 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 156585us
I20260709 12:10:34.150061 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.105507 14435 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:34.152025 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.158900 11866 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 2.
W20260709 12:10:34.159251 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.161644 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:34.154129 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.162233 11868 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.154810 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.155439 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.164366 12015 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:34.165642 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:34.132894 14611 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.156860 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.157018 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.171130 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.166241 11866 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:34.171757 11864 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
W20260709 12:10:34.166718 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.168193 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.156175 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.165266 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.173153 12014 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:34.170460 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.173333 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.174017 11872 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:34.175585 11941 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.179809 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1527) took 1448 ms. Trace:
I20260709 12:10:34.132055 14593 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:34.181365 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.180238 11944 rpcz_store.cc:276] 0709 12:10:32.731766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.209057 (+477291us) service_pool.cc:224] Handling call
0709 12:10:34.179645 (+970588us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400311354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:34.179751 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066267520}
I20260709 12:10:34.185084 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.185858 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.183370 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:34.239279 12015 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:34.160790 14280 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.158499 14439 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:34.346979 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.147120 14527 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:10:34.273584 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.358807 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.171276 14611 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:34.347868 12015 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.236608 14592 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:34.424870 14574 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.234s	user 0.000s	sys 0.005s
I20260709 12:10:34.428777 14495 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:34.380061 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.429448 14541 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:10:34.441560 14541 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.430689 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1485) took 1816 ms. Trace:
I20260709 12:10:34.443473 11867 rpcz_store.cc:276] 0709 12:10:32.613905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.614949 (+  1044us) service_pool.cc:224] Handling call
0709 12:10:32.615298 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:32.639613 (+ 24315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.639653 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:32.661996 (+ 22343us) log.cc:844] Serialized 52 byte log entry
0709 12:10:32.854562 (+192566us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:33.595109 (+740547us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.595648 (+   539us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.624885 (+ 29237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.625006 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.233795 (+608789us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:34.430451 (+196656us) raft_consensus.cc:1685] finished
0709 12:10:34.430475 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.430626 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46124,"prepare.queue_time_us":686334,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":30882,"raft.queue_time_us":52790,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":37396,"spinlock_wait_cycles":228497792,"thread_start_us":598722,"threads_started":2,"wal-append.queue_time_us":510642}
I20260709 12:10:34.432214 11868 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:34.432837 14415 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.434530 14586 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.363875 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:34.437808 12605 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.438414 14571 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.430014 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.503087 12017 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.472472 12015 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:34.505429 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.507208 12015 raft_consensus.cc:2376] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4. Re-sending same reply.
W20260709 12:10:34.511837 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 461765us
I20260709 12:10:34.391220 14462 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.395460 14611 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.516762 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.517335 12611 raft_consensus.cc:2368] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:34.521914 14500 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:34.522058 14564 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:34.357744 14280 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.487772 14592 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.527853 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.519598 14495 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:34.538103 14469 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:34.538937 14495 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:34.510437 14437 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.547201 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1481) took 2493 ms. Trace:
I20260709 12:10:34.547818 12019 rpcz_store.cc:276] 0709 12:10:32.053417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.440893 (+1387476us) service_pool.cc:224] Handling call
0709 12:10:33.627152 (+186259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.690923 (+ 63771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.546883 (+855960us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540015d950. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:34.547115 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406139136}
I20260709 12:10:34.523090 14427 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.553855 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:34.551668 14514 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.003s
W20260709 12:10:34.559020 14590 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.003s
I20260709 12:10:34.591658 12017 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:34.592921 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.594527 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.594583 14553 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.595649 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.597011 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.598733 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.599918 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.600706 12017 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:34.601507 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.602626 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.602974 14558 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.573082 14514 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.547026 14592 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.582841 14590 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.605238 12017 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:34.621026 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.567965 14474 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.573776 14538 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
W20260709 12:10:34.636575 14473 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:10:34.637096 14473 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.622503 14553 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.639645 14473 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.607810 14541 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:34.629606 14474 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.641925 14571 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:34.643040 14474 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.646023 13819 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.658175 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1924) took 1475 ms. Trace:
I20260709 12:10:34.659174 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:34.628861 14590 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.624001 14586 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.679957 14571 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:34.680160 14588 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.114s	user 0.000s	sys 0.015s
I20260709 12:10:34.680461 14571 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.680850 14571 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.682339 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2002) took 2131 ms. Trace:
I20260709 12:10:34.682739 12013 rpcz_store.cc:276] 0709 12:10:32.551520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.498367 (+946847us) service_pool.cc:224] Handling call
0709 12:10:33.627806 (+129439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.628009 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.628049 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.628114 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.628170 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.628260 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.682128 (+1053868us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400179150. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:34.682269 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296731008}
I20260709 12:10:34.690073 14280 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:34.692732 14511 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.003s
I20260709 12:10:34.673471 14595 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:34.699230 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.655186 14443 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.653033 14514 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.632149 14538 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.703375 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:34.674389 11869 rpcz_store.cc:276] 0709 12:10:33.183191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.435049 (+251858us) service_pool.cc:224] Handling call
0709 12:10:33.435527 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.508143 (+ 72616us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:33.854598 (+346455us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.939498 (+ 84900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.939606 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:33.939671 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.001011 (+ 61340us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4800080058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:10:34.657847 (+656836us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54000690d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:34.657918 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.658091 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66535,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":85,"raft.run_cpu_time_us":2274,"raft.run_wall_time_us":57214,"spinlock_wait_cycles":243255296,"thread_start_us":407402,"threads_started":2,"wal-append.queue_time_us":94817}
I20260709 12:10:34.652901 14592 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:34.653054 14500 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:34.713380 14593 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.656236 14527 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:10:34.652689 14567 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.730963 11837 leader_election.cc:400] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:34.731439 11837 leader_election.cc:403] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:34.728705 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.693286 14511 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.732529 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:34.733402 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:34.733497 14503 consensus_meta.cc:287] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.673s	user 0.003s	sys 0.008s
I20260709 12:10:34.734114 14503 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.735483 14592 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.736351 14496 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.738587 14496 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.738958 14496 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.742761 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.744228 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.744668 14503 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.745010 12608 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:34.746569 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.747563 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:34.750259 11869 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:34.729612 14595 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.762311 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.764606 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.722470 14538 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.755669 14625 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.763365 14595 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:34.788475 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.755852 14592 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.731269 14567 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:34.796283 14617 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.721158 14590 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:34.797820 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:33.912640 12022 rpcz_store.cc:276] 0709 12:10:32.656071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.770086 (+1114015us) service_pool.cc:224] Handling call
0709 12:10:33.770372 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.770613 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:33.782824 (+ 12211us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.895792 (+112968us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.895959 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.896006 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.896067 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.896134 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.896249 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23306,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":7883,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9543,"thread_start_us":112255,"threads_started":1}
I20260709 12:10:34.802400 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:34.792958 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 470) took 1030 ms. Trace:
I20260709 12:10:34.820099 11947 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.820333 12021 rpcz_store.cc:276] 0709 12:10:33.762960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.819149 (+ 56189us) service_pool.cc:224] Handling call
0709 12:10:33.819426 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.100776 (+281350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.792652 (+691876us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400046ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:34.792885 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644574464}
I20260709 12:10:34.806309 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:34.821933 11944 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.797350 14495 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.803862 14595 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.808794 14592 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:34.830652 14592 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.820186 11940 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:34.834198 14425 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:34.834347 14571 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.826582 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.827510 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.823251 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:34.809969 14567 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.840423 11943 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:34.841121 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:34.838356 14571 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:34.843904 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46189.1us
I20260709 12:10:34.845415 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.840426 14622 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.844846 14617 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.850244 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:34.857197 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.852506 14532 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.862048 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:34.873246 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.854211 14571 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.875231 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:34.849582 14567 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.877521 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:34.877594 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:34.885800 12020 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.877718 11943 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:34.881196 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.887379 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.853719 14435 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.890760 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:34.855283 14511 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:34.861650 14617 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:34.875669 14566 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.895925 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.892500 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.883541 14563 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:34.884408 14597 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.898072 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:34.852058 14611 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.914907 14611 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:34.916536 14496 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:34.894451 14571 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.899436 14563 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:34.918413 14563 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.919063 14496 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:34.892782 14435 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:34.921972 14435 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.923136 14638 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.897326 14577 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.924420 14577 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:34.876348 14622 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:10:34.896695 14542 consensus_meta.cc:287] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.835s	user 0.017s	sys 0.000s
I20260709 12:10:34.926369 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 119) took 7270 ms. Trace:
I20260709 12:10:34.893880 14532 raft_consensus.cc:2764] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:34.930547 14436 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.930997 14436 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:34.931605 14593 raft_consensus.cc:2764] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:34.926371 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.935709 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.929000 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:34.928093 14577 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.907883 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.929250 11769 rpcz_store.cc:276] 0709 12:10:27.651017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.651191 (+   174us) service_pool.cc:224] Handling call
0709 12:10:30.770610 (+3119419us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b54003c4ca8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f209839b4 00007f1f1f4673dc 00007f1f1f428e0b 00007f1f1f428be4 00007f1f21928fa1 00007f1f219297ff 00007f1f217e8a1b 00007f1f218f090e 00007f1f1fdb12a4 00007f1f1fdb1232
0709 12:10:34.921509 (+4150899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:30.940485 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:30.941288 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:30.941345 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:30.941383 (+    38us) tablet.cc:662] Decoding operations
0709 12:10:31.170709 (+229326us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:31.178201 (+  7492us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:31.187793 (+  9592us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:31.226932 (+ 39139us) tablet.cc:701] Row locks acquired
0709 12:10:31.226958 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:10:31.227174 (+   216us) write_op.cc:270] Start()
0709 12:10:31.227342 (+   168us) write_op.cc:276] Timestamp: P: 1783599031227110 usec, L: 0
0709 12:10:31.227372 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:10:31.346521 (+119149us) log.cc:844] Serialized 1686 byte log entry
0709 12:10:33.183137 (+1836616us) op_driver.cc:464] REPLICATION: finished
0709 12:10:33.882474 (+699337us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f189290ac 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1f469ef0
0709 12:10:33.950469 (+ 67995us) write_op.cc:301] APPLY: starting
0709 12:10:33.950570 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:33.950737 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:33.980355 (+ 29618us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:34.079734 (+ 99379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:34.089806 (+ 10072us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:34.089871 (+    65us) write_op.cc:312] APPLY: finished
0709 12:10:34.146368 (+ 56497us) log.cc:844] Serialized 41 byte log entry
0709 12:10:34.536331 (+389963us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.544638 (+  8307us) write_op.cc:454] Released schema lock
0709 12:10:34.552989 (+  8351us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:34.567288 (+ 14299us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.567333 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":212580,"reported_tablets":8,"spinlock_wait_cycles":2832640,"child_traces":[["op",{"apply.queue_time_us":767084,"apply.run_cpu_time_us":41264,"apply.run_wall_time_us":616773,"num_ops":4,"prepare.queue_time_us":106192,"prepare.run_cpu_time_us":32083,"prepare.run_wall_time_us":844600,"raft.queue_time_us":566091,"raft.run_cpu_time_us":20989,"raft.run_wall_time_us":859586,"replication_time_us":1955556,"spinlock_wait_cycles":135881600,"thread_start_us":1671513,"threads_started":5,"wal-append.queue_time_us":1307613,"wal-append.run_cpu_time_us":45780,"wal-append.run_wall_time_us":1535054}]]}
I20260709 12:10:34.950336 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.952410 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.958321 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:34.962579 14625 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:34.932008 14436 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.956743 14617 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.964771 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:34.989693 14436 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.991043 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:34.991962 14638 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.992787 14638 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.953577 14452 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.988210 12021 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:34.956846 14532 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:34.965063 14566 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.965629 14564 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:34.976210 14571 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.934098 14542 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:34.992707 14527 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:35.008801 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:35.009765 12021 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:35.010212 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:34.981446 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:35.003758 14461 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.975229 14608 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:34.976768 14611 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:35.009522 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:35.006937 14532 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:35.020701 14611 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:35.035462 14611 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:35.036963 14611 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.058564 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:35.060191 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:35.034613 14573 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.016747 14461 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.075201 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:35.088681 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:35.050946 14617 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.049839 12602 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:35.093165 11872 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.094260 11867 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:35.046845 14625 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.105885 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.106206 11943 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.105433 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.106873 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.106998 11866 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:35.107302 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.108181 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.108615 11942 raft_consensus.cc:2376] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4. Re-sending same reply.
I20260709 12:10:35.110313 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.114665 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.115353 12018 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:35.098354 14595 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.121199 14595 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:35.101137 14617 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.123342 12016 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.123576 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.127482 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:35.127867 11942 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:35.124497 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:35.128199 11864 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.129134 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.131054 11944 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.133432 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.101159 14611 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.134443 11945 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:35.134485 11872 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.139964 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.142458 14542 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:35.144081 14461 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:35.144609 14532 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:35.150547 14643 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:35.151129 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1520) took 2528 ms. Trace:
W20260709 12:10:35.152065 14642 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:10:35.102754 14564 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:35.154502 14564 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:35.154956 14564 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:35.155841 14564 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.157140 14564 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.157649 14495 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.158521 14495 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.111634 14625 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.158875 14495 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:35.159791 14495 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.160828 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.151530 11941 rpcz_store.cc:276] 0709 12:10:32.622480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.805871 (+1183391us) service_pool.cc:224] Handling call
0709 12:10:33.806173 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.175964 (+369791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.150862 (+974898us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003d4d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:35.151057 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849169664}
I20260709 12:10:35.162983 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.166900 14495 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.165061 11871 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
W20260709 12:10:35.171160 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54506.9us
I20260709 12:10:35.166939 14625 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:35.196310 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.200672 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.205258 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:35.206571 14647 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:35.211261 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:35.227732 11942 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.227276 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:35.231211 11942 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.231841 11941 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:35.236967 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.236382 14563 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.243815 14563 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:35.245232 11867 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.228461 14614 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.246104 14614 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:35.246150 14439 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:35.247576 14439 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.248124 14439 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:35.247437 14614 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.227902 14597 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.250896 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:35.182090 14646 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:35.252604 11869 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.253168 12021 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:35.259927 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.244032 14577 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.249114 14439 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.273036 14439 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.281188 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.510s (SENT) [suppressed 27 similar messages]
I20260709 12:10:35.282095 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:35.288123 14577 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:35.263041 14646 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:35.290553 11873 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.298815 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:35.290220 14541 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.264786 14509 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.305431 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:35.307236 11940 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:35.246196 14435 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.313206 11947 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:35.323824 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:35.337262 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.340401 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:35.340840 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 89029.6us
I20260709 12:10:35.343251 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:35.344426 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:35.344820 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.304934 14646 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:35.365396 11947 raft_consensus.cc:2368] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:35.365302 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:35.308473 14541 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:35.284686 14593 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:35.324913 14577 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:35.317946 14509 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:35.325165 14647 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:35.348102 11873 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:35.372156 11947 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.340667 14597 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.327327 14527 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.397679 11947 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.365005 14617 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:35.413290 11873 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:35.417089 11839 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.674s (SENT)
I20260709 12:10:35.419595 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:35.388890 12603 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.449218 11873 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:35.393810 14597 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.458228 11947 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:35.466147 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.442317 14514 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.455809 14617 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.482960 11947 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:35.402606 14647 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.394407 14577 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.464255 14597 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.527876 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.528996 11947 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:35.531356 14577 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:35.532932 14637 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.682s	user 0.003s	sys 0.003s
W20260709 12:10:35.540383 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.547448 14647 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:35.554152 14435 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:35.460208 14541 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.521078 14509 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.480641 14595 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:35.556252 14595 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.579403 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:35.488054 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.505311 14652 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 12:10:35.506528 14654 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:10:35.507601 14651 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:10:35.510365 14657 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:35.511360 14646 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.481382 14514 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:35.595422 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.470178 14527 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
W20260709 12:10:35.594123 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 240306us
I20260709 12:10:35.604606 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.608357 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:35.613480 11870 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:35.616639 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:35.616700 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.617520 11939 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:35.618008 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:35.622553 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:35.622817 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:35.623675 12607 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:35.624470 14461 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:35.631579 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:35.626505 14559 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:35.626622 14590 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.651216 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:35.624632 14514 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.665280 14514 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.647568 14614 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:35.677366 12611 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:35.679087 14452 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:35.679859 14655 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
I20260709 12:10:35.679785 14452 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.682359 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:35.684912 14614 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.685346 14614 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:35.686362 14614 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.655195 14571 raft_consensus.cc:2764] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:35.652282 14559 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:35.690932 14559 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.652637 14590 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.705775 14590 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.716095 14597 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.717871 12015 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:35.720072 14495 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.720530 14495 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:35.725728 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.729090 14617 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.721437 14495 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.731442 14495 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.735926 14595 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:35.748852 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:35.749693 11872 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:35.756065 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:35.766549 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:35.767966 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.774585 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.775880 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.776712 11943 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:35.777432 11946 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.777432 11947 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:35.779855 11947 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.779781 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:35.781498 11947 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:35.782209 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.783792 11941 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.786679 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.778209 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.789016 12610 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.790302 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:35.806458 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:35.807658 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.808274 11942 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.815347 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.816054 11944 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.816090 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:35.817104 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:35.817710 11939 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.834506 14435 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:35.834916 14499 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.865991 14611 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.865904 14499 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.866601 14611 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:35.867172 14628 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.867619 14611 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:35.868392 14499 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:35.864835 11941 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:35.874326 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:35.875044 11941 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:35.875658 11941 raft_consensus.cc:614] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.810761 14566 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.851133 14615 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.822259 14511 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.875931 11939 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:35.929666 11948 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.887156 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 267932us
W20260709 12:10:35.891776 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75764.9us
I20260709 12:10:35.863700 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:35.929857 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.884908 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 128940us
I20260709 12:10:35.822144 14593 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:10:35.790445 14595 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:10:35.936295 11939 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:35.835537 14567 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:10:35.943501 11944 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:35.949895 12013 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.952150 11940 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:35.937909 14566 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:35.927575 14590 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.968223 14566 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:35.972435 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 180526us
I20260709 12:10:35.936357 14559 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:35.942371 14542 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:35.954342 14511 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.985219 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.946755 14615 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:36.006335 14597 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:36.014318 14673 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:10:36.043280 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.978730 14681 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:35.998080 14527 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.003931 14511 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:35.998778 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59049.5us
W20260709 12:10:36.071847 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.017436 14590 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.021085 12602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 290) took 1857 ms. Trace:
W20260709 12:10:36.085821 14675 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:36.085909 14676 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.090449 14676 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:36.091418 14672 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:10:36.095238 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.084398 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:36.103623 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:36.096683 14452 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:36.104447 14662 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.598s	user 0.005s	sys 0.000s
I20260709 12:10:36.094161 14628 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:36.104952 14628 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:36.106024 14628 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:36.107040 14664 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.594s	user 0.002s	sys 0.000s
I20260709 12:10:36.107793 14511 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.107452 14628 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.109089 14593 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.093011 14676 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.113581 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:36.116067 11872 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.118377 11870 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:36.078935 14680 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.109890 14461 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.077764 12602 rpcz_store.cc:276] 0709 12:10:34.163724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.167346 (+  3622us) service_pool.cc:224] Handling call
0709 12:10:34.184181 (+ 16835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.110911 (+926730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.016446 (+905535us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54004abd54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:36.021001 (+  4555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925274496}
I20260709 12:10:36.082001 14615 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.126529 14461 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:36.149406 14461 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.113745 14559 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.079293 14435 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:36.125408 14680 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:36.080135 14527 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.109511 14593 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:36.148581 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.152912 11872 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:36.157011 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.140512 14615 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.175674 14615 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.175880 14680 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.177095 12603 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:10:36.172801 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.179296 14542 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:36.179188 14593 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.180531 14542 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.181010 14542 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:36.180603 14593 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.169338 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:36.184854 14590 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.185963 14590 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.186316 14590 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.198132 14614 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.199405 14527 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.202764 14500 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.203224 14500 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:36.203796 14542 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.207199 14647 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.207582 14542 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.204114 14500 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.208148 14677 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.208629 14677 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:36.208681 14500 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.209640 14677 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.210598 14511 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.210872 14677 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.213107 14595 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.211468 14577 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.213840 14577 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:36.214769 14656 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.734s	user 0.000s	sys 0.009s
I20260709 12:10:36.215485 14647 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.211573 14676 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.212102 14684 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:36.211241 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:36.227468 14679 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:36.194111 14461 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.213675 14595 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.231840 14566 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.233453 14624 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:36.233521 14595 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.228942 14597 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.239442 11940 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.240666 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.233784 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:36.217803 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.218278 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:36.244565 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:36.218858 11870 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.220353 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.246783 11865 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:36.247839 14514 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.247977 14681 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:36.248392 14514 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.248536 14620 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.248790 14514 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.249173 14620 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:36.250129 14620 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.253611 14688 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:36.245512 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:36.255965 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:36.257665 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:36.211200 14511 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.259029 14427 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.259824 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:36.260717 14511 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.261209 14646 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.262223 14527 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.262669 14527 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.263051 14527 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.266374 14509 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.266995 14566 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.267980 14577 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.228396 14676 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.270545 14676 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.228930 14680 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.233948 14624 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:36.272595 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:36.275228 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:36.277674 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:36.256201 14595 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.278440 12015 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.216020 14647 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.274569 14427 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:36.277261 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:36.284786 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.290042 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:36.281904 14587 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.291764 14587 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.291862 14674 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.292241 14587 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.292405 14674 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:36.292889 14674 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.292989 14541 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.293727 14623 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:36.294945 14682 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:10:36.296082 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:36.284274 14559 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.301390 12019 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:36.302682 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.281993 14511 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.306666 14511 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:36.307721 14511 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.310921 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:36.315950 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:36.316829 11940 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.322082 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:36.322824 12022 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
W20260709 12:10:36.323619 14696 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:10:36.325570 14659 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.813s	user 0.006s	sys 0.000s
I20260709 12:10:36.326838 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1520) took 1029 ms. Trace:
I20260709 12:10:36.328245 14597 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:36.328688 14597 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:36.296265 14679 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.240064 14684 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.330071 14682 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.330317 14567 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.330767 14567 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.330688 14682 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.331265 14567 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.331899 14684 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.327235 11866 rpcz_store.cc:276] 0709 12:10:35.297424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.297792 (+   368us) service_pool.cc:224] Handling call
0709 12:10:35.298238 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.308851 (+ 10613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.308901 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.324032 (+ 15131us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.410104 (+ 86072us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:35.410160 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.410267 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.324816 (+914549us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:36.326519 (+  1703us) raft_consensus.cc:1685] finished
0709 12:10:36.326539 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.326771 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10151,"raft.queue_time_us":15851,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7120,"spinlock_wait_cycles":13481216,"thread_start_us":79033,"threads_started":1,"wal-append.queue_time_us":181517}
I20260709 12:10:36.344854 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.345417 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.345744 11866 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:36.347379 11869 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:36.348654 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.350047 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.351091 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.351545 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.352380 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.353143 11873 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:36.354372 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.355144 11869 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:36.351738 11866 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:36.357134 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.333314 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:36.358254 11948 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:36.359493 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:36.319085 14595 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.366761 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.368116 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:36.367563 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.335326 14679 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:36.334262 14647 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:36.334487 14461 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:36.421139 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.337903 14564 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.416750 11864 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:36.332875 14682 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:36.425926 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 148338us
I20260709 12:10:36.429366 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:36.424239 14564 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.335222 14439 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:10:36.416708 14676 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.329381 14427 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.461519 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:36.444521 14654 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:36.462666 11940 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:36.466524 14571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.020s	sys 0.022s
I20260709 12:10:36.425899 14595 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:36.359360 14597 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.470140 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:36.480028 14702 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.480157 11940 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.480890 14702 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:36.333313 14624 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.469096 14676 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:36.484915 14571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.021s	sys 0.022s
I20260709 12:10:36.478523 14559 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.510617 14679 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:36.515569 14695 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:10:36.540927 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:36.510735 14699 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:36.567121 14693 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:10:36.481410 14702 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.524130 14461 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.569311 12603 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:36.602999 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 251137us
I20260709 12:10:36.583685 14595 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.606086 14625 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:36.575132 14461 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:10:36.613504 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.613437 14564 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.572446 14699 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.614135 14676 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:36.771669 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.893817 11942 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.710644 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.892933 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 422803us
I20260709 12:10:36.783481 14702 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:36.618311 14499 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.814307 14587 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
W20260709 12:10:36.780651 14590 consensus_meta.cc:287] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
W20260709 12:10:36.825248 14541 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 12:10:36.614172 14461 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.814459 14495 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.752800 14571 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.830909 14577 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.736304 14439 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.710048 14509 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.735960 14452 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.749848 14628 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.781325 14564 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:36.658295 14684 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:36.871838 14567 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.923856 14597 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:36.937815 14680 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
W20260709 12:10:36.927901 14527 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.005s
I20260709 12:10:36.656633 14514 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.754292 14674 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.945454 14689 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.944752 14658 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.949036 14624 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.932327 14499 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.945447 14590 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.936471 14587 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.989694 14684 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:36.991832 14689 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:36.975438 14628 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.000360 14658 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.019871 14684 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.020799 14699 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.023427 14689 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.024312 14689 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.809202 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.064234 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 445107us
I20260709 12:10:37.068212 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:37.069877 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.087759 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.091809 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.097470 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.098467 11768 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 6, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.105089 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.108096 11941 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:37.117925 11944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.020s	sys 0.034s
W20260709 12:10:37.118563 11944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.020s	sys 0.035s
I20260709 12:10:37.116142 11768 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 4 to 6, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:37.123793 11946 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:37.146777 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.147751 12013 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.161806 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:37.164114 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.165989 14587 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.167043 14587 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.167917 14587 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.005906 14567 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:36.967233 14509 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.975158 14564 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.173023 14509 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.173949 14682 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.174917 14682 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.175498 12019 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.178078 14677 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:37.179155 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.179981 14658 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.989467 14527 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.183564 14527 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:36.969702 14452 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.180976 14684 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.178870 14677 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.184561 11942 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.193871 12013 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:36.966842 14577 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:36.964423 14571 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:37.198378 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 130644us
I20260709 12:10:36.935429 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.023038 14674 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:36.957762 14495 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.260079 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.268652 14564 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.269377 14564 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.270169 14564 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.270953 12610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:10:37.272145 12610 raft_consensus.cc:606] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:37.275454 14500 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.276520 14500 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.280692 14499 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.285030 14577 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.286157 12603 raft_consensus.cc:2393] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:37.286410 14684 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.288767 14514 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.291303 14571 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.292330 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.293262 12610 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:37.295090 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.248706 14527 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.301558 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:36.966295 14439 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.308522 14577 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:10:37.309422 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 164017us
I20260709 12:10:37.309494 14577 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.310451 14495 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.312057 14587 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.288805 14684 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.312335 14577 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.263438 14682 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.315232 12610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:10:37.315743 14628 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.315972 12610 raft_consensus.cc:606] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:37.316459 12610 raft_consensus.cc:614] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.316504 14628 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.305514 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46685.4us
I20260709 12:10:37.299998 14564 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.300791 14527 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.326368 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.309351 14439 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.322432 14452 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:37.329852 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.306483 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:37.325275 14527 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.344375 14500 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.336374 14495 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.317276 14628 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.350731 12013 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:37.353827 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.349134 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.348320 14495 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.374899 14495 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:37.379449 14718 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
I20260709 12:10:37.380290 14461 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.346410 14500 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.393028 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.369517 14577 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:37.394804 14590 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.401237 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.402447 14677 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.402578 14577 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.406253 12014 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.405262 14577 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.406370 14461 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.409104 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:37.417680 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.433705 12610 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:37.432982 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.446038 14677 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.446988 14677 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.450021 14682 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.451032 14682 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.453725 14452 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.453935 14628 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.454761 14577 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:37.455278 14577 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.455713 14577 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:37.455725 11946 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:37.423020 14500 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.424576 14722 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.461894 14452 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.468705 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:37.464615 14677 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.475989 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.474833 11872 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.468742 14435 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.469594 14452 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.486799 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.490614 14646 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.489096 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.475495 14682 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.496392 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.497675 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.498518 11868 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:37.485006 14435 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:37.504124 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 114866us
I20260709 12:10:37.506554 14723 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:37.507736 14682 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.507567 14723 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.508437 14682 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.509899 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.510753 14682 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:37.515407 14713 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.003s
I20260709 12:10:37.522442 11768 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 2 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:37.523967 14710 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.241s	user 0.003s	sys 0.000s
I20260709 12:10:37.525224 11945 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:37.525707 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1573) took 1172 ms. Trace:
I20260709 12:10:37.526307 11944 rpcz_store.cc:276] 0709 12:10:36.353722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.353989 (+   267us) service_pool.cc:224] Handling call
0709 12:10:36.365809 (+ 11820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.531073 (+165264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.531117 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.531728 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.005394 (+473666us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4800190158. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:10:37.119366 (+113972us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.119507 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.119650 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.523020 (+403370us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:37.525275 (+  2255us) raft_consensus.cc:1685] finished
0709 12:10:37.525295 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.525577 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102063,"raft.run_cpu_time_us":5275,"raft.run_wall_time_us":537352,"spinlock_wait_cycles":97250432,"thread_start_us":698207,"threads_started":2,"wal-append.queue_time_us":716380}
W20260709 12:10:37.528244 14721 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:10:37.535184 12014 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:37.535413 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.536747 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.538282 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.538484 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.541266 11942 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.546572 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.546880 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.547474 12019 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.546572 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1567) took 1191 ms. Trace:
I20260709 12:10:37.550128 11947 rpcz_store.cc:276] 0709 12:10:36.347742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.360732 (+ 12990us) service_pool.cc:224] Handling call
0709 12:10:36.361064 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.474206 (+113142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.474242 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.474791 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.132278 (+657487us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18003d4f80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:37.226589 (+ 94311us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.226676 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.226821 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.531288 (+304467us) raft_consensus.cc:1685] finished
0709 12:10:37.531312 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.539177 (+  7865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1480,"raft.queue_time_us":95307,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":15098,"spinlock_wait_cycles":6266624,"thread_start_us":206411,"threads_started":2,"wal-append.queue_time_us":912186}
I20260709 12:10:37.551528 14500 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.550127 14682 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:37.553442 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.544966 11942 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:37.555974 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.557578 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.558619 14715 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.559490 14715 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.561434 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.491379 14646 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.564880 11943 raft_consensus.cc:1813] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:37.565871 11946 raft_consensus.cc:2393] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:37.567519 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.564208 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:37.568733 11943 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:37.494858 14722 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.570798 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.574688 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:37.576056 12016 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:37.577865 14689 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.007s
I20260709 12:10:37.579388 14682 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.580117 14682 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.580665 14682 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.579298 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.584534 12021 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:37.586155 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.587026 11941 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:37.587333 14677 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.588104 14677 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.588996 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.589744 12022 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:37.590610 14435 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.590639 14677 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.592562 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.593271 14646 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.595746 11947 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:37.596233 11947 raft_consensus.cc:614] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.590766 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.600441 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:37.600755 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.601289 11946 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:37.601925 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.602488 14689 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.603134 14689 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.598986 12020 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:37.575280 14723 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.615129 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.609985 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.624696 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.626166 11872 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:37.611790 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.622134 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.630165 11865 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:37.632822 12022 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:37.617429 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.634474 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:37.634935 14717 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:37.635775 14717 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.638108 14500 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.570887 11942 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.639235 11940 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:37.639014 14500 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.633895 14435 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.644634 14717 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.615549 14715 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.647046 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.647886 12610 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:37.649312 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:37.605518 14689 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:37.651073 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 80959.9us
I20260709 12:10:37.651073 11942 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.652925 14500 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.653584 14500 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.654002 14500 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:37.654438 14500 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.654937 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:37.665385 14646 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.655450 14683 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:37.665925 14646 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.666445 14646 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.666852 14683 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.667404 14683 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:37.668552 14683 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.641379 14722 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.657064 14527 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.669873 14683 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.671814 14527 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.658304 11946 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:37.656670 14624 consensus_meta.cc:287] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.003s
I20260709 12:10:37.657851 14435 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.675529 14435 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.656072 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.658614 11768 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 4, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:37.681350 12019 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:37.665954 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:37.689376 11942 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.692497 14624 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.692981 11946 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.693158 14624 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.695811 14624 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:37.644042 14597 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.001s
I20260709 12:10:37.697999 12016 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:37.677161 14646 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.703974 12013 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:37.654184 14577 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.688750 12603 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:37.723058 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:37.719611 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:37.723994 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 100479us
I20260709 12:10:37.725911 12610 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:37.727203 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.718464 14597 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.728894 11946 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:37.731381 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.741250 11872 raft_consensus.cc:2410] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:37.731453 14715 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.732378 11768 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 1 to 3, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 3 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.742590 14715 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.743615 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.744365 12610 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:37.745893 14646 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.747601 14715 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:37.749701 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 83862.7us
I20260709 12:10:37.738934 14495 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.750643 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:37.750654 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.752131 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:37.729960 14597 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.753041 14677 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.753348 14597 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.753552 14677 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:37.754133 14677 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.757616 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:37.758571 14717 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.758962 14717 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.758988 14646 raft_consensus.cc:2764] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:10:37.759888 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.730677 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.759471 14717 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.765707 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.766527 11946 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:37.771818 14495 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.773265 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:37.781643 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.783569 12610 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:37.789276 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.759989 14682 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.798480 14723 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.799185 14715 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:37.799431 14723 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.799871 14715 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.798667 14711 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.803992 14711 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.807148 14723 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.825366 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.829485 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.830644 11940 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:37.833858 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.838050 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.838994 11940 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:37.838860 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.839566 11941 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:37.841179 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.841054 12603 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:37.842600 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.842718 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:37.843385 12611 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:37.844086 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.844408 14495 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.844734 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.845117 14495 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:37.845775 12607 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:37.843398 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.846381 14495 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.847244 12609 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:37.848186 14723 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:37.848879 14723 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.849270 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:37.844907 12606 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:37.849936 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.850661 11946 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:37.851095 14723 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.849944 11941 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:37.852310 11941 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.814119 14646 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.857888 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.813833 14577 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.807260 14711 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:37.794829 14500 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.870538 14723 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.874337 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:37.874750 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.875492 14435 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.875896 14435 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.875983 12602 raft_consensus.cc:1813] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:37.876332 14435 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.876796 12602 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:37.874166 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.866289 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:37.871837 14715 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.872053 14577 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:37.872577 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:37.881163 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:37.884305 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.882257 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:37.889644 11947 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 3: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:37.892161 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:37.893170 14624 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.893714 14624 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.894160 14624 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.900130 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:37.902122 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.902854 14717 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.903447 11870 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:37.903694 14723 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:37.904803 11865 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:37.906810 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:37.918390 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:37.919963 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.870694 14646 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.927307 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.928246 11870 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:37.929966 14597 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.932663 14597 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.934301 14682 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.925057 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.935092 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:37.938510 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.941491 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.941653 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.935523 11868 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:37.945628 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.887509 14577 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.948812 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:37.954770 12022 raft_consensus.cc:2410] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:37.950238 11941 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:37.954341 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.960961 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:37.965248 11944 raft_consensus.cc:2410] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:37.967757 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.947229 14682 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.972319 11943 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:37.977999 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:37.979238 12019 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:37.982976 11942 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:37.981560 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:37.985390 12602 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:37.985522 14732 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:37.986233 14732 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:37.987150 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:37.988145 14715 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.988559 14715 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.988770 14732 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:37.988958 14715 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.997390 14500 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.998276 11868 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:38.002233 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:38.003036 12602 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.980213 14723 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:37.991816 14682 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.006729 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:37.981707 14680 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.982152 14597 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:38.021175 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 49600.6us
I20260709 12:10:37.992797 14732 raft_consensus.cc:2764] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:38.044916 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.995016 14717 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:38.048816 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.032260 11986 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:38.059428 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:10:38.069072 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92302.2us
I20260709 12:10:38.071406 11868 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:38.065636 14682 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.078156 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.043268 14597 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.083375 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:38.090862 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:38.073028 14684 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.092365 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:38.093411 11870 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:38.103891 11868 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:38.107041 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47737.3us
I20260709 12:10:38.091189 14689 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.119251 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:38.120693 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.097894 14732 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.123252 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:38.128549 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.086599 14624 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.099500 14684 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:38.137989 11870 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:38.106608 14646 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.140071 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.125130 14732 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:38.130503 14577 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:38.155958 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 46501.1us
I20260709 12:10:38.156956 11986 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:38.143285 14684 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.148869 14738 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.166814 14736 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.167407 14646 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.167904 14577 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.168263 14741 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.156212 14689 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.159319 14732 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.149315 14677 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.176190 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.177646 12022 raft_consensus.cc:2410] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 12:10:38.176733 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53558.8us
I20260709 12:10:38.182101 14743 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.182786 14743 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.187027 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.187861 11872 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:38.188980 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.189919 11871 raft_consensus.cc:2368] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:38.189728 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.190088 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.190560 11870 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:38.189157 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.192108 11869 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:38.174127 14738 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.194512 11872 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.196200 14738 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.197403 14747 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.197607 14745 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.197939 14747 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.198052 14745 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.198458 14745 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.200004 14677 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.142613 14731 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 12:10:38.197453 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.204124 12022 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.174911 14741 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.198390 14747 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.219307 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:38.220904 11872 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:38.223580 12016 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:38.226461 14737 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:10:38.228135 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.229223 11864 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:38.229760 14680 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:38.230319 14680 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.230758 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.175029 14646 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.232658 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.233686 11867 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:38.234767 14646 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.238303 14624 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.175809 14577 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.206151 14744 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.242458 14744 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.242818 14744 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.243355 14577 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.175426 14736 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.242870 14435 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.253665 14736 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.254987 14743 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:38.258224 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.233520 14715 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.263954 14715 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.264477 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.265275 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.265949 12018 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:38.266490 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:38.267009 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.267674 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:38.267731 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.268631 12015 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:38.209436 14741 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.270327 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.270484 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:38.271028 12017 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:10:38.225553 14735 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:38.272447 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:38.273833 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:38.277292 11868 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:38.278920 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.279835 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:38.282439 12610 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:38.284591 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.267170 11866 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.284600 14495 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:38.287073 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.288722 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.288475 14747 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.289368 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.260931 14597 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.263676 12602 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:38.290956 12016 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:38.291147 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.294445 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.291851 14435 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.273908 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:38.462646 12607 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.396201 12022 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:38.397554 14683 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.405941 12021 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:38.408136 12016 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:10:38.408275 14745 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.464159 12016 pending_rounds.cc:85] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 3
W20260709 12:10:38.425210 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.452546 14680 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.455906 11865 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:38.291143 14684 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.294489 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:38.430433 12015 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:38.474504 14683 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:38.479749 12013 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:38.480029 14683 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.477505 12017 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:38.477674 14715 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.481153 14715 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:38.482354 14715 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.464514 12016 pending_rounds.cc:107] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:10:38.483906 12016 raft_consensus.cc:2889] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:38.485694 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.477494 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 183083us
I20260709 12:10:38.511639 12607 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:38.580768 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:38.585745 14495 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.587654 14495 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:38.588967 14495 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.452908 14744 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:38.599567 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 419965us
I20260709 12:10:38.600598 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:38.628021 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.639113 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.662954 14597 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:38.663947 14597 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.665645 14732 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.667644 14744 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.689754 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:38.690809 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 90325.5us
I20260709 12:10:38.690927 14689 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.691570 14689 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:38.692737 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:38.692566 14689 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.693262 11942 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.699023 11942 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:38.704612 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:38.705288 11946 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:38.708294 11839 leader_election.cc:336] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.510s (SENT)
I20260709 12:10:38.708947 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:38.719534 11866 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:38.721125 14747 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.728441 11946 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:38.746877 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:38.748500 11946 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.756536 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.733068 14717 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:38.761494 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53277.5us
I20260709 12:10:38.760195 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.762784 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.763101 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.764693 11947 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:38.717206 14741 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.738727 14683 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:38.781400 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.782063 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.789923 14597 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.793061 14683 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:38.798977 14683 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.800441 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:38.801656 12610 raft_consensus.cc:2368] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:38.801899 14680 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.812004 11946 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:38.835469 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.836289 12017 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.837085 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.856422 12014 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.840806 14741 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:38.845749 11912 leader_election.cc:400] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:38.871286 11912 leader_election.cc:403] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.847412 14435 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.852850 14732 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.878461 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.875984 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:38.881513 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 77771.6us
I20260709 12:10:38.873188 11870 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:10:38.887086 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 105886us
I20260709 12:10:38.889091 12017 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:38.891703 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:38.892582 11943 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:38.896749 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.897650 12016 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:38.897716 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.898679 12021 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:38.898698 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.896842 14741 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.902360 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.920655 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.921798 12022 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
W20260709 12:10:38.921015 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45151.4us
I20260709 12:10:38.922734 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:38.888068 14754 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:10:38.926329 11946 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:38.926842 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.927686 11942 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:38.926345 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:38.929117 11839 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.602s (SENT)
I20260709 12:10:38.933256 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.933781 12607 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:38.934243 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:38.900079 14683 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:10:38.937318 11839 leader_election.cc:336] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.616s (SENT)
I20260709 12:10:38.937911 14744 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.938534 14495 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.937352 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:38.972455 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:38.972803 12021 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.880471 14435 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:38.944353 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.948731 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:38.950083 14684 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:38.951977 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:38.952199 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:38.985558 11943 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:38.986194 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.967309 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:38.971625 12014 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:38.943332 14620 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.905560 14741 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:38.975908 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 187517us
I20260709 12:10:38.981953 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.991321 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:38.992746 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.966135 14744 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:39.001228 11942 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:38.995803 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:39.003396 11946 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:38.995617 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.021945 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.021955 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:38.974840 14715 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.989481 14745 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:39.021456 12602 raft_consensus.cc:2368] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:39.032733 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:38.996091 14624 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.038461 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.004832 14744 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.039230 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 102000us
I20260709 12:10:38.997114 14741 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.058223 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.029839 14757 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.062163 11943 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.067601 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:39.062301 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66595.3us
I20260709 12:10:39.073310 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.074142 11947 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:39.044039 14624 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:39.003356 14620 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.078734 14435 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:39.079048 14768 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:39.095134 14768 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.072800 14757 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:39.096338 14620 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:39.097323 14757 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:39.098248 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.080237 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.081487 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.100059 14683 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:39.079474 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:39.086091 14753 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:10:39.100965 11943 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.089727 11839 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.635s (SENT)
I20260709 12:10:39.095063 14624 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.086004 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.102499 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:39.104107 14745 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.123404 14745 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.123889 14745 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:39.105743 14684 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:39.107018 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:39.126176 12016 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:39.126157 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.127004 11941 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:39.127511 11986 leader_election.cc:400] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:39.107601 14751 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.127838 11986 leader_election.cc:403] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.127604 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.126173 14684 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.130987 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.116923 12610 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:39.133147 14435 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.134434 12602 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.135921 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:39.136301 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:39.137176 12606 raft_consensus.cc:2368] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:39.108956 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.109692 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.138612 12017 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.138621 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:39.139366 12606 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.111642 12021 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:39.141382 14751 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:39.141932 14768 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:39.142285 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:39.146648 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57012.1us
I20260709 12:10:39.131101 14684 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:39.147397 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.148001 12606 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:39.148157 14684 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.149677 14684 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.150939 11912 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.152338 14724 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.152768 14724 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.153084 14724 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.153834 14717 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.145515 12602 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:39.155309 11986 leader_election.cc:400] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:39.155743 11986 leader_election.cc:403] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.157220 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:39.147418 11839 leader_election.cc:336] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.666s (SENT)
I20260709 12:10:39.158752 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:39.116466 11942 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.163199 11946 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:39.107702 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:39.169690 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.174266 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.175078 11945 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:39.170946 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.177201 11947 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:39.124848 14745 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.192073 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.195402 11944 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.198199 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.199055 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.199237 12017 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:39.196698 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.168594 14435 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:39.202519 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.203158 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:39.203015 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47104.4us
I20260709 12:10:39.206126 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:39.204783 11941 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:39.164101 14717 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:39.194005 14715 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.209869 11940 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:39.215306 12021 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:39.215847 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:39.216145 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:39.216071 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.190292 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:39.217710 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.221949 11866 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:39.222270 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:39.217875 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.223580 11944 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:39.204034 14769 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.168824 14751 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:39.202394 14747 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:39.225927 11872 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.226117 11942 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:39.222119 12017 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:39.196244 14732 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:39.232368 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:39.246565 11867 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:39.230581 14769 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.246763 12016 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:39.247293 14769 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.248531 12018 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:39.250803 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:39.253875 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.254797 11948 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.256016 12019 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:39.265728 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 118348us
I20260709 12:10:39.269820 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:39.270613 12021 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:39.273715 11872 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:39.269239 14680 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.277473 14680 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:39.277354 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.278589 14680 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:39.282253 11839 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.668s (SENT)
I20260709 12:10:39.282783 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:39.283628 14715 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.284549 12014 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:39.285661 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:39.286486 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:39.287124 11870 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:39.287854 11839 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.767s (SENT)
I20260709 12:10:39.287993 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:39.288335 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:39.290561 14684 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.292851 14684 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:39.298974 11943 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:39.294252 14715 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.298135 14769 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.291853 14597 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.299829 14684 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.302783 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:39.327471 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 121432us
I20260709 12:10:39.329386 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:39.333803 12021 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 3.
I20260709 12:10:39.338002 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:39.338076 14495 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:39.303545 14751 raft_consensus.cc:2764] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:39.339516 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:39.320139 14597 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:39.338876 14689 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.318390 14435 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.365154 14769 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:39.365964 14745 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.377580 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.377791 14760 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:39.378374 11948 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.378922 14760 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:39.379451 14760 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.380506 14760 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.393355 12610 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
W20260709 12:10:39.397323 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.399096 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:39.373430 14689 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:10:39.402145 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 63542.1us
I20260709 12:10:39.361395 14763 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:10:39.404546 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 296906us
I20260709 12:10:39.420750 14744 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.402781 14597 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.413648 14760 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:39.434490 12606 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:39.434945 14715 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.435500 14715 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.435551 14744 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:39.436522 14715 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.436975 11988 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:39.439301 14776 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.422937 14689 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.403187 14751 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:39.442754 14751 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:39.443475 14717 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.443938 14715 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.443804 14751 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.443998 14717 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.446501 14597 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.446621 14717 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.448091 14717 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.412056 14741 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:39.428815 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.451395 14741 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:39.451810 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.452862 14768 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.454206 14768 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.454663 14768 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:39.455662 12606 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.455494 14768 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.456738 14768 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.457804 14620 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.459575 14683 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.460037 14683 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:39.461144 14683 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.473810 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.475142 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.476801 14747 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:39.476961 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.477451 14747 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.478588 14747 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.492619 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.496721 11939 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:39.503234 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:39.508530 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.514437 11948 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:39.521848 12603 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:39.522243 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45877.4us
W20260709 12:10:39.526634 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115211us
I20260709 12:10:39.521704 14732 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:39.524497 14683 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.524729 14774 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.533949 14774 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.534315 14774 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.536849 14779 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:39.547124 14724 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.554976 11943 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
W20260709 12:10:39.557845 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.559303 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.562279 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.567641 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.568897 11948 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.572141 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:39.575073 12603 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.551082 14732 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.577822 11940 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:39.578477 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.579748 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.591301 11945 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:39.580571 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.561378 14741 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:10:39.581027 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.581343 14782 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:39.557399 14724 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:39.558688 14779 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:39.560807 11769 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 6, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:39.581979 14689 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:39.607928 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.608175 11939 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.595997 12603 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:39.601761 11942 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:39.573477 14435 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.609261 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.576406 14715 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:10:39.608248 11769 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:39.658334 11948 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:39.762282 12610 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:39.598618 14732 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:39.850255 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 194314us
W20260709 12:10:39.777586 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.702822 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.674209 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.785256 11912 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:39.775840 14763 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.861465 14779 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:39.862272 14763 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.863526 14763 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.852543 11769 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 1 to 2, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:39.761247 14776 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.768663 14684 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.869444 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.870251 11946 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:39.870170 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 85034.8us
I20260709 12:10:39.872766 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.877362 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.878153 11946 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:39.659056 14689 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:39.880666 11943 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.879319 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:39.859257 11988 connection.cc:256] RPC call timeout handler was delayed by -1.6365143079999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:10:39.870563 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 4 to 7, term changed from 5 to 6, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to <none>, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 6 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:39.883833 11988 connection.cc:256] RPC call timeout handler was delayed by -1.5456143080000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 12:10:39.885200 11988 connection.cc:256] RPC call timeout handler was delayed by -1.4637143079999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 12:10:39.879608 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.886384 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.887215 11943 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.888579 14689 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.889751 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.889941 14628 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:39.893187 11948 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:39.890828 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.892151 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:39.898335 11946 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.895222 14781 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.901110 14781 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.902182 14781 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.903496 14781 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:39.903967 14745 consensus_meta.cc:287] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.005s
I20260709 12:10:39.905194 12016 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:10:39.894279 11769 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 6, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:39.905664 12016 pending_rounds.cc:85] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 7
I20260709 12:10:39.906047 12016 pending_rounds.cc:107] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:10:39.906353 12016 raft_consensus.cc:2889] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.906275 11769 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:39.895056 11943 raft_consensus.cc:2368] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:39.875388 14768 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.912750 14768 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:39.913928 14768 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.893584 11942 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:39.895701 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:39.864503 14747 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.918529 11944 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:39.919484 14747 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:39.880496 14786 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:39.923372 12018 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:39.924696 14786 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.881239 14763 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.927224 14786 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:39.928570 11768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 191) took 11997 ms (client timeout 15000 ms). Trace:
I20260709 12:10:39.876155 14684 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.933491 11948 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:39.934816 14684 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:39.937242 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54124.4us
W20260709 12:10:39.937676 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.941856 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62960.8us
I20260709 12:10:39.683734 14774 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:39.929031 11768 rpcz_store.cc:269] 0709 12:10:27.930701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.931008 (+   307us) service_pool.cc:224] Handling call
0709 12:10:39.928462 (+11997454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.097977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.219322 (+121345us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.219383 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:38.219418 (+    35us) tablet.cc:662] Decoding operations
0709 12:10:38.220269 (+   851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.220344 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.220370 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:38.221053 (+   683us) tablet.cc:701] Row locks acquired
0709 12:10:38.221104 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:38.221287 (+   183us) write_op.cc:270] Start()
0709 12:10:38.221436 (+   149us) write_op.cc:276] Timestamp: P: 1783599038221217 usec, L: 0
0709 12:10:38.221456 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.222242 (+   786us) log.cc:844] Serialized 2094 byte log entry
0709 12:10:39.101170 (+878928us) op_driver.cc:464] REPLICATION: finished
0709 12:10:39.352417 (+251247us) write_op.cc:301] APPLY: starting
0709 12:10:39.359611 (+  7194us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:39.359841 (+   230us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:39.360006 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:39.361957 (+  1951us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:39.362324 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:39.362370 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:39.362792 (+   422us) log.cc:844] Serialized 47 byte log entry
0709 12:10:39.362994 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.363138 (+   144us) write_op.cc:454] Released schema lock
0709 12:10:39.363226 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:39.363699 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.363728 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":212,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":208700,"apply.run_cpu_time_us":3587,"apply.run_wall_time_us":35059,"num_ops":5,"prepare.queue_time_us":228307,"prepare.run_cpu_time_us":29451,"prepare.run_wall_time_us":400085,"raft.queue_time_us":233007,"raft.run_cpu_time_us":43636,"raft.run_wall_time_us":138430,"replication_time_us":879526,"thread_start_us":604939,"threads_started":4,"wal-append.queue_time_us":580843}]]}
I20260709 12:10:39.949339 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:39.871592 14435 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:10:39.936460 14780 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.265s	user 0.004s	sys 0.000s
I20260709 12:10:39.944375 14786 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.956030 14786 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.958587 14786 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:39.958729 14724 raft_consensus.cc:2764] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:39.961129 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:39.952901 14717 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:39.961892 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:39.962455 14717 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.963356 14620 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.964905 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:39.965230 14717 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:39.966341 14717 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:39.968016 14717 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.964780 14435 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:39.971246 14774 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:39.977299 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.011191 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.026093 12607 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.028805 12016 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:40.029930 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:40.031330 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.032972 11946 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:40.041467 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.046456 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 73688.6us
I20260709 12:10:40.037010 14774 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.054121 14774 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:40.054682 14774 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.054752 14757 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:40.046103 14781 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:40.066288 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 122568us
I20260709 12:10:40.073338 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:40.052098 14786 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.063457 14732 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.085726 14732 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:40.094198 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:40.096071 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:40.098814 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 143644us
I20260709 12:10:40.100952 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.081342 14786 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.077821 14680 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:40.082450 14769 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:40.115099 14620 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.109328 14724 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.115767 14732 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.114531 14786 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.157912 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.187122 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:40.187808 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 90766.1us
W20260709 12:10:40.186523 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 124262us
I20260709 12:10:40.189093 11914 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:40.189636 11914 leader_election.cc:403] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:40.189162 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.196040 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "005405ff7b534db6b4c6be122c445915"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:10:40.196974 12603 raft_consensus.cc:606] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.180088 14724 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:40.204206 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.205212 11948 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:40.203264 14624 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:40.196600 14620 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:40.223069 11943 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:40.217698 11940 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.233393 12016 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.210729 14781 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.236111 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:40.236284 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56757.3us
I20260709 12:10:40.219434 14684 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.240206 12018 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:40.204416 14732 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:40.243597 11944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4755afb6a253477badd7f673bff77faa"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:40.245340 11944 raft_consensus.cc:606] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:40.246655 11944 raft_consensus.cc:614] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:40.235167 14745 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.247331 11941 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:40.249720 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60823.3us
W20260709 12:10:40.253759 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.232185 14744 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:40.243441 14684 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:40.256692 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:40.261279 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.251434 14776 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.268712 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.262540 14684 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.259440 14807 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6.
I20260709 12:10:40.256256 14751 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:10:40.254256 14745 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.269348 14776 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:40.294034 11944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:40.302923 11944 raft_consensus.cc:606] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.303329 11944 raft_consensus.cc:614] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:40.299926 14799 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:10:40.301585 14806 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:40.277366 14781 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.308678 14779 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:40.313804 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.259862 14724 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.275578 14620 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.306492 14776 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.330346 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.321000 14779 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.329947 14806 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:40.347568 14779 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.363117 14745 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:40.363489 14805 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:40.328033 14683 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:40.341951 14768 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:40.357456 14781 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.244158 14801 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:10:40.308424 14811 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:10:40.278245 14809 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 12:10:40.249069 14749 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.151s
W20260709 12:10:40.409523 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79273.5us
I20260709 12:10:40.413221 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:40.436492 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.472843 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.476212 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50754.9us
I20260709 12:10:40.478420 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:40.475855 14809 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.496958 14809 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:40.498672 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.500341 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:10:40.501024 12603 raft_consensus.cc:606] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.495177 14784 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.503051 14784 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:40.372900 14810 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:10:40.516675 14683 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.504738 14806 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.498723 14809 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:40.614753 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 136416us
I20260709 12:10:40.632731 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:40.619814 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 351164us
I20260709 12:10:40.636236 11988 leader_election.cc:400] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
W20260709 12:10:40.636341 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.637457 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:40.627255 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 311818us
W20260709 12:10:40.642390 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.573179 14774 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.005s
I20260709 12:10:40.643649 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.597414 14807 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:40.648479 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.613607 14747 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:40.536957 14745 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.553320 14776 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.646628 14715 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.555095 14784 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:40.652729 14751 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:40.659111 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.667198 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.670038 12603 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:40.667105 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 184069us
I20260709 12:10:40.647650 14816 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:40.674273 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.660221 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.594333 14786 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.650913 14807 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:40.682686 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.668308 14745 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.656665 14747 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:40.686821 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:40.689894 11941 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:40.690448 11941 raft_consensus.cc:630] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Rejecting request to transfer leadership because tablet server 46f08e8ff3774f25acad18252e5cd57d is not a voter in the active config
I20260709 12:10:40.666704 14763 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.671305 14768 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.692525 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:40.652180 14774 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.693774 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:40.696812 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.701938 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53555.8us
I20260709 12:10:40.704622 11944 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.706213 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:40.693630 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.710595 12014 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:40.667024 14818 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.708974 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:40.706211 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:40.715428 11945 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.711899 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:40.710958 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.839s (SENT) [suppressed 17 similar messages]
I20260709 12:10:40.675563 14715 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.701635 14814 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.703711 14811 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:40.721719 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54596us
W20260709 12:10:40.725329 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 43528.5us
I20260709 12:10:40.711548 14732 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.731432 12606 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:40.731719 14732 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:40.732674 14732 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:40.738284 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.713868 14818 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:40.686208 14779 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.709179 14684 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.730767 14811 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.763350 11945 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:40.767454 12603 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.806308 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:40.816581 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:40.740923 14749 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:40.818676 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:40.757220 14818 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.815872 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 104936us
I20260709 12:10:40.765471 14811 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.774711 14732 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.750586 14435 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:10:40.746358 14724 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:10:40.845126 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 119594us
I20260709 12:10:40.846258 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.836732 14814 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:40.731729 14747 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:40.828593 14495 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.857200 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.857023 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:40.862052 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:40.803208 14782 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:40.866144 14620 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.867035 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.868224 14620 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.869298 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.870644 14620 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:40.872192 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 117037us
I20260709 12:10:40.871006 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:40.875445 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 99995.9us
W20260709 12:10:40.877372 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.916895 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54935.1us
I20260709 12:10:40.864488 14683 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:40.923553 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52642.4us
W20260709 12:10:40.926102 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.985697 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.965353 14802 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.986424 14802 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:40.927407 14803 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:10:40.871371 14816 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:40.961846 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.922833 14817 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.858107 14807 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:40.926250 14751 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.919826 14806 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:40.940225 14825 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:10:40.930784 14786 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:40.939268 14823 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.978758 14779 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:41.009284 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.979640 14774 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:40.982115 11988 leader_election.cc:400] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5.
I20260709 12:10:40.983155 14745 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:40.986727 14782 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.985620 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:40.921810 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.011871 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.013695 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:40.988214 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 247626us
W20260709 12:10:40.979147 14828 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:10:41.017405 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 95737.4us
I20260709 12:10:40.981480 14715 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.015997 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:41.019595 14822 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.006868 14751 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:41.020183 14839 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.020946 14807 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:41.021348 14763 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.022387 14814 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.001362 14816 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.049654 14779 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:41.027792 14684 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:41.036116 14776 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:40.991473 14495 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:41.038358 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.023312 14782 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.043308 14838 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.047333 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.045320 14747 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.025740 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:41.032541 14837 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:10:41.056032 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.050349 14816 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.046016 14751 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.045879 14839 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.055286 14809 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.077500 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.092861 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:41.084137 14684 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.084486 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.084846 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.073452 14715 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:41.071869 14776 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.093514 11943 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:41.113104 14804 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.115479 14809 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:41.115829 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 90215.5us
I20260709 12:10:41.116276 11941 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:41.091817 14839 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.091593 14781 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.068377 14838 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.126269 14717 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:41.131160 14715 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.166661 14715 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.132843 11940 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:41.167881 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:41.138296 14830 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 12:10:41.116092 14811 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.144915 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:41.147054 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.067441 14495 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.179991 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:41.156086 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.157660 14814 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.158102 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 109614us
I20260709 12:10:41.148828 14684 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:41.164740 14838 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.169227 14717 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.142077 14745 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:41.172547 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.149839 11943 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:41.191215 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.178095 14803 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.149384 14776 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:41.070942 14802 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.201035 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.213677 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:41.182904 14749 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:10:41.223253 14684 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.218209 14715 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.224314 14850 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.221375 14724 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:41.226075 14831 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.286s	user 0.000s	sys 0.003s
I20260709 12:10:41.214506 14823 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.236034 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:41.237143 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46170.2us
I20260709 12:10:41.199703 14814 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:41.242817 14841 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.243s	user 0.004s	sys 0.000s
I20260709 12:10:41.248688 14846 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:41.234567 14850 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.218164 14745 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:41.270264 14816 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:41.283668 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47694.8us
W20260709 12:10:41.286285 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.295825 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.248342 14717 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:41.301331 14845 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:10:41.267153 14782 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.271104 14850 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.270792 14724 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.271934 14715 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.335632 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.336123 14495 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.282799 14776 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:41.266263 14846 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.337077 14781 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.337682 14717 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.374693 14732 consensus_meta.cc:287] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.005s
I20260709 12:10:41.392354 14717 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:41.394910 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 147627us
W20260709 12:10:41.393394 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55899.4us
W20260709 12:10:41.402458 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.401348 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:41.405784 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 191419us
I20260709 12:10:41.348440 14715 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.408188 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:41.411471 14781 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.413313 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:41.417869 14715 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.426810 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.405249 14814 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:41.411760 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.433130 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.435465 14715 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.435972 14715 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.436070 14843 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:10:41.436514 14715 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.422712 14811 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:41.438000 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:41.431039 14833 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.492s	user 0.006s	sys 0.000s
I20260709 12:10:41.449618 14856 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.451823 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:41.452762 11865 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:41.453802 14717 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.454084 11870 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:41.454902 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:41.453218 14839 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.455580 11871 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.457525 14839 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:41.451906 14856 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.465914 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:41.480044 14856 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.480306 11867 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.484333 14763 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.439019 14861 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.486146 14861 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:41.486529 14861 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.470155 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.505211 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74646.4us
I20260709 12:10:41.507483 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:41.457871 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:41.509196 11873 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.528817 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:41.477180 14818 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.005s
W20260709 12:10:41.530774 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.530218 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.532696 11944 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:41.535115 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 289811us
W20260709 12:10:41.547224 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.555819 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.556830 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.562729 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.563941 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6951584030000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 12:10:41.564420 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6690584030002356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 12:10:41.564951 11839 connection.cc:256] RPC call timeout handler was delayed by -2.5259584030002316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 12:10:41.565212 11839 connection.cc:256] RPC call timeout handler was delayed by -2.3810584030002246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:10:41.565629 11839 connection.cc:256] RPC call timeout handler was delayed by -2.12635840300004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 12:10:41.565999 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8940010250000796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:10:41.566284 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8175010249999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:10:41.566550 11839 connection.cc:256] RPC call timeout handler was delayed by -1.771758403000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2641s for a response
W20260709 12:10:41.566911 11839 connection.cc:256] RPC call timeout handler was delayed by -1.7131010250000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 12:10:41.567289 11839 connection.cc:256] RPC call timeout handler was delayed by -1.7131010250000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 12:10:41.567597 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.567638 11839 connection.cc:256] RPC call timeout handler was delayed by -1.6933010249999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:10:41.568545 11839 connection.cc:256] RPC call timeout handler was delayed by -1.65460102499992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:10:41.568951 11839 connection.cc:256] RPC call timeout handler was delayed by -1.6537010249999184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:10:41.569231 11839 connection.cc:256] RPC call timeout handler was delayed by -1.6492010249999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:10:41.569782 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4953010249998897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:10:41.570222 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4908010250001098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:10:41.570580 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4881010250001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:10:41.570906 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4846584030001395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.296s for a response
W20260709 12:10:41.571280 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4846584030001395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.296s for a response
W20260709 12:10:41.572067 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4512010250000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:10:41.572440 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2982010250000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 12:10:41.547073 14745 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:41.556830 14816 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:41.572786 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2973010250000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 12:10:41.577123 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2586010249999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 12:10:41.578207 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2586010249999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 12:10:41.569478 14838 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:41.584034 14838 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.558962 14763 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:41.578634 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2460010249999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:10:41.540313 14818 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.560506 14769 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:41.592690 11867 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:41.594029 11871 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:41.614665 11868 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:41.614740 11872 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:41.567065 14751 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.575305 14744 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:10:41.617166 14751 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:41.622686 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.603600 14818 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:41.588855 14846 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:41.599200 11873 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
W20260709 12:10:41.591724 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2460010249999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:10:41.606581 14763 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:41.531394 12606 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:41.630033 11944 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
W20260709 12:10:41.631670 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0822010249999039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24080000000000001s for a response
W20260709 12:10:41.647009 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0048010250000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24940000000000004s for a response
I20260709 12:10:41.653395 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:41.654614 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 80892.2us
I20260709 12:10:41.666051 14715 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.668407 14715 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.670595 14763 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:41.671777 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:41.683173 14856 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:41.689774 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 288570us
I20260709 12:10:41.685050 14861 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.690655 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:41.692346 14803 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.692909 14803 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:41.647897 14850 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.693874 14683 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:41.702533 14850 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:41.703685 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 470934us
I20260709 12:10:41.686443 14717 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.692363 14861 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.753175 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:41.758909 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.750499 14856 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:41.758086 14803 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:41.794519 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.795995 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:41.796676 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.811208 11946 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.797351 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:41.812270 11940 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:41.798337 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.799748 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.797308 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.805104 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.813894 12013 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:41.814997 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.815632 12013 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:41.813338 11943 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.815364 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.833174 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.833413 12021 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:41.834986 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 144424us
I20260709 12:10:41.835165 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.836388 12022 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:41.837954 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:41.837149 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.840833 12017 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:41.845278 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.846359 12019 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:41.835817 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:41.848510 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:41.849781 12015 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:41.855008 12018 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:41.855644 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:41.857889 12014 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:41.810375 14717 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.862170 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:41.860641 11946 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:41.864787 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:41.868026 11940 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.870774 11943 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:41.870849 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.848558 14763 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.875063 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:41.875211 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:41.861589 14846 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:41.861403 14856 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.881690 14861 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.924896 14861 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.925375 14861 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.929387 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48512.8us
I20260709 12:10:41.933125 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:41.935141 11839 leader_election.cc:400] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:41.883612 14747 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.950655 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:41.951697 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 79072.4us
I20260709 12:10:41.952996 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:41.945600 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 77976.5us
W20260709 12:10:41.947037 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.885357 14715 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.873348 14717 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:41.965260 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:41.886116 14868 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.947069 14763 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:41.886368 14856 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:42.011432 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46245.9us
W20260709 12:10:42.020604 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51969.1us
I20260709 12:10:42.022120 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:41.894464 14846 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:41.923053 14822 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:10:41.962366 14715 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.963140 14816 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:41.959044 14823 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 12:10:42.026810 14833 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:42.024869 14856 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.042739 14844 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:42.046250 14747 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:42.073989 14747 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.052727 14715 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.075675 14880 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.076663 14880 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.077201 14880 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:42.072191 14846 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:42.074975 14871 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:10:42.079680 14870 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:10:42.059043 14816 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.052297 14763 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.086194 14763 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:42.086905 14763 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.087487 14715 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.046131 14868 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:42.078378 14880 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.090401 14715 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.090512 14868 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.092780 14763 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.102802 14823 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.110585 14856 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.115993 12014 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.116443 14856 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.119778 12018 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.120380 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:42.121165 12015 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:42.122773 12022 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:42.124650 12021 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:10:42.125088 14717 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.126531 12019 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:42.127524 14873 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:42.127895 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:42.130280 14823 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.130870 14823 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.131357 12019 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:42.133042 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.162802 11940 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:42.180707 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.218123 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:42.137907 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.217963 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.219413 11944 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:42.171083 11868 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:10:42.219834 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.135746 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:42.220686 12015 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.134907 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:42.140501 12021 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.191044 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:42.132614 12014 raft_consensus.cc:2410] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:42.202803 12022 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.217900 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:42.213651 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 263061us
I20260709 12:10:42.173700 11871 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:42.223505 11940 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:42.223943 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:42.141315 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:42.226634 11947 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.222954 11869 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:42.229333 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:42.149996 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 130866us
I20260709 12:10:42.230952 11946 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.232834 11946 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:42.233791 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.232825 11873 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:42.234810 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:42.235920 11943 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:42.237805 11940 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:42.238282 11839 leader_election.cc:400] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:42.241020 11866 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:42.241860 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:42.242726 11870 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.245941 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:42.260365 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:42.297392 12019 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:42.297240 11864 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:42.298735 12022 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:42.236213 14850 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.225775 14806 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:42.311398 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51156.9us
I20260709 12:10:42.319608 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:42.314522 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:42.171362 14816 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:42.325362 11864 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.326757 12014 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:42.327025 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:42.316732 12015 raft_consensus.cc:2410] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:42.292425 14856 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.245678 14624 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:42.345292 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:42.381414 11945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.014s
I20260709 12:10:42.313575 14776 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:42.329871 14763 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.334554 14715 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.399062 14802 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.324934 14684 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:42.350080 14881 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:42.377900 11870 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:10:42.377071 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54142.4us
I20260709 12:10:42.350020 14887 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:10:42.382941 11945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.007s	sys 0.014s
I20260709 12:10:42.330207 14850 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:42.396099 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.397560 14776 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.408627 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:42.415086 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:42.416342 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:42.391139 14786 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.421623 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:42.434778 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 145952us
W20260709 12:10:42.446028 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 64630.5us
I20260709 12:10:42.407429 14884 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.420879 14763 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.402189 14861 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.424165 14717 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.466897 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:42.390012 14624 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.435329 14856 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.473229 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1637) took 1060 ms. Trace:
I20260709 12:10:42.424510 14786 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:42.409700 14684 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.454437 14880 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.474691 11941 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:42.476997 11942 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:42.421990 14883 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:42.483928 11867 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:42.467324 14885 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.454010 14884 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:42.475138 14683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49974 (request call id 78) took 2278 ms. Trace:
W20260709 12:10:42.513484 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 91985us
I20260709 12:10:42.471010 14717 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.474236 11948 rpcz_store.cc:276] 0709 12:10:41.412640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.424276 (+ 11636us) service_pool.cc:224] Handling call
0709 12:10:41.432740 (+  8464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.689917 (+257177us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:41.690285 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.023340 (+333055us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.046730 (+ 23390us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.047033 (+   303us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:42.382646 (+335613us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.472932 (+ 90286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.473021 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.473058 (+    37us) raft_consensus.cc:1685] finished
0709 12:10:42.473067 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.473176 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339796,"prepare.queue_time_us":35547,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":400458,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":14140,"thread_start_us":677111,"threads_started":4,"wal-append.queue_time_us":152917}
I20260709 12:10:42.480440 14786 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.523413 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:42.569350 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46031us
I20260709 12:10:42.479658 14880 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:42.473744 14856 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.521075 14885 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.619242 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:42.633301 12019 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.578034 14861 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.580147 14897 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:42.568584 14751 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.571182 14816 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:42.575140 14850 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:42.573918 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 96759.2us
I20260709 12:10:42.507793 14817 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 12:10:42.482262 14887 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 12:10:42.524978 14884 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:42.598351 14889 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:10:42.606518 14890 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:10:42.572557 14717 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.613516 14684 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.585490 14776 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.634294 14885 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.634611 14856 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.737756 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:42.613860 14763 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.568567 14683 rpcz_store.cc:276] 0709 12:10:40.206407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.207508 (+  1101us) service_pool.cc:224] Handling call
0709 12:10:40.263464 (+ 55956us) log.cc:844] Serialized 501 byte log entry
0709 12:10:42.475016 (+2211552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22576,"raft.queue_time_us":52666,"raft.run_cpu_time_us":1903,"raft.run_wall_time_us":115036,"thread_start_us":381977,"threads_started":2,"wal-append.queue_time_us":373526,"wal-append.run_cpu_time_us":2457,"wal-append.run_wall_time_us":1006779}
I20260709 12:10:42.742091 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:42.742456 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:42.749931 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 73694.1us
I20260709 12:10:42.786428 14776 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:42.788628 14776 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.791103 14776 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.783180 14763 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.794781 14763 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.796907 14817 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.751502 14854 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.751120 14880 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.754032 14624 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.758561 14896 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:42.679106 14816 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.762516 12019 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:42.768127 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:42.771737 12607 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:42.782301 14887 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:42.802634 14880 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.802366 14887 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:42.806375 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 90538.3us
I20260709 12:10:42.674389 14751 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.678572 14689 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:42.785595 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 215378us
I20260709 12:10:42.807953 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:42.763429 14898 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:42.813287 12013 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:42.813023 11986 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:42.815026 12014 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:42.823186 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:42.824515 11870 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:42.825891 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:42.836494 12019 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:42.837121 12019 pending_rounds.cc:85] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:10:42.837437 12019 pending_rounds.cc:107] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:42.837780 12019 raft_consensus.cc:2889] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.810998 14776 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.809028 14903 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.835193 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:42.839473 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:42.797947 14817 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.807179 14854 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.820020 14683 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:10:42.811801 14802 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:42.843099 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:42.940886 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 101455us
I20260709 12:10:42.835012 14747 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.814113 14684 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.845942 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:42.924790 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.839s (SENT)
I20260709 12:10:42.941480 11864 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.947554 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:42.870069 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 549) took 1687 ms. Trace:
I20260709 12:10:42.948309 12016 rpcz_store.cc:276] 0709 12:10:41.182449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.192384 (+  9935us) service_pool.cc:224] Handling call
0709 12:10:41.192918 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.352414 (+159496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.352458 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.368188 (+ 15730us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.531880 (+163692us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.531961 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.869607 (+1337646us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b5400046ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:42.869656 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.869703 (+    47us) raft_consensus.cc:1685] finished
0709 12:10:42.869717 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.869981 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122097,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"spinlock_wait_cycles":222564224,"thread_start_us":197860,"threads_started":2,"wal-append.queue_time_us":220133,"wal-append.run_cpu_time_us":2319,"wal-append.run_wall_time_us":1002337}
W20260709 12:10:42.894897 14899 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:42.955250 14786 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.956537 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:42.911849 14776 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.958182 14776 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.959942 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:42.960390 14776 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:42.960703 11867 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:42.960999 14776 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:42.930608 14856 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.967425 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 550) took 1771 ms. Trace:
I20260709 12:10:42.924165 14816 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.946689 14850 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.947322 14751 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.975193 11867 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:42.868220 14887 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.816303 14689 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.949188 14903 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.970384 12020 rpcz_store.cc:276] 0709 12:10:41.195651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.195804 (+   153us) service_pool.cc:224] Handling call
0709 12:10:41.196213 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.547894 (+351681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.547931 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.560383 (+ 12452us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.686673 (+126290us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:41.686741 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.961905 (+1275164us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5400029254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:42.961957 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.962008 (+    51us) raft_consensus.cc:1685] finished
0709 12:10:42.962020 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.967316 (+  5296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77300,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":54944640,"thread_start_us":410680,"threads_started":2,"wal-append.queue_time_us":309066}
I20260709 12:10:42.983944 14763 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.995573 14786 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.996520 14786 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:42.993552 14910 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:42.997484 14763 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.997915 14910 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:42.998965 11870 raft_consensus.cc:2368] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:43.001418 14717 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.002502 14910 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:42.994107 14887 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:42.995206 14903 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.004246 14856 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:42.981132 14850 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.006069 14850 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.006136 11865 raft_consensus.cc:2368] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:43.009104 14817 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.009907 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:42.902786 14884 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:42.894176 14902 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:10:43.012964 11873 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.021497 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.022071 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.024511 11872 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.027177 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.024277 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.028539 11872 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:43.032194 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.033298 11872 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.035177 11867 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:43.038462 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54823us
I20260709 12:10:43.040771 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:43.045611 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 468) took 1346 ms. Trace:
I20260709 12:10:43.050423 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.051075 11867 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.052168 14822 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:43.052749 14689 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.054790 14817 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:43.057408 11988 leader_election.cc:336] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.549s (SENT)
I20260709 12:10:43.058970 14717 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.062052 14884 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.062301 14854 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:43.067684 11864 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.069638 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:43.070376 12015 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.046752 11939 rpcz_store.cc:276] 0709 12:10:41.699052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.700254 (+  1202us) service_pool.cc:224] Handling call
0709 12:10:41.820716 (+120462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.856453 (+ 35737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.856489 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.857089 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.985905 (+1128816us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b1800237100. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:43.030099 (+ 44194us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.030146 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.030217 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.044524 (+ 14307us) raft_consensus.cc:1685] finished
0709 12:10:43.044559 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.044947 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94986,"raft.queue_time_us":56947,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2264,"spinlock_wait_cycles":8489728,"thread_start_us":43949,"threads_started":1,"wal-append.queue_time_us":1168088}
I20260709 12:10:43.072695 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.073951 12016 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.075184 12020 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:43.071693 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:43.079366 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.080127 11867 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.081399 12022 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:43.082105 11988 leader_election.cc:336] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.575s (SENT)
I20260709 12:10:43.082630 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.082101 12014 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:43.084605 11872 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.090963 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.091356 12016 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:10:43.089450 14751 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.095238 14817 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:43.098562 14817 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.049604 14683 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:43.102604 12021 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:43.121729 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:43.150748 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68683.4us
W20260709 12:10:43.176885 11988 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.593s (SENT)
I20260709 12:10:43.148496 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:43.179993 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 86791.9us
I20260709 12:10:43.177507 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.084617 14908 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.230194 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:43.241863 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65031.1us
W20260709 12:10:43.225315 11839 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36526 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:43.248720 11866 raft_consensus.cc:2376] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10. Re-sending same reply.
W20260709 12:10:43.248944 11988 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.631s (SENT)
I20260709 12:10:43.229866 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.157173 14904 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:43.149343 14911 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:43.250141 11872 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.251279 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.251735 14806 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:43.252411 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.250168 14904 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.252955 11872 raft_consensus.cc:2376] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8. Re-sending same reply.
I20260709 12:10:43.122996 14905 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:43.254287 14905 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.253957 14904 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.254410 14896 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:43.254918 14896 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.255401 14905 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.256034 14896 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:43.257392 14901 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.384s	user 0.008s	sys 0.002s
I20260709 12:10:43.257828 14896 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.256623 14905 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.186704 12015 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:10:43.260215 11988 leader_election.cc:336] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.640s (SENT)
I20260709 12:10:43.245077 11867 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:43.263496 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.219688 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b93a2cf326204d8e89e4fe76ead348c5 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:10:43.275050 11758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 93241.5us
I20260709 12:10:43.078928 14913 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.119781 14880 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.124924 14897 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.278990 14897 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.280519 14897 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.156479 14883 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.149940 14884 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.278007 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.219676 14816 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.261739 14854 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.300760 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 119324us
I20260709 12:10:43.241801 14885 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.276877 14747 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.272610 14817 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.223978 14916 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:10:43.286123 14883 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.309087 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.249222 11839 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36526 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1617)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1618)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1620)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1623)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
I20260709 12:10:43.276090 14908 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:10:43.286636 14880 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.301718 14776 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.283838 14913 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:41.176205 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.300801 14884 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.374413 14884 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.374658 14895 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:43.304347 14874 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:43.336361 14806 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.309969 14817 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.350879 14916 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.365818 14683 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:43.383873 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:43.362372 14902 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:43.353515 14881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.031s	sys 0.079s
I20260709 12:10:43.368530 14913 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:43.393507 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.168s (SENT)
I20260709 12:10:43.351111 14850 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.399442 14902 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.401353 14850 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.398463 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.403436 14850 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:43.404384 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.382570 14776 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:43.390659 14874 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.406415 14776 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.408836 14874 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.410262 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 120) took 5438 ms. Trace:
I20260709 12:10:43.413759 14683 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.414953 14902 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.382362 14920 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.311317 14917 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:10:43.301728 14854 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.410898 11769 rpcz_store.cc:276] 0709 12:10:37.989805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.998141 (+  8336us) service_pool.cc:224] Handling call
0709 12:10:43.410120 (+5411979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:40.123495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:40.227987 (+104492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:40.231645 (+  3658us) write_op.cc:435] Acquired schema lock
0709 12:10:40.234767 (+  3122us) tablet.cc:662] Decoding operations
0709 12:10:40.279154 (+ 44387us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:40.282220 (+  3066us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:40.283696 (+  1476us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:40.389773 (+106077us) tablet.cc:701] Row locks acquired
0709 12:10:40.392604 (+  2831us) write_op.cc:260] PREPARE: finished
0709 12:10:40.397062 (+  4458us) write_op.cc:270] Start()
0709 12:10:40.397186 (+   124us) write_op.cc:276] Timestamp: P: 1783599040396999 usec, L: 0
0709 12:10:40.397209 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:40.398091 (+   882us) log.cc:844] Serialized 2418 byte log entry
0709 12:10:40.847575 (+449484us) op_driver.cc:464] REPLICATION: finished
0709 12:10:41.055087 (+207512us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b180030ebc0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:41.055235 (+   148us) write_op.cc:301] APPLY: starting
0709 12:10:41.055337 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:41.055556 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:41.055584 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:41.128216 (+ 72632us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:41.128462 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:41.128516 (+    54us) write_op.cc:312] APPLY: finished
0709 12:10:41.128829 (+   313us) log.cc:844] Serialized 53 byte log entry
0709 12:10:41.129030 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.129182 (+   152us) write_op.cc:454] Released schema lock
0709 12:10:41.129234 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:41.136917 (+  7683us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.136956 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78367,"reported_tablets":7,"spinlock_wait_cycles":305408,"child_traces":[["op",{"apply.queue_time_us":169161,"apply.run_cpu_time_us":3591,"apply.run_wall_time_us":81612,"num_ops":6,"prepare.queue_time_us":198228,"prepare.run_cpu_time_us":13115,"prepare.run_wall_time_us":379709,"raft.queue_time_us":73828,"raft.run_cpu_time_us":6112,"raft.run_wall_time_us":261008,"replication_time_us":416685,"spinlock_wait_cycles":18955008,"thread_start_us":458020,"threads_started":4,"wal-append.queue_time_us":231545,"wal-append.run_cpu_time_us":13429,"wal-append.run_wall_time_us":1501909}]]}
I20260709 12:10:43.379309 14895 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:43.393309 14881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.032s	sys 0.080s
I20260709 12:10:43.392540 14919 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:43.431550 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:43.432376 14895 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.423215 14883 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.423215 14920 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.436368 14920 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.431826 14922 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.388744 14806 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.437800 14922 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.438212 14917 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:43.439271 14806 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.438906 14922 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.438863 14917 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.441793 14908 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:43.443209 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.443953 12603 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:43.390877 14916 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.447865 14904 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.437040 14920 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:43.388015 14817 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.365506 11836 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1620)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1623)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
W20260709 12:10:43.468153 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.441816 14917 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.451411 14715 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.447868 14916 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:43.473160 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 81343.4us
I20260709 12:10:43.477569 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.478313 12015 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:43.455998 11836 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1620)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1623)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
I20260709 12:10:43.480314 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.482568 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.483089 14916 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:43.483956 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.484079 14751 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.483850 14916 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.471901 14683 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.487181 12015 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.450618 14919 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.491185 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.491999 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.492592 14816 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.493629 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.523584 14919 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.523823 11873 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:43.523604 11870 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:43.524874 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.525152 14803 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.525506 14803 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.525672 11873 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:43.526044 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.526600 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.527777 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.528553 11873 raft_consensus.cc:2368] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:43.470901 14715 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:43.530453 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.530537 14715 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.531711 11867 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.531824 14715 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.489414 14916 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.540315 14803 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.545092 14803 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.555747 12016 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.560510 14895 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.563465 14823 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.568703 12019 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.570192 14823 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.570887 14823 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.557051 11839 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
I20260709 12:10:43.572630 14883 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.575855 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.488234 11836 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1623)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
W20260709 12:10:43.503805 14921 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:43.503520 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.578119 12015 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:43.578367 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.507321 14854 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.514055 14880 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.514688 14913 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.581813 14913 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:43.515759 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.583434 12021 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:43.584492 14823 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.589892 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.590687 12016 raft_consensus.cc:2368] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:43.580305 11836 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1636)
I20260709 12:10:43.493830 14817 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.595329 14924 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:43.595769 14924 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.593823 11836 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1636)
I20260709 12:10:43.575858 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:43.494890 14885 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:43.605684 11942 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:43.608127 11771 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 7 to 4, term changed from 6 to 5, leader changed from <none> to 189a165e6619406382914fe3075dd436 (127.10.114.68), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) added. New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:43.610028 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.609244 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.613896 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.527684 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.501977 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.615540 11870 raft_consensus.cc:2376] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4. Re-sending same reply.
I20260709 12:10:43.596717 14924 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.617435 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.619264 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.626500 11946 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:43.593364 14897 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.622088 14922 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:43.630268 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.630841 11867 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:43.634130 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.606643 11839 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36526 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2013)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1636)
I20260709 12:10:43.620182 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.634737 11948 raft_consensus.cc:1813] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:43.639428 11948 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:43.622478 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.643831 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.646845 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.646992 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.647665 11865 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.648413 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.648518 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.649219 11872 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:43.650013 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.650936 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.648450 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.652616 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.649845 11868 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.650637 11871 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.638824 11939 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:43.660164 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.661509 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.662096 11870 raft_consensus.cc:2376] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9. Re-sending same reply.
I20260709 12:10:43.663257 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.664618 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.666211 11870 raft_consensus.cc:2368] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:43.668514 11836 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36510 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1636)
I20260709 12:10:43.618332 14924 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.674412 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.674561 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.675740 11867 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:43.676018 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.677142 11870 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.677075 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.678618 11867 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:43.678686 11869 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.679607 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.680310 11872 raft_consensus.cc:2368] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:43.680567 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.683151 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.684571 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.685425 11864 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.685660 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.686569 11866 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.687713 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.689805 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.690841 11870 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:10:43.693359 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 150464us
I20260709 12:10:43.693979 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.694584 11868 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
W20260709 12:10:43.694835 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.812s (SENT)
I20260709 12:10:43.694336 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.696287 11948 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:43.697721 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.697203 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.698271 11867 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.700917 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.701490 11873 raft_consensus.cc:2376] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10. Re-sending same reply.
I20260709 12:10:43.701651 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.667347 14895 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.703456 11946 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:43.703836 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.704692 11939 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:43.705682 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.691831 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.708956 11870 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.712031 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.712991 11868 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:43.716595 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.717669 11872 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:43.718338 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.718966 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.719491 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.719553 12603 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.721144 11867 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:43.622402 14817 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:10:43.727929 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.725564 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:43.730656 11871 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:43.717960 11771 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:43.692721 14922 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:43.733681 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.734797 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.743304 12610 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:43.739858 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.745565 11867 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:43.747053 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.749353 11870 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:43.750953 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.751617 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.752403 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.753104 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.753372 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.752411 11864 raft_consensus.cc:2368] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:43.754027 11867 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:43.757376 14935 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.758236 14935 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.758780 14935 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.759666 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.759938 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.785867 11869 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.707505 14807 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:43.761900 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.766300 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:43.787176 12610 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.768322 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.768501 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.769245 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.771281 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.776197 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.782862 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.784606 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.785099 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.790912 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.829730 14927 tablet_replica.cc:333] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:10:43.829988 11868 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:43.831234 14927 raft_consensus.cc:2243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:43.693009 14823 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:10:43.833292 11867 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:43.834357 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.834712 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.835042 11867 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.787657 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.836715 11870 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:43.837263 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.837333 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.831226 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.838492 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.807291 11866 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:43.839030 11944 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:43.839300 11873 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.742697 14846 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:43.790586 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:43.839941 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.842316 11941 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.850945 11866 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:43.818567 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.852046 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.852259 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.852665 11942 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.853904 12610 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.845005 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:43.854457 11947 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:43.741242 14922 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.854934 11872 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.731302 14895 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:43.859762 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:43.858865 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 133402us
I20260709 12:10:43.847357 11867 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:43.853055 11939 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:43.856791 11866 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:43.876204 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1582) took 1041 ms. Trace:
I20260709 12:10:43.858007 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.876358 11873 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.876387 11867 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:43.877229 11871 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:43.855130 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:43.878001 11868 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:43.878482 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1564) took 1054 ms. Trace:
I20260709 12:10:43.876675 11866 rpcz_store.cc:276] 0709 12:10:42.834597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.856033 (+1021436us) service_pool.cc:224] Handling call
0709 12:10:43.856376 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.875930 (+ 19554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.876149 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.832209 14885 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:43.878890 11941 raft_consensus.cc:2410] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:43.845124 14724 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:43.844832 14919 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.880036 11988 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.813s (SENT)
I20260709 12:10:43.732004 14909 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:10:43.881270 11864 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:43.829679 14807 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.849020 14846 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.878818 11868 rpcz_store.cc:276] 0709 12:10:42.824080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.848465 (+1024385us) service_pool.cc:224] Handling call
0709 12:10:43.878417 (+ 29952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.887135 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.848376 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:43.923867 11948 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.906591 14919 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.892783 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.857380 14922 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:43.894614 11867 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:43.894347 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.898226 11871 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:43.897331 11942 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:43.903801 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1581) took 1069 ms. Trace:
I20260709 12:10:43.907717 11939 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.908867 14927 raft_consensus.cc:2272] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:43.958477 11873 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:43.960141 14935 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.909196 14807 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.892992 14885 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.910835 14846 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.880119 14715 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:43.901993 14724 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:43.937024 11943 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
W20260709 12:10:43.938247 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58249.7us
I20260709 12:10:43.978834 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.979703 11945 raft_consensus.cc:2410] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:43.954137 14684 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.935709 11864 rpcz_store.cc:276] 0709 12:10:42.834255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.854177 (+1019922us) service_pool.cc:224] Handling call
0709 12:10:43.881083 (+ 26906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.903508 (+ 22425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.903734 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.963301 11869 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:43.970948 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.972093 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.974233 11865 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:43.976291 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.983328 11942 raft_consensus.cc:2368] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:43.984345 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1586) took 1076 ms. Trace:
I20260709 12:10:43.985711 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:43.978610 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:43.986388 11865 rpcz_store.cc:276] 0709 12:10:42.908268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.545111 (+636843us) service_pool.cc:224] Handling call
0709 12:10:43.984271 (+439160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.988456 11819 placement_policy_util.cc:248] tablet e3e68fbb001a46d6af7bd0fc3e94e9ec: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 12:10:43.987535 11945 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.985775 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:43.961524 14927 ts_tablet_manager.cc:1916] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:43.982024 14715 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:43.982820 11944 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.999590 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:44.001017 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.006014 14868 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:44.006669 14868 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:44.007138 14868 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:44.008651 14936 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.009637 14895 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.017221 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.019763 11939 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:44.026470 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.024340 14684 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:44.038709 14684 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.039870 14684 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.040952 11912 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:44.042250 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.044062 14913 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.044513 14913 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:44.044874 14913 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.032168 14885 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.036789 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:44.047991 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.051827 14850 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.052299 14850 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:44.052802 14850 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.022220 14816 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:44.035951 14715 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.058940 11988 leader_election.cc:400] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
W20260709 12:10:44.061223 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 270847us
I20260709 12:10:44.071230 11988 leader_election.cc:403] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.072235 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:44.061959 11945 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:44.073575 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:44.063268 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 221439us
I20260709 12:10:44.060130 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:44.075716 11839 leader_election.cc:336] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.998s (SENT)
I20260709 12:10:44.070556 11944 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:44.076403 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:44.082232 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.061431 14919 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.084128 14747 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:44.090157 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.064062 14816 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.094683 14816 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.078382 14751 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.098431 14751 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.078873 14924 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.061210 14909 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.062122 14823 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:44.116174 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 144450us
I20260709 12:10:44.078589 14936 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:44.118237 12577 leader_election.cc:400] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:44.078753 14854 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.121241 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:44.121996 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8613180209999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:44.122011 12577 leader_election.cc:403] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.125077 14885 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.125696 14885 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.126050 14913 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.128252 14885 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.105309 14922 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.119153 14823 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.130549 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:44.131062 14724 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.133421 14922 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:44.135972 14937 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:44.122999 14936 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:44.129807 14935 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:44.138828 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1583) took 1271 ms. Trace:
I20260709 12:10:44.146895 11872 rpcz_store.cc:276] 0709 12:10:42.867896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.857796 (+989900us) service_pool.cc:224] Handling call
0709 12:10:43.879080 (+ 21284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.890445 (+ 11365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.890484 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.904059 (+ 13575us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.062189 (+158130us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.062231 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.062292 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.138575 (+ 76283us) raft_consensus.cc:1685] finished
0709 12:10:44.138600 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.138762 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1403,"raft.queue_time_us":11099,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13308,"thread_start_us":139067,"threads_started":1,"wal-append.queue_time_us":145846}
W20260709 12:10:44.166865 12577 leader_election.cc:336] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.946s (SENT)
I20260709 12:10:44.168519 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.171623 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:44.174365 12577 leader_election.cc:336] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.964s (SENT)
I20260709 12:10:44.137952 14854 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7.
I20260709 12:10:44.130556 14823 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.144897 14936 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.179713 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.138504 14879 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:44.170429 14885 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.190604 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.193893 14953 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.136152 14868 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.193917 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:44.179034 14776 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.165302 14913 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:44.198221 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 79642.7us
I20260709 12:10:44.199961 11986 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.181603 14747 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:44.202661 11986 raft_consensus.cc:2686] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:44.203619 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.204636 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.181360 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:44.187047 14715 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.208108 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.212224 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.214517 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.217068 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.218868 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.223551 14947 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.223798 14868 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.224229 14947 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.201334 14854 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.224723 14947 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.226359 14747 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.216495 14861 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.238272 14950 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.208779 12602 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.210717 14817 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.209148 14879 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:10:44.230086 12016 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:44.229470 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.270116 12022 raft_consensus.cc:2376] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5. Re-sending same reply.
I20260709 12:10:44.199935 14885 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.272778 14885 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.273336 14885 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:44.274205 14885 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.274595 14885 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:44.274300 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:44.216852 14776 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.275756 14776 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.276688 14776 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.240007 14689 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:10:44.238696 14807 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.278329 14950 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.278775 14950 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:44.280086 14807 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.279752 14950 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.280987 11948 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:44.228505 14917 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.252180 14913 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.257840 14786 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.259280 14909 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.198248 14850 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.263180 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.284869 14850 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:44.266747 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.187935 14846 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.285285 14786 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.286616 11988 leader_election.cc:400] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:44.286952 11988 leader_election.cc:403] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.287241 14846 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:44.287305 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:44.287941 14846 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.288874 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.289515 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.289922 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.289614 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.288676 14786 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.290521 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.291029 14786 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:44.288735 14846 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.291535 14786 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.292415 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.293814 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.294601 12019 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:10:44.296389 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 79900041d3b94f09a8d4b882957a37c3: Illegal state: Replica 46f08e8ff3774f25acad18252e5cd57d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:44.292337 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.298187 12022 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:44.298264 12021 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.300465 12014 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.300055 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.301667 12022 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.300791 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.302345 12016 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.300630 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.302685 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.205941 14939 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:10:44.303036 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.241930 14715 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.311511 12022 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:44.311837 12014 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:44.312510 12016 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
W20260709 12:10:44.315409 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet d6df9d20345c49f0a6f00d9f5f660140: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:44.317516 14846 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
W20260709 12:10:44.327455 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 6ed1e68af58741ceb833c997cabb45a3: Illegal state: Replica 6b7d9b5a12ef4a6cb097df86b95e5bfa is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:44.330154 14885 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.332446 14885 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.336143 12013 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:44.303794 12019 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:44.341132 12016 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:44.343278 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.350854 12022 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:10:44.345587 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.353062 12015 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:44.346410 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.302585 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:44.358264 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55745us
W20260709 12:10:44.362103 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 9ff67aad7c28488cbcaa11428b8d0954: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:44.364924 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:44.367588 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 154256us
I20260709 12:10:44.369503 12019 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.348945 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:44.373641 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 159197us
I20260709 12:10:44.371695 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.360538 14817 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.380733 14879 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.371635 14922 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.376891 14823 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.392990 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.400918 14955 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.386790 14917 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.402740 11948 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.407913 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:44.408578 11940 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.411077 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.393239 14817 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:44.401861 14956 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:44.401760 14776 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:44.413432 14909 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.414355 14909 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.414492 14817 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.415432 14909 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.416250 14885 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.416724 14909 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.423014 14823 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.418246 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:44.433061 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.441566 11947 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.437676 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.432718 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:44.438444 12016 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.442276 11866 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:44.431605 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.443578 12013 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:44.437099 11869 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:10:44.442349 11865 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.446306 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.447396 11872 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:44.448312 11944 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.449160 12019 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:44.450213 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.450834 11867 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:44.451704 11865 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:44.428859 11940 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:44.433284 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.446398 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:44.453879 12018 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.454197 11868 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.454221 12022 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.455783 11939 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.457885 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.459095 12017 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.465469 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.461802 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.468017 11873 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:44.473351 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:44.473569 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 101945us
I20260709 12:10:44.453401 14913 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.402235 14904 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:10:44.457155 14724 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.403373 14846 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:10:44.455010 14807 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.402823 14922 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:10:44.479887 14786 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.480654 14715 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.463086 14928 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.483579 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:44.452168 14747 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:44.491683 14807 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.468214 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:44.486852 14724 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.469975 14935 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:44.472189 14823 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:44.472831 14948 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.497509 12017 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:44.520524 12016 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:44.520985 12018 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:44.489271 14883 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.507324 11942 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:44.516595 12577 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.557s (SENT)
I20260709 12:10:44.524537 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:44.506953 14786 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.526762 14807 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.526957 14724 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.499480 14928 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.498433 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:44.528481 14897 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.529515 14897 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.529390 14939 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.530139 14897 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:44.531872 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:44.501188 14917 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.533826 14724 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.503518 12602 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.534448 14724 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:44.535004 14724 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.539237 14786 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.539850 14786 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:44.541666 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.542114 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:44.542140 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:44.532860 11947 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:10:44.559641 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 165439us
I20260709 12:10:44.561302 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.562474 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:44.478909 14913 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.561029 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.577239 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.577169 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:44.578352 12016 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:44.576730 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.544003 14948 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.543195 14883 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:44.610589 14879 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:44.581868 14953 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:44.608211 11871 raft_consensus.cc:2955] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:44.595008 14807 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:44.591065 14962 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:44.601265 14963 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.617686 14917 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:44.622790 14883 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.649744 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62424.9us
I20260709 12:10:44.623381 14879 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:44.596873 14936 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:44.659173 11948 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:44.666802 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.668610 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:44.687916 11865 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.644429 14963 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:44.629503 14817 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:44.672994 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:44.678223 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 74604.4us
I20260709 12:10:44.624990 14935 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:44.640136 14953 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.695668 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:44.695444 14953 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.691406 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:44.715243 11865 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:44.720980 11868 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:44.722405 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:44.784281 11873 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:44.604808 14897 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.651150 14962 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:44.691584 14950 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.670511 14968 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.716737 14948 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:44.730183 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 86620us
I20260709 12:10:44.747726 12020 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:44.759158 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.763144 14861 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
W20260709 12:10:44.749644 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.868387 11988 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.096s (SENT)
W20260709 12:10:44.862927 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 319618us
W20260709 12:10:44.867244 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 190074us
W20260709 12:10:44.744983 14959 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:10:44.943531 11869 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:44.743125 14928 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.749697 14936 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:44.742110 14786 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.746518 14913 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:44.883322 14861 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.742668 14972 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.216s
I20260709 12:10:44.958747 14897 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:44.998338 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 302688us
W20260709 12:10:45.048511 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.051271 11945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.001s	sys 0.020s
W20260709 12:10:45.051926 11945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.002s	sys 0.020s
W20260709 12:10:45.054803 14956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.013s
I20260709 12:10:45.061312 14968 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:45.062182 14968 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.065030 14968 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:45.068017 14968 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.067929 14861 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:45.068885 14968 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:45.070356 14968 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.072256 14968 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.079303 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:45.081415 14940 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:45.082065 14940 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.083489 14850 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.084128 14850 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:45.084321 14940 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:45.085485 14940 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:45.086285 14940 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.087430 14868 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.088012 14868 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:44.747345 14963 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:44.971740 14807 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:44.749625 14879 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:45.120842 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 121549us
I20260709 12:10:45.135489 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:44.975157 12602 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:10:45.140414 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.143257 14995 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.143877 14995 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.145859 14927 ts_tablet_manager.cc:1929] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:10:45.146493 14927 log.cc:1199] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/e3e68fbb001a46d6af7bd0fc3e94e9ec
I20260709 12:10:45.146955 14995 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:45.147881 14927 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56154 (request call id 72) took 1733 ms. Trace:
I20260709 12:10:45.148134 14995 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.089653 14940 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:45.148618 14995 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.146056 14807 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.153748 14983 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.113267 14956 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.154395 14985 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:10:45.154528 14983 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.158569 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:45.159353 11867 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:45.159654 11871 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:45.158763 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:45.166638 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:45.169114 14973 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.169802 14973 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.172091 14879 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:45.172150 14973 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:45.156868 14956 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.089473 14868 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.176946 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:45.209946 12019 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:45.177284 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:45.177382 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:45.180292 14850 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.182382 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:45.182041 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 132666us
I20260709 12:10:45.180675 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:45.188253 12017 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:45.238561 12607 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:45.244831 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:45.246663 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:45.247756 12019 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:45.249972 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:45.250871 12021 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:45.129084 14922 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:45.134542 14786 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:45.275134 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 94739.3us
W20260709 12:10:45.240556 14883 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.569s	user 0.000s	sys 0.009s
I20260709 12:10:45.138576 14962 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:45.577702 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.707038 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:45.414930 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:45.317229 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.487644 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1679) took 1060 ms. Trace:
W20260709 12:10:45.276162 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 394759us
W20260709 12:10:45.585440 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 180953us
I20260709 12:10:45.724052 14776 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:45.718116 11871 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
W20260709 12:10:45.453902 14947 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.229s	user 0.011s	sys 0.005s
I20260709 12:10:45.718178 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:45.726621 14947 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.727701 11940 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.728461 12014 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:45.728670 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:45.729188 11944 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:45.730264 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:45.730440 14947 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:45.360149 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.286940 11943 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
W20260709 12:10:45.724342 11988 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.569s (SENT)
I20260709 12:10:45.732278 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:45.719420 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.148319 14927 rpcz_store.cc:276] 0709 12:10:43.414382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.422972 (+  8590us) service_pool.cc:224] Handling call
0709 12:10:43.829275 (+406303us) ts_tablet_manager.cc:1151] Deleting tablet e3e68fbb001a46d6af7bd0fc3e94e9ec
0709 12:10:43.829369 (+    94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:44.475074 (+645705us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:45.136751 (+661677us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:45.147784 (+ 11033us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":396535,"thread_start_us":308348,"threads_started":1}
I20260709 12:10:45.710886 11942 rpcz_store.cc:276] 0709 12:10:44.427322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.427450 (+   128us) service_pool.cc:224] Handling call
0709 12:10:44.427841 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.523575 (+ 95734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.487060 (+963485us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54002b4b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:45.487492 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182289664}
I20260709 12:10:45.716898 12607 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
W20260709 12:10:45.250010 14724 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.001s
W20260709 12:10:45.241129 14961 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 12:10:45.736052 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:45.432610 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.612632 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.448661 14909 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.010s
I20260709 12:10:45.292690 14786 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.722286 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:45.782045 11819 placement_policy_util.cc:248] tablet e3e68fbb001a46d6af7bd0fc3e94e9ec: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 12:10:45.801558 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 79359.5us
I20260709 12:10:45.802528 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:45.261886 14917 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:45.353484 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:45.539980 14913 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.240305 14955 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:45.374048 14895 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:45.371811 14817 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.374800 14904 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:45.829665 11912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.022s
W20260709 12:10:45.536962 14988 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:10:45.717052 14973 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.309847 14850 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.367341 14897 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.327414 14783 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:45.404358 14983 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:45.850656 14983 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.851220 14983 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.734141 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.864753 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.779980 14980 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.548632 14922 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.447227 14747 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.351s
I20260709 12:10:45.274379 14957 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.510s
W20260709 12:10:45.823462 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92387.3us
W20260709 12:10:45.830099 11912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.022s
I20260709 12:10:45.794265 14939 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.795161 14776 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.781876 14883 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.868438 11940 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:45.865722 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet e3e68fbb001a46d6af7bd0fc3e94e9ec (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:10:45.903614 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 726238us
I20260709 12:10:45.805951 14786 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.824326 14995 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:45.846694 15011 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:45.847707 15003 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:45.848510 15015 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.707427 14868 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.799234 14992 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.794826 14724 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:45.911681 11758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46013.6us
W20260709 12:10:45.879004 14984 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.429s	user 0.000s	sys 0.002s
I20260709 12:10:45.924084 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:45.927320 11939 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.831522 14947 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.819438 14913 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.833801 15004 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.878166 14983 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.909444 14980 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:45.905097 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 106153us
I20260709 12:10:45.828625 14955 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.831864 14817 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:45.951056 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.956171 15001 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:10:45.908545 14939 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.842962 14897 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.842767 14973 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.908951 15005 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.911017 14922 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.881258 14783 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:45.912016 14917 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:46.313108 12577 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.665s (SENT)
W20260709 12:10:46.354833 11869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2036) took 1647 ms (client timeout 1939 ms). Trace:
I20260709 12:10:45.921929 14904 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:46.113622 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.178844 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.978123 11944 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 12:10:46.172127 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2027) took 1714 ms. Trace:
W20260709 12:10:46.191704 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.312666 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 84088.1us
W20260709 12:10:46.217859 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 415335us
W20260709 12:10:46.395287 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.708s (SENT)
W20260709 12:10:46.403808 11869 rpcz_store.cc:269] 0709 12:10:44.666293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.666433 (+   140us) service_pool.cc:224] Handling call
0709 12:10:46.230145 (+1563712us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003043d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:46.313385 (+ 83240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588032256}
W20260709 12:10:46.218106 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 313632us
W20260709 12:10:46.391808 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 78736.6us
I20260709 12:10:45.981629 11948 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:46.381486 14850 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 12:10:45.926395 15003 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.225425 15016 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.972514 14981 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:10:46.101475 14924 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:46.015306 15015 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.582551 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.155895 14747 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:46.491182 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:46.462345 11944 pending_rounds.cc:85] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 3
W20260709 12:10:46.570046 12577 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.170s (SENT)
I20260709 12:10:46.601197 11944 pending_rounds.cc:107] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 12:10:46.601663 11944 raft_consensus.cc:2889] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.978770 14776 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.403478 15024 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:46.401197 14885 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.512702 14897 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.378499 14958 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:46.238953 15010 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:10:46.572822 12607 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:46.379954 14909 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:46.617664 14922 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.617851 14909 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.619102 15003 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.619776 15003 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:46.620328 15003 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.620617 14909 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.208339 14992 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.621371 14992 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.622709 14939 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:46.623006 14786 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.002s
I20260709 12:10:46.623502 14786 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.623852 11944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628666a2024d4a61831835e7dee5737a"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:46.624481 11944 raft_consensus.cc:606] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:46.624820 11944 raft_consensus.cc:614] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:46.591518 14817 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.613577 14885 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.628070 14885 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.628808 14885 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.604003 15015 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.631039 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2142) took 1473 ms. Trace:
I20260709 12:10:46.631340 15015 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.076066 14715 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.464301 11864 rpcz_store.cc:276] 0709 12:10:44.434555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.451501 (+ 16946us) service_pool.cc:224] Handling call
0709 12:10:44.466143 (+ 14642us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.604013 (+137870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.604072 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:44.625142 (+ 21070us) log.cc:844] Serialized 52 byte log entry
0709 12:10:44.758943 (+133801us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800416f80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:44.980155 (+221212us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.980210 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.980302 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.134075 (+1153773us) raft_consensus.cc:1685] finished
0709 12:10:46.134103 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.148468 (+ 14365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172855,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9155,"spinlock_wait_cycles":3354368,"thread_start_us":344655,"threads_started":2,"wal-append.queue_time_us":838245}
I20260709 12:10:46.378909 14977 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:46.631511 12013 rpcz_store.cc:276] 0709 12:10:45.157692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.157908 (+   216us) service_pool.cc:224] Handling call
0709 12:10:45.158316 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.158675 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.158704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.240222 (+ 81518us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.808083 (+567861us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.808150 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.808267 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.630801 (+822534us) raft_consensus.cc:1685] finished
0709 12:10:46.630833 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.630972 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1366,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":431518,"threads_started":1,"wal-append.queue_time_us":688918}
I20260709 12:10:46.633019 14977 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:46.634045 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 238805us
I20260709 12:10:46.633793 14958 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:46.634716 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.892s (SENT) [suppressed 58 similar messages]
I20260709 12:10:46.634774 14992 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:46.635321 14850 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.636439 14958 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:46.463675 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:46.237053 15007 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:10:46.637614 14715 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:46.638777 14715 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.639849 14715 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.072726 14895 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:45.946300 14986 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:45.956676 15011 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.625s
I20260709 12:10:46.582033 14978 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.581815 15016 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:45.976622 14913 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.564689 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:46.652761 14978 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:46.654529 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89899.3us
I20260709 12:10:46.655471 15003 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.655874 14978 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.655980 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:46.656206 15003 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.656711 15003 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:46.378998 14990 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.597967 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:46.661186 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 63364.6us
I20260709 12:10:46.066856 14919 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.662596 14919 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.663116 14861 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:46.663491 11943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1675) took 2252 ms (client timeout 2165 ms). Trace:
I20260709 12:10:46.663656 14861 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.664149 14861 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:46.664002 11943 rpcz_store.cc:269] 0709 12:10:44.410800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.412120 (+  1320us) service_pool.cc:224] Handling call
0709 12:10:45.079127 (+667007us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:46.663249 (+1584122us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540013d8d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:46.663377 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406477568}
I20260709 12:10:46.660949 14990 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:46.492652 15012 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:10:46.504009 14968 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.431s	user 0.012s	sys 0.003s
I20260709 12:10:46.601461 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:46.668004 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.961448 14883 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:46.667945 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 97933.5us
I20260709 12:10:46.397511 14724 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:46.500882 14879 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 1.328s	user 0.013s	sys 0.002s
I20260709 12:10:46.669322 14879 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.491647 14987 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.411541 14904 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.610085 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:46.408757 14984 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 12:10:46.682063 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:46.683166 15013 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.683971 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1677) took 2258 ms. Trace:
I20260709 12:10:45.946280 14995 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.651s
I20260709 12:10:46.514288 14980 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.517732 14955 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.611389 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2037) took 1943 ms. Trace:
I20260709 12:10:46.515342 14973 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.573232 15004 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.577924 14924 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:46.510653 14989 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:46.614321 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:46.585419 14880 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.615397 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.586349 14823 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.399868 14948 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
I20260709 12:10:46.620693 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1668) took 2217 ms. Trace:
I20260709 12:10:46.518319 11947 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:10:46.684819 11866 rpcz_store.cc:276] 0709 12:10:44.667809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.668019 (+   210us) service_pool.cc:224] Handling call
0709 12:10:44.668575 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.057117 (+388542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.057163 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.057917 (+   754us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.133928 (+ 76011us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.133981 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.136361 (+  2380us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.611147 (+1474786us) raft_consensus.cc:1685] finished
0709 12:10:46.611167 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.611310 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":395843,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":455016,"threads_started":2,"wal-append.queue_time_us":542758}
I20260709 12:10:46.636937 14977 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.504341 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:46.639938 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 176366us
I20260709 12:10:46.591140 14956 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.613653 15024 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.641690 14950 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:46.641873 14868 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.006s
I20260709 12:10:46.607153 14747 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.642722 14786 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.629365 14885 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.650496 14986 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.146864 15018 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:46.498236 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2125) took 2097 ms. Trace:
I20260709 12:10:46.657348 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:46.657699 15016 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:46.658882 15017 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:46.659942 14783 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:46.379325 15006 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.670739 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:46.671455 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.670307 14987 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.516198 11942 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:45.965252 14947 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.774807 14979 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.738487 11985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.019s
I20260709 12:10:46.684384 11945 rpcz_store.cc:276] 0709 12:10:44.425858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.426029 (+   171us) service_pool.cc:224] Handling call
0709 12:10:44.426426 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.426939 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.426969 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:44.427535 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 12:10:45.052587 (+625052us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.053546 (+   959us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.121573 (+ 68027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.121720 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.493988 (+1372268us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4800190158. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:10:46.683605 (+189617us) raft_consensus.cc:1685] finished
0709 12:10:46.683731 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.683897 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152734,"prepare.queue_time_us":265,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":113811,"raft.run_cpu_time_us":46000,"raft.run_wall_time_us":1343077,"spinlock_wait_cycles":5254528,"thread_start_us":624519,"threads_started":1,"wal-append.queue_time_us":946843}
W20260709 12:10:46.777830 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.778844 11947 pending_rounds.cc:85] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
W20260709 12:10:46.783497 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.774634 14880 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.683759 15013 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:46.901125 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.941962 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.866838 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 232111us
W20260709 12:10:46.886935 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.778703 11946 rpcz_store.cc:276] 0709 12:10:44.402933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.403107 (+   174us) service_pool.cc:224] Handling call
0709 12:10:44.655027 (+251920us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:44.655267 (+   240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.996750 (+341483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.996796 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.061823 (+ 65027us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.620138 (+1558315us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002e9e40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1
0709 12:10:46.620331 (+   193us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.620368 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.620435 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.620476 (+    41us) raft_consensus.cc:1685] finished
0709 12:10:46.620486 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.620606 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":316140,"raft.queue_time_us":464821,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":38709,"spinlock_wait_cycles":41352832,"thread_start_us":88484,"threads_started":2,"wal-append.queue_time_us":384717,"wal-append.run_cpu_time_us":2491,"wal-append.run_wall_time_us":1117171}
I20260709 12:10:46.941272 12014 rpcz_store.cc:276] 0709 12:10:44.401229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.401405 (+   176us) service_pool.cc:224] Handling call
0709 12:10:44.401826 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.729017 (+1327191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.497944 (+768927us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400345654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:46.498161 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050128768}
I20260709 12:10:46.947629 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:46.665400 14919 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:46.946516 11985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.000s	sys 0.029s
I20260709 12:10:46.945976 11947 pending_rounds.cc:107] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260709 12:10:46.947324 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 290030us
W20260709 12:10:46.955600 11988 leader_election.cc:336] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.919s (SENT)
I20260709 12:10:46.958880 11866 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:46.962216 11839 leader_election.cc:400] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:46.962468 11839 leader_election.cc:403] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.959013 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:46.962586 11988 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.989s (SENT)
I20260709 12:10:46.962848 11947 raft_consensus.cc:2889] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.963056 11864 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:46.963513 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.056s (SENT)
I20260709 12:10:46.963909 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:46.673491 15003 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.963162 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:46.778616 14963 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.976779 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:46.845188 14776 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.973203 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.749869 15015 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.982414 11988 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.043s (SENT)
I20260709 12:10:46.971627 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:46.779652 14955 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:46.982944 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:46.983846 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:46.973958 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:46.984512 11869 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:46.985399 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:46.984972 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:46.987104 11864 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:46.987699 11864 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:46.685702 14904 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.943291 14950 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:46.990712 11866 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:10:46.994074 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.959772 14956 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.993197 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.023737 11869 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:47.033242 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1688) took 1308 ms. Trace:
I20260709 12:10:47.033493 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:47.032501 14948 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:46.992995 14980 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.018831 14958 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.981912 14968 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.971287 14868 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.960551 15017 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:46.788311 14823 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.049649 11871 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.066116 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:46.957028 15018 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:46.992365 15016 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.038760 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.078018 11865 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:10:47.078365 11870 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.052563 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.047653 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:47.046809 11864 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.957844 15004 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.056404 14786 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.955591 14924 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.050100 11947 rpcz_store.cc:276] 0709 12:10:45.724381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.724531 (+   150us) service_pool.cc:224] Handling call
0709 12:10:45.724889 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.963490 (+1238601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.032896 (+ 69406us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400425754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:47.033163 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823626624}
I20260709 12:10:47.024734 14817 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:47.069365 14850 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.004333 15015 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.045518 14995 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:47.051265 15011 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:47.063211 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.121049 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.085604 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47796.5us
I20260709 12:10:47.020758 14776 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.020953 14955 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.092561 11864 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.021608 14973 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:10:47.065739 14928 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.061770 14909 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.063326 14990 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:46.965096 14979 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.976922 14895 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:47.080420 15007 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:10:47.048149 14956 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:47.091917 11912 consensus_peers.cc:597] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbba5e6f295144a79461c5afc2e273ae. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:10:47.069959 14952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.003s	sys 0.009s
I20260709 12:10:46.954406 15006 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:46.968632 14989 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.110736 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.183261 11870 raft_consensus.cc:2410] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:47.117245 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 132345us
I20260709 12:10:47.175149 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:47.096460 14983 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.003s
I20260709 12:10:47.075702 14968 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:47.101118 15028 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:10:47.090368 14883 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:47.132326 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44616us
I20260709 12:10:47.236666 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:47.237278 11865 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.237975 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:47.098097 15022 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.076128 14868 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.245491 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.157416 11871 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.245397 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.062353 14948 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.130570 14924 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.122226 14747 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:47.169195 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 105520us
I20260709 12:10:47.103056 14935 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:47.100726 14724 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:47.184732 12014 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.184588 11866 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:47.106158 15016 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:47.184062 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:47.146402 14993 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:47.242799 15038 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:10:47.127918 14995 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.146521 14909 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:47.173053 14952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.004s	sys 0.010s
I20260709 12:10:47.142365 14928 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.160079 14990 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.120410 14850 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.172899 15034 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:47.212841 15033 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:47.212703 14991 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.116925 14817 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.168785 14980 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:47.212936 14968 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:47.292943 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.519s (SENT)
I20260709 12:10:47.215462 15035 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.214468 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:47.112653 14950 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.214464 12602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 352) took 1951 ms. Trace:
W20260709 12:10:47.235453 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 161606us
W20260709 12:10:47.223598 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.432184 14776 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:47.673374 12607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.004s
W20260709 12:10:47.675235 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.675479 12607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.004s
W20260709 12:10:47.345618 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 161622us
W20260709 12:10:47.676677 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.677021 15034 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.241328 11864 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.339586 11865 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:47.687839 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:47.689073 11865 raft_consensus.cc:2368] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:47.293633 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.442975 14955 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.244060 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.691211 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.691314 11945 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:47.692337 11871 raft_consensus.cc:2368] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:47.226905 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.557111 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.695266 14909 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.229387 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.563652 11870 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:47.401108 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.698037 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.249907 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.700201 12013 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:47.702322 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.704408 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:47.383360 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.387741 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.386260 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.706336 12014 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:47.706935 12017 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:47.707413 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.707717 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.708515 12014 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.708680 12015 raft_consensus.cc:2410] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:47.234670 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.667304 12602 rpcz_store.cc:276] 0709 12:10:45.235108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.240552 (+  5444us) service_pool.cc:224] Handling call
0709 12:10:46.505625 (+1265073us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:10:46.505942 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.603822 (+ 97880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.606303 (+  2481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.611846 (+  5543us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.613081 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.146613 (+533532us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400211bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:47.168072 (+ 21459us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.186442 (+ 18370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240863488}
I20260709 12:10:47.388823 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:47.404147 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 161270us
I20260709 12:10:47.685276 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:47.392300 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:47.712101 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.712204 11864 raft_consensus.cc:2376] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8. Re-sending same reply.
I20260709 12:10:47.713330 12016 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:47.387447 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:47.412223 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 119343us
I20260709 12:10:47.358419 14747 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:47.679055 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:47.718921 11872 raft_consensus.cc:2410] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:47.105037 14786 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.396224 14868 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.250156 14879 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:10:47.373008 14880 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.242786 14883 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.248054 14885 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.441610 14928 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.243391 14947 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.791803 14883 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.446393 14948 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.432180 14950 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.384622 14956 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:47.407092 14979 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.810909 12018 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:47.552636 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:47.810657 14956 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.812618 11869 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.222553 14983 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:47.814317 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.816766 14983 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.462584 14980 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.421929 14986 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.425323 14989 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.351078 14987 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.397027 14990 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.851591 14990 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.249841 14992 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.468192 14993 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:47.855409 14993 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:47.856565 14715 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.216s	user 0.015s	sys 0.007s
I20260709 12:10:47.859371 12014 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:47.469475 14995 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.246930 15006 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:47.486614 15003 consensus_meta.cc:287] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 12:10:47.435274 15004 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.407135 15018 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.140174 15011 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.430480 15016 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.438235 15015 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.232064 15026 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.206012 15017 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.337327 15024 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.250463 15022 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.215027 15031 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:47.909184 15004 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.408249 15033 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.420660 15035 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.222010 15036 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.928923 15036 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:47.440899 15039 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:10:47.424582 15046 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.181s
W20260709 12:10:47.441856 15047 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:10:47.390926 15051 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.404476 15053 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.630507 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.628640 14861 consensus_meta.cc:287] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.964s	user 0.013s	sys 0.003s
I20260709 12:10:47.618327 14996 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.650142 14817 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.651705 14850 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:47.330132 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.695521 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.379937 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.679061 15034 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.776088 14955 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.777257 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64825.2us
I20260709 12:10:47.789891 14879 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.969214 14996 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.979810 14879 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:47.980266 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:47.981338 14879 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.982195 14996 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:47.982354 14904 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.933s	user 0.020s	sys 0.007s
I20260709 12:10:47.982764 15024 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.983357 14879 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.866370 15003 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.948463 15026 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.896281 15016 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.861627 14786 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.920693 15031 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.951323 12013 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:47.908488 14963 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.019s
W20260709 12:10:47.961716 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.004570 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.004750 11873 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:47.929560 15033 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:47.950958 15022 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.969955 15053 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.971338 15051 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:47.974776 15035 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.975014 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:47.975339 12577 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.914s (SENT)
I20260709 12:10:47.975733 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.976168 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.976053 14993 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.963510 14861 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:47.976948 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:47.977993 14817 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:47.978983 15006 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.983033 14904 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.920887 14883 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.018592 15051 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.019672 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1693) took 1616 ms. Trace:
W20260709 12:10:48.019856 14924 consensus_meta.cc:287] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.724s	user 0.015s	sys 0.008s
I20260709 12:10:47.985383 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:48.020177 11941 rpcz_store.cc:276] 0709 12:10:46.403082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.403338 (+   256us) service_pool.cc:224] Handling call
0709 12:10:46.493463 (+ 90125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.573387 (+ 79924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.573414 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.573937 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.915617 (+341680us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.915692 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.915817 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.019163 (+1103346us) raft_consensus.cc:1685] finished
0709 12:10:48.019208 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.019413 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79480,"raft.queue_time_us":92563,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":329341,"threads_started":1,"wal-append.queue_time_us":477172}
I20260709 12:10:48.022099 11948 raft_consensus.cc:606] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:48.022536 11948 raft_consensus.cc:614] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.022611 15013 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:47.979862 14955 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.952965 15004 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:47.982410 15034 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.011487 15029 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.011788 14817 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.010593 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:48.013016 15016 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:48.015882 15006 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:48.016804 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 121427us
I20260709 12:10:48.023938 11943 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:48.027868 15029 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.030778 15053 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:48.029518 14823 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.043759 15005 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.044448 15005 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:48.044872 15006 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.031234 14817 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.032145 14861 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:48.033206 15048 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.778s	user 0.003s	sys 0.023s
I20260709 12:10:48.033646 11939 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:48.034179 15004 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.036605 14955 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:47.930548 15036 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:48.046252 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.052403 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 65560.8us
I20260709 12:10:48.025728 15003 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:48.058409 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.047636 14904 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.051966 14993 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.048028 15026 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.045523 15005 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.075507 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.077344 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.078250 12611 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:48.078014 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.047777 15031 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:48.063053 15033 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:48.084009 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.085522 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.086159 11865 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.085600 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:48.094532 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.095389 15005 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.096863 15053 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.098203 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.099424 11866 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:48.097821 15053 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:48.082901 15064 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.264s	user 0.004s	sys 0.004s
I20260709 12:10:48.100420 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.105818 12014 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:48.111491 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:48.118867 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.100775 15033 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:48.122181 15073 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:10:48.129386 12013 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:48.120080 15033 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.134107 14883 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:48.135309 15045 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.843s	user 0.002s	sys 0.008s
I20260709 12:10:48.135313 15016 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:48.139623 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.138064 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:48.141347 14689 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.141826 14689 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:48.142205 14689 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.144634 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.144981 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.145044 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 509) took 1095 ms. Trace:
I20260709 12:10:48.145640 11871 raft_consensus.cc:2410] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:48.145788 11869 raft_consensus.cc:2368] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:48.150204 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:48.152329 11872 raft_consensus.cc:2410] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:48.150267 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.153632 12014 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:10:48.154378 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72429.4us
I20260709 12:10:48.155184 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1695) took 1742 ms. Trace:
I20260709 12:10:48.156090 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2041) took 2989 ms. Trace:
I20260709 12:10:48.156633 11873 rpcz_store.cc:276] 0709 12:10:45.166223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.166377 (+   154us) service_pool.cc:224] Handling call
0709 12:10:48.155868 (+2989491us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54001b5154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:48.155990 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6524718848}
I20260709 12:10:48.158037 11864 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:48.158674 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:48.159652 11871 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:48.145648 11942 rpcz_store.cc:276] 0709 12:10:47.049286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.051385 (+  2099us) service_pool.cc:224] Handling call
0709 12:10:47.051780 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.004712 (+952932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.004765 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.004826 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.004882 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.144570 (+139688us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540038fed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:48.144619 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.144853 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190428928}
I20260709 12:10:48.162739 14922 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:48.163582 14922 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:48.160346 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:48.167061 15053 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:48.168013 15053 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.168467 15053 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.168921 15053 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.170092 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.172899 11941 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.175506 15046 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:48.177691 15074 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:10:48.147940 15036 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.177958 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:48.158241 11865 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:10:48.197757 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.199216 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.200045 12018 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:48.206756 11941 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:48.204877 11866 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:10:48.215711 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.217978 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.219367 11941 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:48.222671 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2052) took 1170 ms. Trace:
I20260709 12:10:48.223201 11867 rpcz_store.cc:276] 0709 12:10:47.052136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.052281 (+   145us) service_pool.cc:224] Handling call
0709 12:10:48.222222 (+1169941us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002f5b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:48.222434 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440254720}
I20260709 12:10:48.230762 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.231456 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.232348 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.232398 11864 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
W20260709 12:10:48.234186 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56484.4us
I20260709 12:10:48.213497 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:48.239653 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.233080 11940 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:48.250687 15017 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.251678 15017 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.253580 15011 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:48.259672 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.263429 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.264881 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.265779 11867 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7.
I20260709 12:10:48.155714 11944 rpcz_store.cc:276] 0709 12:10:46.412936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.628003 (+215067us) service_pool.cc:224] Handling call
0709 12:10:46.628296 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.657617 (+ 29321us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:46.916271 (+258654us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.112699 (+196428us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.879328 (+766629us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:47.893708 (+ 14380us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.896313 (+  2605us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.896385 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.896500 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.134131 (+237631us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:48.154842 (+ 20711us) raft_consensus.cc:1685] finished
0709 12:10:48.154864 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.155013 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99427,"prepare.queue_time_us":367155,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":45023,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":24016,"spinlock_wait_cycles":80132608,"thread_start_us":359482,"threads_started":2,"wal-append.queue_time_us":187155}
I20260709 12:10:48.267506 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.265213 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.269279 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.271636 11942 raft_consensus.cc:606] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:48.272212 11942 raft_consensus.cc:614] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.268602 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:10:48.272910 11872 raft_consensus.cc:2368] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8.
I20260709 12:10:48.266779 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.273422 11946 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:48.283082 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.283655 14922 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:48.283802 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:48.289431 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.290239 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.291769 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.273094 15022 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:48.278050 15078 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:48.312947 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.272804 15011 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.373598 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:48.454129 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.465219 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.296924 11948 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:48.278079 12014 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:48.551122 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:48.552229 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 261895us
W20260709 12:10:48.545307 15085 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:10:48.561146 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.564812 12013 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:48.559540 11866 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:48.572624 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:48.574275 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.574833 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.564011 14879 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.009s
I20260709 12:10:48.583954 12603 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:48.550889 15022 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:48.587944 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.589876 12607 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:48.585726 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.592783 11948 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:48.593433 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.588905 11864 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:48.572721 15004 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.589613 15017 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.589939 15022 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.560295 14689 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:48.561997 15033 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.643399 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.636564 11872 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:48.644797 11872 pending_rounds.cc:85] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 5
I20260709 12:10:48.621796 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.646296 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.645098 11872 pending_rounds.cc:107] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:48.652194 11872 raft_consensus.cc:2889] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.655792 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.656716 15033 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:48.657197 11941 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:48.658152 14962 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.658643 14962 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:48.660012 14962 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:48.661490 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.662192 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.657202 15005 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.005s
I20260709 12:10:48.664304 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:48.665184 11866 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7.
I20260709 12:10:48.666965 15053 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.612317 15011 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.672106 15011 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:48.677866 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.678581 12611 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:48.679559 15083 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 12:10:48.612321 15049 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:48.681260 15049 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:48.661226 14962 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.681089 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.682382 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:48.689606 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 52463.1us
I20260709 12:10:48.698964 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:48.700721 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.705687 12602 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:10:48.706314 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.707140 12018 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:10:48.698315 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0246495300000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3045s for a response
W20260709 12:10:48.709556 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.639732 15004 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.717952 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.714829 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:48.717013 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.718616 12014 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:48.716467 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.711074 15003 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.726998 14689 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.731292 15004 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.727908 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.731526 15003 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:48.731979 15029 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.732146 11940 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:48.717805 15046 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.728902 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:48.733451 12608 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.734143 15049 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:48.734308 15036 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.009s
I20260709 12:10:48.721964 11943 raft_consensus.cc:2376] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9. Re-sending same reply.
I20260709 12:10:48.729163 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.734181 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:48.736295 12610 raft_consensus.cc:1813] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:48.748049 12610 raft_consensus.cc:2410] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:48.750608 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.751586 12018 raft_consensus.cc:2410] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:48.721555 15053 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:48.757009 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.759928 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:48.760779 12013 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:48.762773 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:48.764447 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:48.773443 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.777514 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:48.778317 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.779062 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.772244 15003 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.784025 12608 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:48.786000 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:48.776170 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:48.789794 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.774858 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:48.792855 11941 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:48.794859 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:48.790918 11869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.029s	sys 0.038s
W20260709 12:10:48.798193 11869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.029s	sys 0.038s
I20260709 12:10:48.752995 14883 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:48.799880 11940 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.795751 11943 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:48.804279 11948 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:48.806043 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.807150 15086 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260709 12:10:48.809028 15053 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.809613 15053 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:48.793337 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:48.803301 11837 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:48.810021 15053 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.836746 12014 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:48.831662 15082 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.261s	user 0.003s	sys 0.002s
I20260709 12:10:48.844434 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.852169 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:48.853498 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:48.857291 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.866583 11943 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:48.840936 15003 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:48.876605 15049 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:48.876906 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:48.877579 15049 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:48.882489 15049 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:48.885984 11941 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
W20260709 12:10:48.892526 15084 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 12:10:48.857963 15079 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:48.873356 15003 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:48.880360 14978 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.929728 11943 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.968959 12020 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:48.918967 15003 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:48.985841 15029 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.914247 15079 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:48.986790 15029 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.004990 11769 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:49.006757 11769 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 8, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.008700 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 4 to 7, term changed from 5 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.986691 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.018920 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.032333 15029 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:48.968051 14978 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.037067 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:49.034328 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:49.038612 11867 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.034369 11912 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:49.038156 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 240454us
I20260709 12:10:49.040584 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:49.043912 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:49.047358 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:49.048130 11871 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.052970 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.054944 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:49.055744 11868 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.041874 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:49.068048 11864 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:49.051115 14904 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.073182 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:49.075870 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.083257 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:49.084133 11942 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:49.084553 11942 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:49.086871 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.072252 14879 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.072184 14904 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.097966 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:49.098930 11865 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:49.100513 15022 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.082334 15053 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.103659 11867 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:49.101007 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.116680 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:49.089888 14879 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.094146 14904 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.119869 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:49.123250 15053 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:49.125274 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.129865 14978 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.141644 12014 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:49.138123 11871 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:49.090061 15003 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.144625 11873 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:49.134471 14879 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.143682 11838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.012s	sys 0.009s
W20260709 12:10:49.154067 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.012s	sys 0.009s
W20260709 12:10:49.148645 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 439955us
W20260709 12:10:49.159063 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.158486 14978 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:49.193007 11988 leader_election.cc:336] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.246s (SENT)
W20260709 12:10:49.194332 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.196158 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.189261 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:49.198717 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.199958 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.187467 14978 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:49.194331 14883 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.226292 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:10:49.241914 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.242794 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.227442 15003 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:49.227802 15090 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.223253 15053 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:49.257834 15053 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:49.258603 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77609.5us
I20260709 12:10:49.186720 15005 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:49.260962 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:49.261031 15005 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.233752 12022 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:49.237000 15017 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:49.237663 15022 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:49.238600 14978 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:49.239318 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.274452 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.263530 15005 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:49.243597 11769 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 5, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:49.260319 15053 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:49.234725 11839 connection.cc:256] RPC call timeout handler was delayed by -3.4801362800001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 12:10:49.278230 11839 connection.cc:256] RPC call timeout handler was delayed by -3.4792362800001229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:10:49.278720 11839 connection.cc:256] RPC call timeout handler was delayed by -3.4594362800000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:10:49.279088 11839 connection.cc:256] RPC call timeout handler was delayed by -3.4306362800000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 12:10:49.252064 14883 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.271519 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:49.287420 11769 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.272627 15017 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:49.275985 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.407s (SENT)
I20260709 12:10:49.241937 11947 raft_consensus.cc:606] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:49.294063 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.271023 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:49.287045 11839 connection.cc:256] RPC call timeout handler was delayed by -3.3667362800001683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:10:49.295845 11839 connection.cc:256] RPC call timeout handler was delayed by -3.1921362800001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:10:49.263631 15079 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:49.290926 11898 heartbeater.cc:646] Failed to heartbeat to 127.10.114.126:46571 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.10.114.126:46571 timed out after 15.000s (SENT)
I20260709 12:10:49.271960 15090 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:49.276494 11771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 223) took 20663 ms (client timeout 15000 ms). Trace:
I20260709 12:10:49.285964 11868 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:49.296306 11839 connection.cc:256] RPC call timeout handler was delayed by -3.1705362800000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:10:49.304276 11839 connection.cc:256] RPC call timeout handler was delayed by -3.1705362800000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:10:49.304790 11839 connection.cc:256] RPC call timeout handler was delayed by -3.1327362800000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:10:49.305183 11839 connection.cc:256] RPC call timeout handler was delayed by -3.0175362800000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:10:49.305629 11839 connection.cc:256] RPC call timeout handler was delayed by -3.016636280000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:10:49.306020 11839 connection.cc:256] RPC call timeout handler was delayed by -2.9491362800001752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 12:10:49.306306 15090 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:49.306427 11839 connection.cc:256] RPC call timeout handler was delayed by -2.9491362800001752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 12:10:49.307005 11839 connection.cc:256] RPC call timeout handler was delayed by -2.6746362800001862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2453s for a response
W20260709 12:10:49.307413 11839 connection.cc:256] RPC call timeout handler was delayed by -2.5963362800000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.254s for a response
W20260709 12:10:49.307889 11839 connection.cc:256] RPC call timeout handler was delayed by -2.577436280000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2561s for a response
I20260709 12:10:49.288552 14883 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.299191 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:10:49.299362 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.299721 11769 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.312659 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:49.314585 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.301740 15022 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.303781 15053 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.309267 15005 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.323113 11769 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 5, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 5 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:10:49.315227 14962 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.632s	user 0.015s	sys 0.000s
W20260709 12:10:49.325163 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.350270 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:49.358409 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:49.323187 14883 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:49.372430 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 209020us
W20260709 12:10:49.372720 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49902.7us
I20260709 12:10:49.349175 15005 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:49.374151 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60434.4us
I20260709 12:10:49.378042 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:49.348663 15036 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.352842 15090 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.378948 11943 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
W20260709 12:10:49.381667 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1278090759999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2779s for a response
I20260709 12:10:49.382401 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:49.371063 11769 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:49.388569 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:49.388046 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:49.390142 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:49.390300 11769 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.384099 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:49.303556 11771 rpcz_store.cc:269] 0709 12:10:28.577356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.577686 (+   330us) service_pool.cc:224] Handling call
0709 12:10:49.240774 (+20663088us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:44.205862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:44.226908 (+ 21046us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:44.226955 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:44.226977 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:44.227604 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:44.227710 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:44.229133 (+  1423us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:44.301906 (+ 72773us) tablet.cc:701] Row locks acquired
0709 12:10:44.303327 (+  1421us) write_op.cc:260] PREPARE: finished
0709 12:10:44.331145 (+ 27818us) write_op.cc:270] Start()
0709 12:10:44.331297 (+   152us) write_op.cc:276] Timestamp: P: 1783599044331066 usec, L: 0
0709 12:10:44.331321 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:44.332171 (+   850us) log.cc:844] Serialized 987 byte log entry
0709 12:10:44.760250 (+428079us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b180032b180. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1
0709 12:10:44.764350 (+  4100us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b180032b180. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:46.783849 (+2019499us) op_driver.cc:464] REPLICATION: finished
0709 12:10:47.180728 (+396879us) write_op.cc:301] APPLY: starting
0709 12:10:47.187070 (+  6342us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:47.237334 (+ 50264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:47.242351 (+  5017us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:47.395483 (+153132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:47.418702 (+ 23219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:47.422781 (+  4079us) write_op.cc:312] APPLY: finished
0709 12:10:47.432304 (+  9523us) log.cc:844] Serialized 29 byte log entry
0709 12:10:47.463628 (+ 31324us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:47.463772 (+   144us) write_op.cc:454] Released schema lock
0709 12:10:47.463839 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:47.464362 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:47.464406 (+    44us) write_op.cc:454] Released schema lock
0709 12:10:47.987108 (+522702us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
Metrics: {"mutex_wait_us":1831,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":318359,"apply.run_cpu_time_us":7187,"apply.run_wall_time_us":303573,"num_ops":2,"prepare.queue_time_us":224921,"prepare.run_cpu_time_us":10312,"prepare.run_wall_time_us":176950,"raft.queue_time_us":749149,"raft.run_cpu_time_us":14235,"raft.run_wall_time_us":425934,"replication_time_us":2330914,"spinlock_wait_cycles":109369088,"thread_start_us":680644,"threads_started":5,"wal-append.queue_time_us":372992,"wal-append.run_cpu_time_us":44950,"wal-append.run_wall_time_us":3707669}]]}
I20260709 12:10:49.393832 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:49.394238 11940 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:49.373849 14883 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.394763 11769 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.397779 14883 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.398125 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.359063 15022 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.402029 15104 ts_tablet_manager.cc:933] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:49.402525 12608 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:49.380534 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:49.401701 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:49.406231 15090 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:49.405010 11769 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 5 to 7, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 4 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:49.411446 15017 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.378361 15004 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.412281 15004 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.412659 15004 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:49.415853 11988 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.045s (SENT)
I20260709 12:10:49.384332 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:49.422799 11939 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.423830 11944 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:49.380242 15005 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.426738 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.430573 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:49.430519 15101 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.434448 15101 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.434585 15022 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:49.434880 15101 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.434063 14904 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.435914 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:49.437775 14922 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.438195 14922 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.438527 14922 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.439956 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:49.441817 14904 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:49.442543 14904 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.444478 15100 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:49.446013 15094 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:49.445802 15079 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.446751 15079 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:49.447093 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.447889 15090 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.447698 15079 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.447821 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1712) took 1217 ms. Trace:
I20260709 12:10:49.448628 14879 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.444988 14883 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.452584 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.453015 12607 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:49.454356 14879 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.449982 11945 rpcz_store.cc:276] 0709 12:10:48.230351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.240642 (+ 10291us) service_pool.cc:224] Handling call
0709 12:10:48.272919 (+ 32277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.618654 (+345735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.618692 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.705654 (+ 86962us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.151451 (+445797us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.151492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.154290 (+  2798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.447528 (+293238us) raft_consensus.cc:1685] finished
0709 12:10:49.447551 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.447747 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284814,"raft.queue_time_us":314692,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":14346,"thread_start_us":443955,"threads_started":1,"wal-append.queue_time_us":597606}
I20260709 12:10:49.455075 14883 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:49.466939 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51171.2us
W20260709 12:10:49.468187 11988 leader_election.cc:336] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.979s (SENT)
I20260709 12:10:49.459039 15090 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.461802 15017 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.472615 11837 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:49.473048 11837 leader_election.cc:403] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:49.417907 15036 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.473652 15017 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.466406 15079 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.492913 15022 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.498498 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.500268 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.502041 12013 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:49.493671 15104 tablet_copy_client.cc:323] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
W20260709 12:10:49.509838 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57425.9us
I20260709 12:10:49.510860 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.513758 15049 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.514552 15036 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:49.518303 15005 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.519618 11946 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:49.521667 15022 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.521310 15101 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.524000 15022 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:49.524247 15005 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.524427 15101 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.527446 15004 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.529220 15004 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:49.530247 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.532840 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.537271 11939 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:49.541110 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.544404 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:49.545003 14879 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.563251 14879 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:49.563666 14879 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.565711 15049 raft_consensus.cc:2764] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:49.570215 14978 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.570715 14978 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:49.571102 14978 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.546464 14922 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.551405 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.574558 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.575080 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:49.575615 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:49.575934 12013 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.551680 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.552773 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.553807 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.554847 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.555840 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.581708 12020 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:49.556155 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.582957 12017 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:49.557466 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.558166 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.558370 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:49.560899 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.534394 15017 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:49.585610 12014 raft_consensus.cc:2410] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:49.586897 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.587513 12016 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:49.588040 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:49.589067 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:49.590718 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49699.8us
I20260709 12:10:49.591677 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.591769 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.592840 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.593462 12021 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:49.592332 12022 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:49.594314 12017 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 3: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:10:49.594930 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.594815 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.597138 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:49.597908 12015 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:49.600380 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:49.600749 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:49.603986 12019 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:49.606092 12016 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:49.608425 12013 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:49.614086 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:49.614888 12013 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.615562 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:49.618072 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet cbba5e6f295144a79461c5afc2e273ae from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:10:49.618860 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet cbba5e6f295144a79461c5afc2e273ae from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-cbba5e6f295144a79461c5afc2e273ae
I20260709 12:10:49.622196 15036 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:49.625463 12013 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
W20260709 12:10:49.634145 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 198350us
I20260709 12:10:49.637941 15112 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.646227 14922 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:49.646967 11939 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:49.654251 12607 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:49.650244 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:49.981235 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 331134us
I20260709 12:10:49.981419 15112 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.982120 15112 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.982187 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:49.982554 15112 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:49.656368 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.013362 11958 tablet_copy_source_session.cc:215] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:10:49.854112 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.903292 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 293855us
I20260709 12:10:50.015668 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.017069 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:49.933645 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 317780us
I20260709 12:10:50.018188 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:50.019721 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:10:49.977087 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.025063 15116 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:50.002081 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.704991 14879 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.128916 14879 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.129812 12610 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.131377 15121 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.717514 14978 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:49.649094 15101 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:49.985239 14904 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.179046 14904 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:50.180284 14904 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:49.972707 15046 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.183305 15046 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:50.005219 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 352746us
I20260709 12:10:49.998631 15112 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.191061 15112 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:50.013643 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.028031 15116 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.193979 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet e3e68fbb001a46d6af7bd0fc3e94e9ec with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:49.983609 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:50.195524 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 211974us
I20260709 12:10:50.196288 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.031144 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:50.197968 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 166899us
I20260709 12:10:50.198189 15100 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.198777 15100 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:50.199209 15100 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.201817 15101 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.202761 15101 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.203101 15101 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.203426 15101 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.034008 11942 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.036181 12016 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:50.042758 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.050674 14689 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:50.054055 15119 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.057358 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.209039 15004 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.209792 14922 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.058629 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.210595 14922 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.210861 11870 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:50.212271 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.212810 14922 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.212886 11870 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
I20260709 12:10:50.062733 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.221524 11873 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:50.221827 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.222536 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.223277 11873 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:50.223866 15104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbba5e6f295144a79461c5afc2e273ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:50.224166 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.224807 11873 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:50.064034 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.064956 11871 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:50.225986 11867 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:50.066588 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.227051 11865 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.067632 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.229907 11872 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.068662 15049 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.093079 14883 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.233462 14883 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.235450 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:50.123489 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.136670 14978 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.138063 12609 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:50.132273 15121 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.209851 11868 raft_consensus.cc:2376] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7. Re-sending same reply.
I20260709 12:10:50.244263 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.210259 15004 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.210810 15022 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:50.060567 11869 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:50.061676 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.248355 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.248868 11866 raft_consensus.cc:1813] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:50.213956 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:50.060317 11864 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:50.214766 14689 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.205838 15116 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.216048 14922 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.205984 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:50.219035 15101 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.265780 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.266680 11867 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:50.240801 15046 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.230760 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:50.217259 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.222543 11870 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.235821 14883 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.121292 15017 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:50.271351 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.251299 11866 raft_consensus.cc:2368] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:10:50.249184 11868 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.272710 11864 raft_consensus.cc:2376] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8. Re-sending same reply.
I20260709 12:10:50.274590 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.275708 11867 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:50.275624 15125 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:50.277072 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.270494 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.278314 11869 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:50.279345 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.280197 15125 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.265445 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 121) took 3046 ms. Trace:
I20260709 12:10:50.240352 11872 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:50.263075 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:50.230758 12577 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.638s (SENT)
I20260709 12:10:50.283934 11873 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:50.284421 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:50.285233 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.285562 15046 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.285992 11873 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:50.286574 11867 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:50.287621 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.288056 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:50.285835 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55114us
I20260709 12:10:50.280864 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.291255 11869 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:50.289312 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.292542 11873 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.293112 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.313632 11870 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:50.281812 11769 rpcz_store.cc:276] 0709 12:10:47.223257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.235815 (+ 12558us) service_pool.cc:224] Handling call
0709 12:10:50.261951 (+3026136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:49.489844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:49.510368 (+ 20524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:49.510419 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:10:49.510439 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:49.511640 (+  1201us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:49.511746 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:49.511785 (+    39us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:49.513094 (+  1309us) tablet.cc:701] Row locks acquired
0709 12:10:49.513145 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:49.513356 (+   211us) write_op.cc:270] Start()
0709 12:10:49.513518 (+   162us) write_op.cc:276] Timestamp: P: 1783599049513284 usec, L: 0
0709 12:10:49.521432 (+  7914us) op_driver.cc:348] REPLICATION: starting
0709 12:10:49.522232 (+   800us) log.cc:844] Serialized 5133 byte log entry
0709 12:10:49.713595 (+191363us) op_driver.cc:464] REPLICATION: finished
0709 12:10:49.719827 (+  6232us) write_op.cc:301] APPLY: starting
0709 12:10:49.719908 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:49.720136 (+   228us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:49.720258 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:49.725848 (+  5590us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:49.726301 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:49.726370 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:49.726965 (+   595us) log.cc:844] Serialized 95 byte log entry
0709 12:10:49.728137 (+  1172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:49.728348 (+   211us) write_op.cc:454] Released schema lock
0709 12:10:49.728448 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:49.729028 (+   580us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:49.729066 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1211704,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":5934,"apply.run_cpu_time_us":8246,"apply.run_wall_time_us":9140,"num_ops":13,"prepare.queue_time_us":28844,"prepare.run_cpu_time_us":36529,"prepare.run_wall_time_us":165764,"raft.queue_time_us":87343,"raft.run_cpu_time_us":4518,"raft.run_wall_time_us":8312,"replication_time_us":191739,"thread_start_us":207253,"threads_started":4,"wal-append.queue_time_us":96717}]]}
I20260709 12:10:50.314041 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.247781 15004 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.314556 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.315784 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.316452 11870 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:50.317159 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.295636 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:50.269781 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 81084.9us
I20260709 12:10:50.243778 15100 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.318146 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.298163 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.318579 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.318961 11867 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:10:50.294486 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79898.3us
I20260709 12:10:50.300750 14978 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.298163 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.327701 11873 raft_consensus.cc:2410] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:50.327919 11866 raft_consensus.cc:2376] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7. Re-sending same reply.
I20260709 12:10:50.302156 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:50.328783 11939 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:50.305792 15005 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.308854 11868 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:50.308012 12610 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:50.329515 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 124017us
I20260709 12:10:50.314183 11869 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:10:50.318212 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.319490 15100 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.264433 14922 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:50.299055 14879 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.326083 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet b93a2cf326204d8e89e4fe76ead348c5 with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56154
I20260709 12:10:50.326201 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet e3e68fbb001a46d6af7bd0fc3e94e9ec (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:10:50.366102 15126 tablet_replica.cc:333] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:10:50.327163 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.367071 11867 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:50.368175 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.269781 15119 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.369839 15119 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.328713 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.330041 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.372014 11868 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:50.330202 11870 raft_consensus.cc:1813] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:50.312858 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.258158 15049 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.374316 11873 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:50.319511 11864 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:50.328078 15017 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.333035 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:50.333312 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.333035 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:50.343107 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.343753 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.346256 15036 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.341668 14689 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.347694 11770 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 5 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.350385 14922 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.351028 11865 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:50.352813 15101 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.376840 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.359040 15121 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.338775 15005 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:50.388302 11868 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.388736 14922 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.389154 15005 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.390484 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:50.280952 15125 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:50.317242 15004 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:50.373580 11872 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:50.373582 11870 raft_consensus.cc:2410] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:50.331058 11871 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:50.376391 11939 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.427738 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.422420 11865 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:50.378499 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.379313 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:50.451618 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 72386.3us
I20260709 12:10:50.384078 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:50.455849 11868 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:10:50.385083 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.379853 11869 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:50.393268 11770 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.376093 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.463999 11867 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:50.464531 11864 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.465731 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 84308.8us
I20260709 12:10:50.467154 11866 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:50.467459 11870 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.384336 15036 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.468899 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.377749 15126 raft_consensus.cc:2243] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:50.469791 11871 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:50.377250 15046 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.473862 11873 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:10:50.474145 11872 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:50.378162 15017 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:50.472692 15036 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.475358 15046 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.380048 15119 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.478361 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:50.466498 15079 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.372520 14883 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:10:50.390384 15049 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.488116 11770 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.468405 15127 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.475461 14950 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.468302 14962 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:10:50.375180 15116 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.500823 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.493058 15079 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.512655 11939 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:50.523209 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:50.503700 14950 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.503239 15127 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.525381 14950 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.526010 15130 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.529949 15130 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.530405 15130 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.531860 15125 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.525792 11770 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:50.534886 11770 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:50.537420 15126 raft_consensus.cc:2272] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:50.525882 15046 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.524309 15022 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.542061 15046 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.509994 15101 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.536834 11770 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.544416 15127 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.521831 15079 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.549665 11864 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
W20260709 12:10:50.547518 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69241.8us
I20260709 12:10:50.550572 11770 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 3 to 4, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:50.562992 15049 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:50.574101 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.564802 11770 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 2 to 3, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.545850 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 184408us
I20260709 12:10:50.581756 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:50.548699 15101 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.573897 15126 ts_tablet_manager.cc:1916] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:50.586136 11770 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.595894 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72774.1us
I20260709 12:10:50.596761 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.588557 15101 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.601743 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.610549 11770 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:50.617954 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 113191us
I20260709 12:10:50.617769 11770 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 5, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:50.620347 11939 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:50.626494 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.605252 15022 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.630528 15022 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.630956 15022 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.632230 14922 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:50.632750 14922 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:50.610067 15116 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.633718 14922 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.635035 14922 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.635115 15130 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.639469 11770 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:50.663990 14689 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:50.666342 14950 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.647209 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:50.669448 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 50213.4us
I20260709 12:10:50.685403 15144 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:50.685974 11770 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 6 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:50.687182 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.707s (SENT)
I20260709 12:10:50.687701 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.687462 11770 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:10:50.688562 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59118.9us
I20260709 12:10:50.637671 15130 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:50.693141 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62989.9us
W20260709 12:10:50.687129 15142 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:50.696282 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:50.702139 12019 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.390992 14904 consensus_queue.cc:1175] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "189a165e6619406382914fe3075dd436" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:50.696696 15049 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.705765 12016 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:50.698192 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.699713 15036 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.692458 15129 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.700629 14950 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.694531 15127 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.699776 15022 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.719301 15127 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.720291 15022 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.721323 15129 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:50.722478 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.722410 15129 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.723343 15143 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:50.723096 15101 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.723958 15143 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.713074 14689 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.726413 15143 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.726941 14689 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.724566 15135 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:50.714576 12019 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:50.690649 15140 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:50.738576 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49300.8us
I20260709 12:10:50.740099 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.741688 15148 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:50.742187 15137 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:50.742250 15148 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.756265 15148 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.758888 15138 raft_consensus.cc:993] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:50.760013 15004 raft_consensus.cc:1081] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:10:50.762827 11988 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:50.774241 11988 raft_consensus.cc:2686] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:50.734040 15135 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.770675 15104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41000 (request call id 780) took 1766 ms. Trace:
I20260709 12:10:50.771339 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.771783 15036 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.734654 15140 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.783331 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:50.784029 11839 leader_election.cc:336] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.954s (SENT)
I20260709 12:10:50.784189 11939 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.784526 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:50.778062 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.779712 11869 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.782169 15140 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.783221 15135 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.789883 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:50.790886 12610 raft_consensus.cc:2410] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:50.791606 15125 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.795240 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:50.802549 12607 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.807432 15148 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.798038 15049 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.816882 15079 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:50.823544 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 233555us
I20260709 12:10:50.792083 15125 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.801422 15139 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.835992 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:50.863097 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.847818 11939 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:10:50.865710 11869 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:50.813035 15036 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:50.780046 15104 rpcz_store.cc:276] 0709 12:10:49.012842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.013111 (+   269us) service_pool.cc:224] Handling call
0709 12:10:49.402388 (+389277us) ts_tablet_manager.cc:934] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
0709 12:10:50.219238 (+816850us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:50.383169 (+163931us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:50.383307 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:50.769795 (+386488us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:50.770154 (+   359us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:50.770502 (+   348us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:50.770572 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":36768,"tablet-copy.queue_time_us":358775,"thread_start_us":361137,"threads_started":2}
I20260709 12:10:50.865444 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:50.860296 15125 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.851655 15116 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.868038 12609 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.866596 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.851241 15101 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:50.845371 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61338.7us
I20260709 12:10:50.863850 15139 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.852356 15017 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:50.918870 15017 consensus_queue.cc:1243] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:50.919567 15049 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.920011 15049 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:50.920898 15049 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.890719 15128 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.922140 15128 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:50.922914 15128 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.923120 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.923849 11869 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.922288 15049 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.909476 15079 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:50.914175 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:50.915035 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.914757 15139 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.917634 15148 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.887207 14689 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.881958 15147 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.930390 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:50.936071 11864 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.935382 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:10:50.937093 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:50.922263 15127 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:10:50.945194 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 109313us
I20260709 12:10:50.932984 15104 tablet_copy_client.cc:806] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:50.881968 15116 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.959491 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:50.960264 15116 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:50.949338 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.963198 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:50.963929 11939 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:50.965767 15144 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.966194 15144 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:50.966543 15144 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.969369 15104 tablet_copy_client.cc:670] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:50.971223 15147 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:50.972066 15125 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.974270 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:50.949201 11864 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:10:50.952965 15138 raft_consensus.cc:2764] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:10:50.939792 14689 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:50.986294 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:50.990780 11839 leader_election.cc:336] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.169s (SENT)
I20260709 12:10:50.992894 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:50.992512 14689 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:50.993848 15022 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:50.994426 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:50.994478 15022 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.995236 15129 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.995842 15129 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:50.990465 14962 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.998826 14962 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.999401 14962 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.997481 15022 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.002079 15101 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.002911 15101 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.003608 15101 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:51.004109 12632 debug-util.cc:398] Leaking SignalData structure 0x7b080027bc20 after lost signal to thread 10700
W20260709 12:10:51.005640 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800288f80 after lost signal to thread 11805
W20260709 12:10:51.006048 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800281e40 after lost signal to thread 11819
W20260709 12:10:51.007647 12632 debug-util.cc:398] Leaking SignalData structure 0x7b08002e43a0 after lost signal to thread 11897
W20260709 12:10:51.008409 11839 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.212s (SENT)
W20260709 12:10:51.009608 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800153c80 after lost signal to thread 11972
W20260709 12:10:51.009929 12632 debug-util.cc:398] Leaking SignalData structure 0x7b080036d4e0 after lost signal to thread 11973
I20260709 12:10:51.010327 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:51.011142 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800234520 after lost signal to thread 12046
W20260709 12:10:51.011478 12632 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0b20 after lost signal to thread 12047
W20260709 12:10:51.012820 12632 debug-util.cc:398] Leaking SignalData structure 0x7b08003a51e0 after lost signal to thread 12635
I20260709 12:10:50.991035 15148 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.015998 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:50.989984 15036 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.018957 11939 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.026569 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:51.039484 15155 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:51.039883 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.040628 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.040732 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.050407 11943 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.051031 11944 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.020141 15127 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.051733 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.006889 15158 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:51.046629 11988 connection.cc:256] RPC call timeout handler was delayed by -1.6418570040000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
I20260709 12:10:51.042820 11947 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.052587 11939 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:50.988833 15140 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:50.997121 15129 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:51.054924 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49988.4us
W20260709 12:10:51.056505 11839 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.226s (SENT)
I20260709 12:10:51.053995 15158 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:51.018361 15148 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.061035 15127 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:51.064324 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.069307 11941 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.067730 15127 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.076366 15126 ts_tablet_manager.cc:1929] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:10:51.076550 15140 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.077010 15126 log.cc:1199] T b93a2cf326204d8e89e4fe76ead348c5 P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/b93a2cf326204d8e89e4fe76ead348c5
I20260709 12:10:51.088697 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.093636 11939 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:51.096658 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.115864 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59372.2us
I20260709 12:10:51.077827 15148 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.117477 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:51.130815 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76502.6us
I20260709 12:10:51.109901 15129 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.131464 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.134970 11864 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:51.132575 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.132930 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.121090 15104 tablet_copy_client.cc:538] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:51.138526 14978 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.140566 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.142695 15101 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.143187 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.132736 11865 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:51.143980 11947 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.144424 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.144791 15101 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.145376 15101 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:51.077596 15144 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.145812 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.148466 14950 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:51.150336 11988 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.892s (SENT)
I20260709 12:10:51.126019 15125 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.151960 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.156196 15112 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.156720 15112 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:51.157179 15112 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.157564 15017 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:51.158272 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet b93a2cf326204d8e89e4fe76ead348c5 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:10:51.158144 15017 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.160907 15017 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.168571 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.145833 14978 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:51.145841 15101 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.174331 11940 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:51.175554 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.176923 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.178743 14883 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.181710 11941 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:51.183507 15017 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:51.186728 15147 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.190017 15017 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:51.193940 14962 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.196156 14962 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.169808 15004 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.198181 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:51.202697 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.091s (SENT)
I20260709 12:10:51.206122 15144 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.216600 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:51.237628 14978 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:51.238404 11988 connection.cc:256] RPC call timeout handler was delayed by -1.4419908949998899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:10:51.239477 11988 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.779s (SENT)
I20260709 12:10:51.239856 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.240721 15129 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:51.240870 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.241416 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2610908949998247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 12:10:51.242419 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2493908949998058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:10:51.242756 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2259908949999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:10:51.243048 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2079908949999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:10:51.243319 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0360908949999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 12:10:51.243577 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0117908949998764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 12:10:51.244949 12016 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.245298 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.245941 12013 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:51.202095 15005 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.199898 14883 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:51.245962 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.252972 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.256182 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.241514 15004 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.259613 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.260383 12019 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:51.261229 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.263844 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.264416 12019 raft_consensus.cc:2376] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7. Re-sending same reply.
I20260709 12:10:51.217723 15049 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.270553 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.259296 12020 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:10:51.265185 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.279184 11864 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:51.279774 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101761us
I20260709 12:10:51.282553 12014 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:51.282586 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.283533 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.263067 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.284945 12022 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.281126 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.286666 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.286830 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.287281 11864 raft_consensus.cc:2368] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:51.287331 11868 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.288717 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.289429 11864 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.287489 12019 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.292476 12018 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.284304 12017 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:51.262740 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.293514 12015 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:51.294028 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.294782 12019 raft_consensus.cc:2368] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:51.295538 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.155227 15158 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.301108 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.302804 11867 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.295765 11865 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:51.306183 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.306316 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.306272 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.307518 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.305593 11864 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.309069 11869 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:51.309746 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.311067 11864 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.311786 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.312891 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.317395 11868 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.318621 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.319271 11868 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:51.321941 12022 raft_consensus.cc:2368] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:51.322265 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.282235 14904 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.324362 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.329707 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.329908 12014 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:51.330657 11871 raft_consensus.cc:2410] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:51.322515 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.330776 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.328850 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.332386 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.332415 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.333031 12020 raft_consensus.cc:2376] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7. Re-sending same reply.
I20260709 12:10:51.297760 14922 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.333263 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.339133 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.334292 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.333127 11864 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.340149 11865 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.340227 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.335446 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.339049 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.258132 15128 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.343734 11867 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:51.334396 11866 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.345487 12017 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:51.345366 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.346153 11871 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.346191 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.346854 12018 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:10:51.348388 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.348955 12020 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:51.265810 15049 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.349455 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.350827 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.356927 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.357252 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.337852 15174 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.407315 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.407701 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.407967 11944 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.358170 12015 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.358839 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:51.373086 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.377780 11865 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:51.378305 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.379631 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.410074 12020 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.383880 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:51.333721 15005 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:51.385380 11870 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.386269 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.410519 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.411342 12017 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.387164 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.387950 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.411455 12022 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.412833 11941 raft_consensus.cc:2368] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:51.388780 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.389729 12014 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.413663 12021 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:10:51.400741 15128 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.403484 11947 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:10:51.403656 15104 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:10:51.406047 15112 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.406299 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.411383 11865 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:10:51.395081 15170 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:10:51.429589 15004 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:51.374166 14883 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.438341 15172 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.438748 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.439045 15172 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.414451 12013 raft_consensus.cc:2410] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:51.416790 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:51.440783 11939 raft_consensus.cc:606] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.420253 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.441586 11864 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.443650 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.419925 12017 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:51.444394 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.432608 11869 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.429143 12016 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.445570 12015 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.437968 15004 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:51.452585 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.458510 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.460853 12021 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.458663 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:51.430277 11871 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:51.464510 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:51.465444 11871 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.466904 11864 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
W20260709 12:10:51.477955 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.471025 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.482903 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.483770 12018 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.491119 12609 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.491991 12020 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:10:51.495357 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 111619us
I20260709 12:10:51.500044 12022 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.470741 15036 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:51.501526 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.430581 15005 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.515936 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.512061 12020 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.504741 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.525921 15140 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:51.526999 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.527925 15129 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.500528 15138 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.541673 14904 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.542294 14904 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.543254 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:51.544193 11939 raft_consensus.cc:606] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.544538 14904 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:51.544647 11939 raft_consensus.cc:614] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.545791 15135 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.500885 15143 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:51.548334 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:51.530880 15127 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:51.557096 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:51.546437 15135 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.422168 15174 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.567667 11871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:10:51.568229 11871 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:51.568571 11871 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.569573 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.570760 11939 raft_consensus.cc:2368] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7.
I20260709 12:10:51.573051 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:51.574270 11939 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.574802 11939 raft_consensus.cc:614] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.578733 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4755afb6a253477badd7f673bff77faa"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:51.579311 11947 raft_consensus.cc:606] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:51.579685 15049 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.583055 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:51.583673 11947 raft_consensus.cc:606] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:51.585008 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:51.505519 15036 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:51.586997 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.588995 12020 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:51.589761 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.597961 11868 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:51.598963 11943 raft_consensus.cc:2368] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:51.602977 11939 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.605468 11988 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:51.606076 11988 leader_election.cc:403] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:51.608951 12609 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:51.567342 15005 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.617043 11943 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 7. Ops: []
I20260709 12:10:51.540153 14978 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:10:51.618449 15128 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4.
I20260709 12:10:51.618847 14922 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:51.620375 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.620687 15112 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.621956 11940 raft_consensus.cc:1217] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:10:51.598600 15036 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:51.635190 11839 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.960s (SENT)
I20260709 12:10:51.622958 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.631177 15148 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.635589 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.635839 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:51.634608 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 123414us
I20260709 12:10:51.636907 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:51.643474 12020 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.638494 11944 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:51.638517 11940 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:51.648620 11943 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.650103 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:51.651047 12017 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:51.657667 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.656358 11943 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:51.653234 11871 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.661345 11864 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.663399 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.664597 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.668044 15116 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:51.670784 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.672771 12019 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:51.640861 14922 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.674670 12020 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:51.678833 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.679302 11871 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:51.650830 15129 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.681237 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:51.681887 12610 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.682199 12017 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.685717 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:51.679898 15140 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.690361 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:51.703665 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.704658 11943 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.674233 15125 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:10:51.706028 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70879.2us
W20260709 12:10:51.709417 15171 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.323s	user 0.000s	sys 0.004s
I20260709 12:10:51.683727 15130 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.712028 15148 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:51.712569 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.713594 11945 raft_consensus.cc:2410] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:51.713485 15174 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.715413 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.715624 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.716107 11946 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:51.716399 11945 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.672401 15128 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:51.718758 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:51.719998 15101 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:10:51.720026 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.720608 15101 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.721763 15125 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.721928 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:51.722254 15125 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.722654 11941 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:51.724903 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.725802 11946 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:51.725872 11942 raft_consensus.cc:2368] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:51.727358 11871 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:10:51.728075 11946 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:51.728427 15140 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:51.728790 11871 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:51.728963 15140 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.729270 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.721213 14922 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.732753 11871 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:51.735920 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.622s (SENT) [suppressed 46 similar messages]
I20260709 12:10:51.733995 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.739852 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:51.740731 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.742240 11940 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:51.742375 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.743659 11871 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.777698 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.778422 11944 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:51.780331 11939 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.782899 11871 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.785230 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:51.785753 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115723us
I20260709 12:10:51.788292 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.777745 15127 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.824361 11943 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:51.818892 15116 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:51.833873 15116 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:51.841460 12610 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:51.827147 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.852466 12013 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:51.856868 11943 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.863672 11943 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.822459 15046 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:51.869751 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.880744 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.860622 15101 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.889031 11943 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:51.889844 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.891067 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.857307 15169 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:51.871400 15129 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:51.897451 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.880870 14922 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:51.899171 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 208835us
I20260709 12:10:51.888233 15135 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:51.902443 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.904153 11943 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:51.907873 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.908906 11943 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:51.911154 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.912869 15194 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:51.913895 15197 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:51.904515 14950 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:51.900247 14689 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:10:51.910987 15198 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:51.911998 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:51.922884 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:51.924896 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.926081 11912 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:51.914244 15186 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:51.910269 15135 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:51.998310 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.134886 11944 raft_consensus.cc:2368] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:52.135612 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.015054 15184 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.008296 15140 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:51.958112 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.136788 15036 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.139703 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:51.955644 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.934773 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.071568 15125 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:51.946367 11871 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:52.138286 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:52.135318 11839 leader_election.cc:336] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.525s (SENT)
I20260709 12:10:52.094103 14950 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.934126 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:52.111248 15188 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.231s	user 0.001s	sys 0.001s
I20260709 12:10:52.133298 15172 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:52.136385 15184 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.147186 11947 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:51.980331 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.160610 11945 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:52.159101 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.939914 15198 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.165429 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.165158 11946 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:52.166235 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.167387 11944 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:52.167567 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.168303 11947 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:52.169085 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:51.934762 15101 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.170500 12017 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:52.169337 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.168270 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.175582 11947 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:52.177292 11946 raft_consensus.cc:2368] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:51.962015 15201 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 12:10:52.158963 15202 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.183151 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.166884 15198 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:52.185627 11945 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:52.176643 15101 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.186887 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.187841 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.189525 11944 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.163085 14950 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.189970 11944 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.191483 14950 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:52.194121 15148 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.002279 15129 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.196830 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:52.199939 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.205849 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45687.3us
I20260709 12:10:52.207952 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.209403 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:52.188879 15198 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.191013 11944 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.194139 15022 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:52.235535 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:52.230254 15125 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:52.193305 15101 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.233193 12609 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.216459 15202 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:52.229032 11988 leader_election.cc:400] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:52.241019 11988 leader_election.cc:403] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.241869 11944 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.242511 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:52.243186 11870 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:52.235888 14950 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:10:52.233987 15140 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:52.248021 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:52.262238 11871 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.248648 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:52.250662 15036 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:52.252069 14689 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:52.259119 15172 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.275473 11867 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:52.275722 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.279515 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.282766 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:52.289222 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 103251us
W20260709 12:10:52.290028 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.290941 11871 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:10:52.284044 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55149.6us
I20260709 12:10:52.293830 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1695) took 1002 ms. Trace:
I20260709 12:10:52.293478 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:52.268262 15125 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:10:52.309978 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:52.312654 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.294358 11873 rpcz_store.cc:276] 0709 12:10:51.291571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.480472 (+188901us) service_pool.cc:224] Handling call
0709 12:10:51.482361 (+  1889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.918253 (+435892us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b1800127960. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba2bbfb 00007f1f1ba3664b
0709 12:10:51.918516 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.918555 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.919127 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.069499 (+150372us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:52.110862 (+ 41363us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.281526 (+170664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.281636 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.281691 (+    55us) raft_consensus.cc:1685] finished
0709 12:10:52.293509 (+ 11818us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.293748 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160571,"prepare.queue_time_us":37392,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":23645,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":22785,"spinlock_wait_cycles":95057792,"thread_start_us":200147,"threads_started":2,"wal-append.queue_time_us":312857}
I20260709 12:10:52.320618 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.321128 11944 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:52.325340 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.293004 14922 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:52.307503 15181 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.878s	user 0.000s	sys 0.004s
W20260709 12:10:52.311432 15208 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:52.311651 15140 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.274554 15172 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.351058 15221 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.351295 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.347653 15140 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:52.355504 15140 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.356047 15175 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.918s	user 0.004s	sys 0.000s
I20260709 12:10:52.358412 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:52.359604 11839 leader_election.cc:336] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.525s (SENT)
I20260709 12:10:52.361011 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:52.362203 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46211.1us
I20260709 12:10:52.363256 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:52.368585 15219 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.374871 15125 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.375016 15219 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.375495 15219 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.375530 15125 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:52.379002 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2093) took 1046 ms. Trace:
I20260709 12:10:52.379418 11868 rpcz_store.cc:276] 0709 12:10:51.332092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.599177 (+267085us) service_pool.cc:224] Handling call
0709 12:10:51.599575 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.617878 (+ 18303us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:51.825791 (+207913us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.138883 (+313092us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800417ca0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d323a 00007f1f1ba3da2a
0709 12:10:52.258176 (+119293us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.319226 (+ 61050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.332281 (+ 13055us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.332532 (+   251us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:52.332586 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.332685 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.378731 (+ 46046us) raft_consensus.cc:1685] finished
0709 12:10:52.378756 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.378931 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89770,"prepare.queue_time_us":254700,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2890,"raft.queue_time_us":120160,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":32179,"spinlock_wait_cycles":5678976,"thread_start_us":266062,"threads_started":3,"wal-append.queue_time_us":369623}
I20260709 12:10:52.376857 15125 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.358295 15129 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.383175 15184 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:52.384903 15172 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:52.387027 14922 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.388000 14922 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:52.392656 15104 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:10:52.396286 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:52.400928 11864 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:52.409873 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:52.411639 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.412344 12014 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:52.413079 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:52.414222 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.416960 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:52.424028 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:52.425863 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.426663 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:52.401521 15184 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.432054 12013 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.434554 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.435827 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:52.439154 11942 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:52.443185 11944 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.444357 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.445113 11939 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.446846 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.447562 11941 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.455327 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.457052 12014 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:52.458150 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:52.483090 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 129653us
I20260709 12:10:52.484742 11942 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:52.490136 15223 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.491655 15147 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.492147 15147 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.482838 15216 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:52.493331 15147 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.494603 15223 raft_consensus.cc:993] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:10:52.495059 15147 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.495314 15223 raft_consensus.cc:1081] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:10:52.446976 15036 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:52.497841 15036 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:52.498030 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.438750 15129 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.500043 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.507767 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.503329 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:52.513693 11941 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:10:52.519359 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 76701.4us
I20260709 12:10:52.523643 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.525619 11839 leader_election.cc:400] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:52.525990 11839 leader_election.cc:403] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.529220 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.503933 15104 tablet_bootstrap.cc:492] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:10:52.542508 11944 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:52.450028 15198 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.542308 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.505352 15223 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.503362 15036 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.549666 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.553344 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.498147 15101 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.550457 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.530634 11939 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:52.537848 15148 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.571506 12021 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.538844 15079 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.548087 15022 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.573855 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.538414 15184 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:52.578485 11939 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.551721 15220 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.582003 11943 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:52.582702 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.586760 15220 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.587515 15220 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.588862 15220 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.581861 11941 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:52.568612 15202 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.553953 15129 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.537928 15218 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:52.579309 15104 ts_tablet_manager.cc:1403] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.176s	user 0.042s	sys 0.013s
I20260709 12:10:52.596298 11939 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:52.571384 15223 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.600972 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:52.578657 15079 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.595435 15200 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:10:52.609018 15217 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:10:52.582671 15127 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.618618 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 93182.9us
I20260709 12:10:52.620492 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.622371 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:52.593787 15224 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:52.612648 15079 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:52.628633 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.566633 15138 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:52.631090 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2097) took 1237 ms. Trace:
I20260709 12:10:52.643900 11872 rpcz_store.cc:276] 0709 12:10:51.393355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.714945 (+321590us) service_pool.cc:224] Handling call
0709 12:10:51.715453 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.715864 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:51.786029 (+ 70165us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.882463 (+ 96434us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.083649 (+201186us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18004378c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:52.471818 (+388169us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18004378c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a
0709 12:10:52.486054 (+ 14236us) log.cc:844] Serialized 506 byte log entry
0709 12:10:52.486277 (+   223us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:52.486303 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.486356 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.630770 (+144414us) raft_consensus.cc:1685] finished
0709 12:10:52.630800 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.631002 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181221,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":883,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5909,"spinlock_wait_cycles":9990400,"thread_start_us":124559,"threads_started":2,"wal-append.queue_time_us":110172}
I20260709 12:10:52.630542 15202 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:52.672437 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48313.3us
I20260709 12:10:52.625025 15127 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.626200 15227 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.595505 15229 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:10:52.626253 15193 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:52.684633 15202 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:52.741657 15232 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:52.742110 15202 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:52.734177 15226 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:52.734534 15022 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:52.735522 15140 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.765023 15140 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:52.739880 15198 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:52.631021 15223 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.765758 15233 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.766332 15233 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:52.740955 15101 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:52.767288 15233 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.684779 15128 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:52.755183 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:52.771446 11942 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:52.765465 15036 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:52.769375 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 216069us
I20260709 12:10:52.751286 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.775100 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.781996 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:52.795346 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.795917 11942 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:52.769662 15216 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.800998 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:52.806015 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 632) took 1125 ms. Trace:
I20260709 12:10:52.810488 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.798329 15036 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:52.811823 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:52.789515 15112 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.786274 15116 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.807314 12017 rpcz_store.cc:276] 0709 12:10:51.680863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.687548 (+  6685us) service_pool.cc:224] Handling call
0709 12:10:51.689508 (+  1960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.172546 (+483038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.805789 (+633243us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54000b6154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:52.805955 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105569664}
I20260709 12:10:52.816692 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:52.817251 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 196831us
I20260709 12:10:52.795192 15128 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:52.823227 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:52.828043 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.804307 15174 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.846448 15174 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.846920 15174 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.850884 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:52.806699 15216 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.834388 15211 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:52.840173 15158 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.840329 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:52.841077 14922 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.851985 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:52.818184 15138 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.859447 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:52.799117 15143 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:52.826597 15112 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.882763 15112 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.883020 15127 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:52.883867 15138 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.885145 15138 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.873670 15220 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.875061 15222 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:10:52.875898 15241 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.882212 15143 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.886857 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.861711 15139 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:52.833395 15128 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:52.851804 15147 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.857406 15104 raft_consensus.cc:359] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.857088 15216 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:52.896366 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 83588us
I20260709 12:10:52.873253 15184 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:52.900244 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 212560us
I20260709 12:10:52.902330 15116 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.924049 15104 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:10:52.924492 15079 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.921375 15101 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.925032 15104 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:10:52.923189 15219 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.004s
I20260709 12:10:52.900985 15241 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:52.951220 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.901072 15143 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:52.956303 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.953935 14922 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:52.963573 15227 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.964028 15227 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:52.964138 15143 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:52.965744 15143 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.966229 15248 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:52.967792 15239 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.968410 15239 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:52.931820 15184 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:52.958205 15036 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.962590 15079 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:52.949215 15211 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:52.954701 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67942.5us
I20260709 12:10:52.978513 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:52.974651 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 146836us
I20260709 12:10:52.974048 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.962908 15240 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:10:52.986423 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 163254us
I20260709 12:10:52.987421 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.989902 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.993925 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:52.957015 15127 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:10:52.992411 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:52.977802 15211 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:52.981684 15125 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:52.964942 15227 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.981626 15172 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.001569 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.001446 15240 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:53.000943 15223 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:53.012354 15223 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:53.012705 11839 leader_election.cc:400] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:53.013181 11839 leader_election.cc:403] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.955384 15219 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.013336 15223 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.015549 15219 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.016762 15172 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.004638 15243 raft_consensus.cc:2764] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:53.002445 15220 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:53.004823 15255 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.006112 15104 ts_tablet_manager.cc:1434] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.400s	user 0.009s	sys 0.002s
I20260709 12:10:53.006546 15257 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.007612 15127 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:53.008554 15184 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:52.985852 15128 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.009939 15227 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.004124 15125 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:53.035508 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:52.991915 15036 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:53.047258 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47285.1us
I20260709 12:10:52.996294 15202 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.053419 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:53.028146 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.028990 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.030458 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.032948 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:53.028903 15172 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:53.035048 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.035737 11948 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.036525 12013 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:53.056524 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.057116 12022 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:53.045851 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.020339 15255 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:53.050732 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.051633 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:53.026283 11839 leader_election.cc:400] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:53.068367 11839 leader_election.cc:403] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.042490 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.053300 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:53.061053 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:53.025828 15127 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:53.072013 12018 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:52.969425 15239 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.025808 15243 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:53.036368 15257 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:53.081929 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:53.037175 15140 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.067791 12015 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
W20260709 12:10:53.074177 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51787us
I20260709 12:10:53.085783 11947 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.089332 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.090770 15246 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:53.090530 15125 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.091148 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.091704 15246 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.092021 15125 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.092152 15246 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:53.092427 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.055903 15172 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.072137 15147 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.081766 15128 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.098115 11945 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:53.000021 15241 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.082612 15222 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.073310 15255 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.071444 15202 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:53.026533 14922 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.012800 15240 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:53.109633 11839 leader_election.cc:336] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.626s (SENT)
I20260709 12:10:53.105319 15220 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.084681 15237 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9.
I20260709 12:10:53.097848 15140 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:53.115820 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:53.101399 15235 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.117672 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:53.101451 15229 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.117033 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:53.142549 12021 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:53.124697 15249 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.129607 15202 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.130204 15140 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.135527 15216 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.137187 15112 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.137998 15257 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.138727 15172 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.098483 15036 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.124739 12018 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:53.117504 15127 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:53.139955 15250 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 12:10:53.149751 15243 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:53.118652 15241 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.067775 15211 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:53.158630 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 55590.8us
W20260709 12:10:53.168299 11839 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.632s (SENT)
I20260709 12:10:53.160677 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-cbba5e6f295144a79461c5afc2e273ae received from {username='slave'} at 127.0.0.1:43956
I20260709 12:10:53.113127 15046 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:10:53.169090 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 87470.8us
W20260709 12:10:53.171060 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.185963 11770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 173) took 13559 ms (client timeout 15000 ms). Trace:
I20260709 12:10:53.187095 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:53.193117 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.689s (SENT)
I20260709 12:10:53.193722 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.123646 15174 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:53.204072 11839 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.732s (SENT)
I20260709 12:10:53.211730 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.184697 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-cbba5e6f295144a79461c5afc2e273ae on tablet cbba5e6f295144a79461c5afc2e273ae with peer 189a165e6619406382914fe3075dd436
I20260709 12:10:53.224014 11839 leader_election.cc:400] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:53.226320 11839 leader_election.cc:403] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.191257 15127 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.230419 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:53.230726 11868 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.231325 11940 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:53.186486 11770 rpcz_store.cc:269] 0709 12:10:39.655568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.674419 (+ 18851us) service_pool.cc:224] Handling call
0709 12:10:53.167573 (+13493154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:50.790338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:50.790927 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:50.790962 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:10:50.790982 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:50.855250 (+ 64268us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:50.855346 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:50.855381 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:10:50.860882 (+  5501us) tablet.cc:701] Row locks acquired
0709 12:10:50.860906 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:10:50.861104 (+   198us) write_op.cc:270] Start()
0709 12:10:50.861252 (+   148us) write_op.cc:276] Timestamp: P: 1783599050861041 usec, L: 0
0709 12:10:50.861272 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:50.862092 (+   820us) log.cc:844] Serialized 5582 byte log entry
0709 12:10:51.096168 (+234076us) op_driver.cc:464] REPLICATION: finished
0709 12:10:51.137963 (+ 41795us) write_op.cc:301] APPLY: starting
0709 12:10:51.148341 (+ 10378us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:51.148650 (+   309us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:51.148784 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:51.207935 (+ 59151us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:51.208465 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:10:51.208527 (+    62us) write_op.cc:312] APPLY: finished
0709 12:10:51.282831 (+ 74304us) log.cc:844] Serialized 101 byte log entry
0709 12:10:51.329373 (+ 46542us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:51.345697 (+ 16324us) write_op.cc:454] Released schema lock
0709 12:10:51.351131 (+  5434us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:51.436206 (+ 85075us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:51.436254 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"spinlock_wait_cycles":1522432,"child_traces":[["op",{"apply.queue_time_us":41478,"apply.run_cpu_time_us":5993,"apply.run_wall_time_us":252202,"num_ops":14,"prepare.queue_time_us":84668,"prepare.run_cpu_time_us":18331,"prepare.run_wall_time_us":223868,"raft.queue_time_us":27965,"raft.run_cpu_time_us":5260,"raft.run_wall_time_us":45976,"replication_time_us":234711,"thread_start_us":282660,"threads_started":4,"wal-append.queue_time_us":202939,"wal-append.run_cpu_time_us":9439,"wal-append.run_wall_time_us":1292368}]]}
I20260709 12:10:53.234582 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.235376 11869 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.222839 11768 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.215337 15235 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.215566 15229 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:53.247128 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:53.249680 15182 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
I20260709 12:10:53.225183 15224 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.250222 11946 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:53.261452 15229 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.228358 15237 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.260404 11768 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.283497 11768 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:10:53.289848 11768 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.267596 15222 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:53.302177 15222 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.304710 15222 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.308377 11866 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:53.310354 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 86499us
I20260709 12:10:53.328272 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:53.329469 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.262601 15216 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.332835 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:53.339295 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.333469 11869 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:53.335951 12016 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:53.339684 11768 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.341019 11839 leader_election.cc:400] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6.
W20260709 12:10:53.391584 15259 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:10:53.392369 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51533.5us
I20260709 12:10:53.394315 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:53.396672 11839 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:53.228509 15172 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:53.390117 15258 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.198s
I20260709 12:10:53.402917 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:53.223448 15243 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:53.297896 15224 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:53.407429 11768 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.341593 15216 raft_consensus.cc:2764] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:53.385830 15198 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.451902 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 288123us
I20260709 12:10:53.192700 15220 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:10:53.341399 15244 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.531123 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.534466 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.531136 11768 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.538254 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:53.540531 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.551669 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.552812 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.555331 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.556293 11945 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:53.582479 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.585345 11945 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 12:10:53.585924 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.598703 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 196442us
I20260709 12:10:53.600003 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.598664 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:53.642704 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:53.540207 15235 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.538108 15174 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.538592 15217 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:53.646878 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:53.655342 12018 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.540446 15182 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.647818 11939 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:10:53.530121 15198 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:53.659957 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60056.8us
I20260709 12:10:53.666282 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.678227 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:53.680898 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:53.662451 15252 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:53.599752 15258 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 12:10:53.682755 15227 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.004s
I20260709 12:10:53.646797 15235 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:10:53.746546 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.061s	sys 0.074s
I20260709 12:10:53.663997 15241 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:53.728631 15270 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
W20260709 12:10:53.729877 15275 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:10:53.730510 15222 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:53.688928 15244 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:53.747102 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.061s	sys 0.074s
I20260709 12:10:53.702301 15217 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:53.797640 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 682553us
W20260709 12:10:53.780308 11940 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 12:10:53.830647 11940 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:53.687348 15172 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:53.711889 15174 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.830828 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:53.767982 11987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.003s	sys 0.024s
I20260709 12:10:53.832036 11869 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
W20260709 12:10:53.832011 11987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.029s
I20260709 12:10:53.685331 15182 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.835654 11940 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.779862 15227 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:53.839057 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.661454 15224 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.844869 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.845794 11871 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.842511 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.846601 11873 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.743312 15243 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:10:53.844030 11940 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:53.851814 12018 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
W20260709 12:10:53.850899 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 170036us
I20260709 12:10:53.855556 11948 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.856449 11839 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 3 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 3. Current term is 4.
I20260709 12:10:53.857520 11871 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:53.840978 15227 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.878358 15227 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.860016 15243 consensus_queue.cc:1243] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:53.747012 15240 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:10:53.854851 15193 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.885877 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.885382 11871 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:10:53.857643 15237 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.849931 15174 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:53.850167 15277 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.889199 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:53.891239 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:53.853400 15229 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.896816 11873 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:10:53.900204 15266 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
I20260709 12:10:53.903163 15112 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.904582 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 635) took 1976 ms. Trace:
I20260709 12:10:53.906104 15243 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:53.907315 15211 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:53.911163 11865 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:53.914744 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.925482 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.931830 11864 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:53.918231 12016 rpcz_store.cc:276] 0709 12:10:51.928323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.928540 (+   217us) service_pool.cc:224] Handling call
0709 12:10:51.928910 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.341853 (+1412943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.904235 (+562382us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400178754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:53.904499 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234437504}
I20260709 12:10:53.934162 11872 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:53.934698 11872 pending_rounds.cc:85] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:53.934979 11872 pending_rounds.cc:107] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:53.926520 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.935245 11872 raft_consensus.cc:2889] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.923066 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:53.939320 11870 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10.
I20260709 12:10:53.940270 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.942524 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.946734 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:53.949024 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.949882 11872 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.951666 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:53.975569 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:53.924597 15101 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.930445 15158 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.935810 15182 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:53.985335 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:53.980695 15138 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.997225 15158 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:53.999785 15158 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:54.002089 15276 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:10:53.895183 15193 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.986074 11870 raft_consensus.cc:2376] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7. Re-sending same reply.
I20260709 12:10:54.007752 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:53.950886 15286 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.862232 15235 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.010118 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:10:54.011302 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.009327 15138 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:54.012877 15174 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:53.988646 15255 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.876s	user 0.008s	sys 0.005s
I20260709 12:10:53.983098 15283 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.980206 15229 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.020408 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.006315 15193 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:54.025015 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:54.017467 11866 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.019623 11872 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:54.037308 11872 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:53.997035 11873 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:53.927347 15277 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:53.987000 15101 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:54.033438 11870 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:54.034731 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.934613 15243 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.014868 15273 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:54.077178 11864 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:54.048527 15101 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.070479 11870 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [8.6-10.7]
W20260709 12:10:54.185309 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 165436us
W20260709 12:10:54.270855 11839 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.905s (SENT)
I20260709 12:10:54.038547 15255 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.045720 15229 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.271466 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.274447 15116 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:54.261173 11866 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:54.281303 11866 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 12:10:54.262871 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.263135 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:54.296591 11948 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:54.263110 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.297614 11943 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:54.263885 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.297902 11941 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:54.298249 11940 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:10:54.278941 15282 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.181s	user 0.005s	sys 0.001s
I20260709 12:10:54.267032 15202 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.116873 15138 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.304260 15288 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.305051 15288 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.304250 15202 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.107183 15271 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:10:54.041790 15283 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:54.281632 11839 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.154s (SENT)
I20260709 12:10:54.269140 15193 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.266139 11945 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:54.286443 15291 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.332396 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.332926 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:54.279814 15294 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.233s	user 0.006s	sys 0.003s
I20260709 12:10:54.307516 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.335032 11940 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:54.327998 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.275130 15246 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.344321 11988 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10.
I20260709 12:10:54.345428 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:54.333546 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51999.9us
I20260709 12:10:54.356012 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:54.422641 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.284649 15116 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:54.428969 15263 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:54.429315 15288 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.430294 15116 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.310498 15079 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:54.431224 15079 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.345031 15193 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.435660 15255 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.436550 15193 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:54.439680 15229 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:54.440918 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 85055.9us
I20260709 12:10:54.442068 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:54.442638 15291 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.346561 15299 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.443977 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.444402 15299 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.446584 15172 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.447475 15299 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.449687 15202 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:54.451946 15246 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.458918 15101 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.445487 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:54.464268 15227 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.005s
I20260709 12:10:54.471107 15243 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:54.473430 15283 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:54.475234 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.618464 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:54.586663 15298 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
W20260709 12:10:54.586148 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.605625 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 160200us
I20260709 12:10:54.437463 15193 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:54.479847 15127 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.235s	user 0.013s	sys 0.005s
I20260709 12:10:54.650873 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.583303 14922 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.655443 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:54.594125 15286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.007s	sys 0.017s
I20260709 12:10:54.680130 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2110) took 1420 ms. Trace:
I20260709 12:10:54.685937 11868 rpcz_store.cc:276] 0709 12:10:53.232299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.232931 (+   632us) service_pool.cc:224] Handling call
0709 12:10:53.233288 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.249313 (+ 16025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.249361 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.259093 (+  9732us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.639065 (+379972us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.639122 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.639403 (+   281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.652611 (+1013208us) raft_consensus.cc:1685] finished
0709 12:10:54.652632 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.652772 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4905,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8784,"thread_start_us":306663,"threads_started":1,"wal-append.queue_time_us":740809}
I20260709 12:10:54.688517 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:54.616526 15291 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:54.623986 15277 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:54.684921 15286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.018s
W20260709 12:10:54.703830 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 358466us
I20260709 12:10:54.679633 15243 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.704592 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.685077 15283 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:54.683149 15255 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.625514 15227 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.695490 15233 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.690838 15299 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.696894 15290 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.720615 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:54.709039 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:54.722244 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:54.703279 14689 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.705950 15273 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.702494 15288 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.702937 15079 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.707489 15193 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.706135 15286 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:54.708303 15277 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.693704 14922 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.782721 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:54.786891 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.798324 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:54.801594 12017 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:10:54.798995 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.753602 15128 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.648s	user 0.024s	sys 0.003s
I20260709 12:10:54.709880 15182 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.816148 11942 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:54.802657 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.760016 15283 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:54.809140 15138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.059s
I20260709 12:10:54.825230 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:54.826360 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.778512 15211 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.829965 11868 raft_consensus.cc:2410] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:54.721082 15255 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:54.830607 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 175234us
I20260709 12:10:54.835430 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.836071 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.838580 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:54.819442 15304 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:54.822760 15284 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.829205 15138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.009s	sys 0.059s
I20260709 12:10:54.825579 15079 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.779731 14689 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.811388 15277 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.767127 15290 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.878634 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.880033 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:54.801880 15193 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.755757 15299 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.781395 15273 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.837121 15308 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.886353 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:54.854763 15323 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:54.906924 12020 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:10:54.832231 15283 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.917981 12017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4755afb6a253477badd7f673bff77faa"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:10:54.885025 15288 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.837442 15211 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.912488 12014 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.910424 12013 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:54.960553 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44203.7us
I20260709 12:10:54.962642 11942 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.888475 15218 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.963778 12017 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.964362 12017 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.965996 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:54.960498 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:54.979926 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 169500us
W20260709 12:10:54.905665 15305 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:10:54.994544 11868 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.967551 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:54.997219 12013 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.999439 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:54.997507 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:54.889415 15243 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:10:54.882265 15079 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:54.869599 15284 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.915060 15101 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:54.981422 15318 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.014266 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:55.024777 11942 raft_consensus.cc:606] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:55.025249 11942 raft_consensus.cc:614] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.916710 15308 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.025890 15308 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.028800 15308 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:55.008699 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1711) took 1114 ms. Trace:
I20260709 12:10:55.030812 14689 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.029557 11871 rpcz_store.cc:276] 0709 12:10:53.894473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.035435 (+140962us) service_pool.cc:224] Handling call
0709 12:10:54.035718 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.036083 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.036104 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.057600 (+ 21496us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.607001 (+549401us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:54.677001 (+ 70000us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.677266 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.677345 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.008452 (+331107us) raft_consensus.cc:1685] finished
0709 12:10:55.008474 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.008627 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69736,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":5997,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":20755,"thread_start_us":349534,"threads_started":1,"wal-append.queue_time_us":630820}
W20260709 12:10:55.032845 15312 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:10:55.033151 11871 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:55.020447 15320 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.035851 15320 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.038663 15277 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.040362 15290 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.040814 15244 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.041271 15244 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:55.020778 15299 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:54.877763 15304 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:55.022141 15306 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:10:55.023236 15307 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:10:55.023840 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1719) took 1124 ms. Trace:
I20260709 12:10:55.010259 15243 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:55.010828 15309 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:10:55.007161 14922 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.019954 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1720) took 1118 ms. Trace:
I20260709 12:10:55.019263 15273 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.041811 11871 pending_rounds.cc:85] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 4
I20260709 12:10:55.071511 11871 pending_rounds.cc:107] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:10:55.071770 11871 raft_consensus.cc:2889] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:55.005481 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:55.063573 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66163.2us
I20260709 12:10:55.072494 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1729) took 1092 ms. Trace:
I20260709 12:10:55.072844 11871 rpcz_store.cc:276] 0709 12:10:53.980395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.032162 (+1051767us) service_pool.cc:224] Handling call
0709 12:10:55.032628 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.072215 (+ 39587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.072430 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.074747 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:55.075659 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 381) took 1094 ms. Trace:
I20260709 12:10:55.076020 11871 rpcz_store.cc:276] 0709 12:10:53.980817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.074847 (+1094030us) service_pool.cc:224] Handling call
0709 12:10:55.075174 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.075354 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.075379 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.075431 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:55.075462 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.075511 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.075608 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.076529 12013 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:55.058327 11864 rpcz_store.cc:276] 0709 12:10:53.900334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.097165 (+196831us) service_pool.cc:224] Handling call
0709 12:10:54.097720 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.098074 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.098114 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.268471 (+170357us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.707428 (+438957us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.707476 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.707555 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.023523 (+315968us) raft_consensus.cc:1685] finished
0709 12:10:55.023555 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.023756 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":399512,"threads_started":1,"wal-append.queue_time_us":596733}
I20260709 12:10:55.077498 11871 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.078348 11864 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:55.078572 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 382) took 1092 ms. Trace:
I20260709 12:10:55.079175 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 383) took 1092 ms. Trace:
I20260709 12:10:55.066484 15227 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.067579 15193 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:55.042052 15320 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:55.024793 15318 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.048300 15283 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:55.080737 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.071139 15220 consensus_meta.cc:287] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.359s	user 0.021s	sys 0.000s
I20260709 12:10:55.082885 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.102699 11864 rpcz_store.cc:276] 0709 12:10:53.987235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.077638 (+1090403us) service_pool.cc:224] Handling call
0709 12:10:55.078044 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.078863 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.079109 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.077658 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:54.896468 15286 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:54.917049 15323 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.076779 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:55.006173 15288 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:10:55.070793 11870 rpcz_store.cc:276] 0709 12:10:53.901793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.271069 (+369276us) service_pool.cc:224] Handling call
0709 12:10:54.278575 (+  7506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.282931 (+  4356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.282961 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.291458 (+  8497us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.649293 (+357835us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.815268 (+165975us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.816387 (+  1119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.816472 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.007652 (+191180us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b180028f720. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:55.012518 (+  4866us) raft_consensus.cc:1685] finished
0709 12:10:55.019705 (+  7187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.019868 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37717,"prepare.queue_time_us":59843,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":39048,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":28636,"spinlock_wait_cycles":11461376,"thread_start_us":466413,"threads_started":2,"wal-append.queue_time_us":517671}
I20260709 12:10:55.051678 15147 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:55.114077 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.079284 11871 rpcz_store.cc:276] 0709 12:10:53.986400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.077012 (+1090612us) service_pool.cc:224] Handling call
0709 12:10:55.077324 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.078272 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.078504 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.063016 15101 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.064510 15243 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:55.123271 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:55.163208 12013 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.126832 12014 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:55.131817 15323 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:55.134526 15316 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:10:55.144160 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67471.2us
I20260709 12:10:55.145251 12017 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.159771 15211 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.117229 15193 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.162029 15325 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.165845 15101 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.203598 15314 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.204278 15314 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.207111 15314 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.207864 15193 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:55.209048 15193 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.135983 15283 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:55.199364 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:55.123138 15320 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:55.165946 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:10:55.224007 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.233403 15283 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:55.240449 15317 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:10:55.239916 15283 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.226842 12014 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:55.248008 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.249001 11942 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:55.250816 12014 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:55.253158 12013 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:55.255788 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:10:55.220167 15306 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:10:55.231655 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.149s (SENT)
I20260709 12:10:55.258416 15319 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.179680 15243 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.268306 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.260268 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1728) took 1291 ms. Trace:
I20260709 12:10:55.270334 11868 rpcz_store.cc:276] 0709 12:10:53.969137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.884506 (+915369us) service_pool.cc:224] Handling call
0709 12:10:54.903820 (+ 19314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.995024 (+ 91204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.260019 (+264995us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b5400069ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:55.260201 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207743744}
I20260709 12:10:55.166136 15255 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.225875 15130 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.282823 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1772) took 2249 ms. Trace:
I20260709 12:10:55.278936 15319 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:55.283492 11941 rpcz_store.cc:276] 0709 12:10:53.033770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.033888 (+   118us) service_pool.cc:224] Handling call
0709 12:10:53.036096 (+  2208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.298334 (+1262238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.282500 (+984166us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003d4354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:55.282742 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901330816}
I20260709 12:10:55.136132 15318 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.286686 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.287631 11948 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:55.287791 15318 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.152908 15147 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.292114 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.293780 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.294656 11945 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:10:55.296962 15101 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.297078 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.300307 11941 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:55.301837 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1713) took 1406 ms. Trace:
I20260709 12:10:55.302286 11872 rpcz_store.cc:276] 0709 12:10:53.894998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.038001 (+143003us) service_pool.cc:224] Handling call
0709 12:10:54.038197 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.038520 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.038542 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.056191 (+ 17649us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.285895 (+229704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.294376 (+  8481us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.295020 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.295120 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.301600 (+1006480us) raft_consensus.cc:1685] finished
0709 12:10:55.301623 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.301758 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7956,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":5083,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":18863,"thread_start_us":24900,"threads_started":1,"wal-append.queue_time_us":615790}
I20260709 12:10:55.303876 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.284672 15319 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.304781 12013 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 5: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:55.220749 15325 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:55.338742 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72397.6us
I20260709 12:10:55.340829 15326 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.341579 11940 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:55.353822 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:55.403445 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:55.406291 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52760.5us
I20260709 12:10:55.407104 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:55.407155 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.408174 11941 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
W20260709 12:10:55.409855 11913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.012s	sys 0.026s
W20260709 12:10:55.410429 11913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.012s	sys 0.026s
I20260709 12:10:55.411437 15271 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.412081 15271 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:55.322881 15291 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.005s
I20260709 12:10:55.304978 15130 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.438027 15325 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.438692 15324 raft_consensus.cc:2764] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:10:55.439543 15293 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:55.443048 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.434020 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:55.363027 15318 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.427888 15319 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.409430 15079 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.430375 15288 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.441336 15291 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:55.467382 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 387) took 1469 ms. Trace:
I20260709 12:10:55.429785 15330 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.426553 15286 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:55.452718 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 386) took 1462 ms. Trace:
I20260709 12:10:55.495138 11871 rpcz_store.cc:276] 0709 12:10:53.990410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.147942 (+1157532us) service_pool.cc:224] Handling call
0709 12:10:55.148404 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.148679 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:55.162086 (+ 13407us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.452194 (+290108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.452281 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:55.452348 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.452448 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.452637 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14612,"prepare.queue_time_us":13171,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":19206,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":18387,"thread_start_us":283148,"threads_started":1}
I20260709 12:10:55.472922 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.426626 15304 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.486881 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.440630 15147 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.451754 15293 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:55.497416 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:55.484943 15325 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.483999 15227 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.341630 15326 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.514164 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.516970 12013 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:55.522610 11871 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 2.
W20260709 12:10:55.525862 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.526465 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.527850 15287 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.502s	user 0.000s	sys 0.012s
I20260709 12:10:55.529294 12017 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:55.527668 15262 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.544376 15262 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.546989 15130 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.547479 15262 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:55.530794 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.548702 12018 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
W20260709 12:10:55.549793 15246 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.936s	user 0.013s	sys 0.002s
I20260709 12:10:55.550927 12015 raft_consensus.cc:2410] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:55.529914 15227 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.493273 15220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43950 (request call id 12) took 9094 ms. Trace:
I20260709 12:10:55.500564 15286 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.538635 15271 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.543285 15147 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.553460 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:55.567989 12020 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:55.472922 15318 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.555178 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:55.556661 15217 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:10:55.537457 15233 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.798s	user 0.008s	sys 0.005s
I20260709 12:10:55.562347 15293 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.571547 15217 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:55.572086 15326 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.560271 15220 rpcz_store.cc:276] 0709 12:10:46.398561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.410864 (+ 12303us) service_pool.cc:224] Handling call
0709 12:10:46.513078 (+102214us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33ba0a 00007f1f1a33b693 00007f1f1a33b631 00007f1f1ba6e902 00007f1f1ba6e6dd 00007f1f1ba39f3f 00007f1f1ba396b3 00007f1f209f9d29 00007f1f19f781d4 00007f1f19f78162
0709 12:10:46.974078 (+461000us) log.cc:844] Serialized 506 byte log entry
0709 12:10:55.483999 (+8509921us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66054,"raft.queue_time_us":74840,"raft.run_cpu_time_us":2910,"raft.run_wall_time_us":134140,"spinlock_wait_cycles":8066304}
I20260709 12:10:55.576017 12019 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:55.556368 15036 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.578241 12015 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:10:55.583446 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.590803 12013 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:55.742429 15318 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.744544 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:55.745573 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:10:55.564741 15329 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.230s
I20260709 12:10:55.529209 15325 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.743867 15129 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.779773 15129 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:55.815094 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.014s	sys 0.019s
W20260709 12:10:55.815732 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.014s	sys 0.019s
I20260709 12:10:55.895854 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 385) took 1907 ms. Trace:
I20260709 12:10:55.896746 11870 rpcz_store.cc:276] 0709 12:10:53.987842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.137808 (+1149966us) service_pool.cc:224] Handling call
0709 12:10:55.138256 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.138544 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:10:55.139276 (+   732us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.895101 (+755825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.895209 (+   108us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:10:55.895285 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.895402 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.895636 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50538,"prepare.queue_time_us":374,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":10018,"raft.queue_time_us":51675,"thread_start_us":676507,"threads_started":1}
I20260709 12:10:55.764048 15330 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.905789 11864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.100s	sys 0.131s
W20260709 12:10:56.041280 11864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.101s	sys 0.131s
I20260709 12:10:55.906576 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.576313 15147 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.914707 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.045867 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:55.918856 12609 raft_consensus.cc:1217] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:10:55.901280 15242 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:55.901966 15202 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:55.936535 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.765065 15036 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:55.938717 11944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:56.049775 11944 raft_consensus.cc:606] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:55.939810 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.935168 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.942175 15217 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:55.944178 15325 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:55.949981 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.914738 15329 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.926059 15333 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.979339 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:55.915175 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.047173 12609 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 5 LEARNER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:10:56.055243 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.061560 11870 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:56.065325 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.066524 11870 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:56.047058 15237 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:56.084033 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.071456 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.069660 15333 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.087890 11944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:56.058604 15286 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.093377 11944 raft_consensus.cc:606] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:56.098496 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 648) took 2943 ms. Trace:
I20260709 12:10:56.099241 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:56.100512 15279 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 2.263s	user 0.015s	sys 0.017s
I20260709 12:10:56.069389 15329 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.049067 15330 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.105392 12022 rpcz_store.cc:276] 0709 12:10:53.154828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.155139 (+   311us) service_pool.cc:224] Handling call
0709 12:10:53.162122 (+  6983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.162535 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.162579 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.163243 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.439256 (+2276013us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003a3480. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:55.901656 (+462400us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.901701 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.901805 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.089172 (+187367us) raft_consensus.cc:1685] finished
0709 12:10:56.089195 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.098371 (+  9176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1905,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":18035,"spinlock_wait_cycles":4082944,"thread_start_us":462134,"threads_started":1,"wal-append.queue_time_us":2921139}
I20260709 12:10:56.090557 11870 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:56.058073 15217 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:56.068969 15325 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.091034 15243 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.803s	user 0.015s	sys 0.000s
I20260709 12:10:56.057298 15202 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.055883 15242 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.128844 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:10:56.130860 15319 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
I20260709 12:10:56.131106 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:56.132062 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:56.115125 12602 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:56.136233 11871 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:10:56.124104 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.102391 15333 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.091681 15237 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:56.118911 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.008s
I20260709 12:10:56.166417 11870 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:56.166712 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.008s
W20260709 12:10:56.167228 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 670636us
I20260709 12:10:56.169004 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 645) took 3024 ms. Trace:
W20260709 12:10:56.138413 12577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.000s	sys 0.016s
W20260709 12:10:56.170074 12577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.000s	sys 0.017s
I20260709 12:10:56.167621 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.171280 11870 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:10:56.171588 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.169090 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:56.169457 12021 rpcz_store.cc:276] 0709 12:10:53.145052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.145241 (+   189us) service_pool.cc:224] Handling call
0709 12:10:53.162500 (+ 17259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.168401 (+  5901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.168437 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.185022 (+ 16585us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.554983 (+369961us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.555952 (+   969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.556018 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.960530 (+2404512us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:56.134531 (+174001us) raft_consensus.cc:1685] finished
0709 12:10:56.134554 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.168916 (+ 34362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32212,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":6286,"spinlock_wait_cycles":13970688,"thread_start_us":314149,"threads_started":1,"wal-append.queue_time_us":482258}
I20260709 12:10:56.127130 15291 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.190917 11987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.078s	sys 0.150s
I20260709 12:10:56.189702 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:56.193068 11987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.078s	sys 0.150s
W20260709 12:10:56.198233 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.129266 15243 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.195960 15291 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.201938 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:56.211404 11870 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.215337 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:56.216235 11944 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.216635 11944 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:56.218125 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.219015 11945 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:56.220417 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.222601 11944 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.224113 11944 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.226573 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.227586 11945 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:56.214257 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.126484 15325 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.190620 15140 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:56.232874 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:56.203627 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:56.128266 15217 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.244067 11943 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:56.201223 15333 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:10:56.249272 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.208201 15295 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:56.250177 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:56.173609 15319 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:10:56.254509 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.269133 11870 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:56.270455 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:56.271039 11870 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:56.272548 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.273180 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.240082 15140 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.276134 15318 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.274299 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:56.277269 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.285099 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.269481 15295 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.276144 12602 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.293906 12605 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:10:56.294307 15271 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.294480 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.295085 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.294957 15271 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.297909 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.298468 11870 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:56.299062 15330 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.271420 15333 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.297293 15271 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.300295 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2121) took 2038 ms. Trace:
I20260709 12:10:56.303646 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 384) took 2316 ms. Trace:
I20260709 12:10:56.277570 15351 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:56.304491 11864 rpcz_store.cc:276] 0709 12:10:53.987565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.120353 (+1132788us) service_pool.cc:224] Handling call
0709 12:10:55.120798 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.121080 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:55.121455 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.303278 (+1181823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.303340 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:56.303401 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.303474 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.303588 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1352,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":127097,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":20158,"thread_start_us":1181319,"threads_started":2,"wal-append.queue_time_us":1004524}
W20260709 12:10:56.306062 15348 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:10:56.305907 15351 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.283607 15140 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:56.316906 15237 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.302585 15330 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.319072 15283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.020s	sys 0.028s
W20260709 12:10:56.319578 15283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.020s	sys 0.028s
I20260709 12:10:56.289297 15147 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:56.305927 15344 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:10:56.293934 15288 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.804s	user 0.010s	sys 0.006s
I20260709 12:10:56.299676 15295 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:56.290680 15318 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.344233 15318 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.349426 15237 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.299449 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.313369 15329 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:56.315687 15351 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.316797 15242 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.406376 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.319195 15330 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.304419 11872 rpcz_store.cc:276] 0709 12:10:54.262282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.309319 (+1047037us) service_pool.cc:224] Handling call
0709 12:10:55.403562 (+ 94243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.432130 (+ 28568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.432182 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.432885 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.855139 (+422254us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:55.855186 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.855276 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.300001 (+444725us) raft_consensus.cc:1685] finished
0709 12:10:56.300031 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.300218 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":23925,"thread_start_us":419962,"threads_started":1,"wal-append.queue_time_us":732115}
I20260709 12:10:56.310809 11944 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:10:56.389717 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2120) took 2455 ms. Trace:
I20260709 12:10:56.394922 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.337904 15288 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.399432 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.390193 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.408344 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.413182 11872 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:56.416924 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.419337 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.420831 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.425796 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:56.426033 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.426719 12022 raft_consensus.cc:2410] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:56.427307 11946 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:56.417905 11948 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:10:56.429066 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.430742 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.432379 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.436111 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.437309 11945 raft_consensus.cc:2410] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:56.414258 11866 rpcz_store.cc:276] 0709 12:10:53.934584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.300210 (+365626us) service_pool.cc:224] Handling call
0709 12:10:54.300611 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.326845 (+ 26234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:54.480653 (+153808us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.713881 (+233228us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.038737 (+324856us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b1800437bc0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:55.239230 (+200493us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:56.389111 (+1149881us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b1800437bc0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287
0709 12:10:56.389237 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.389301 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.389366 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.389473 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.389650 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23464,"prepare.queue_time_us":218865,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":4875,"raft.queue_time_us":206891,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":12710,"spinlock_wait_cycles":70408192,"thread_start_us":332756,"threads_started":2,"wal-append.queue_time_us":413815,"wal-append.run_cpu_time_us":4718,"wal-append.run_wall_time_us":1400416}
I20260709 12:10:56.439865 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.441602 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.456830 12015 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:56.457262 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.457890 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.409750 15237 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.389608 15249 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.442062 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.434525 15242 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:56.448046 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.460814 12021 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:56.446959 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.461915 11939 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:10:56.409550 11864 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:56.463934 12015 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:10:56.464838 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 186535us
I20260709 12:10:56.465149 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1731) took 1001 ms. Trace:
W20260709 12:10:56.467021 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 239713us
I20260709 12:10:56.467159 11864 rpcz_store.cc:276] 0709 12:10:55.465215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.306281 (+841066us) service_pool.cc:224] Handling call
0709 12:10:56.465083 (+158802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.464200 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.468629 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.471308 12015 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:56.472169 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.474630 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.475214 11864 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:56.471860 12015 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:56.475976 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.469483 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:10:56.459596 15237 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.479990 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.476722 12015 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.483355 12015 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.483456 12021 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:56.483805 11864 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:56.469713 15333 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.485903 12021 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:10:56.486202 15350 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:56.486810 15350 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.488098 15319 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:56.488672 15319 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.491145 15319 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.480233 15242 consensus_queue.cc:1243] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:56.493088 15319 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:56.489077 15350 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:56.499528 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2122) took 2220 ms. Trace:
W20260709 12:10:56.504967 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.506161 11866 rpcz_store.cc:276] 0709 12:10:54.279370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.498354 (+2218984us) service_pool.cc:224] Handling call
0709 12:10:56.498848 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.499082 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.499119 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.499178 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.499225 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.499298 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.499438 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:56.506676 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 86690.1us
W20260709 12:10:56.470477 15193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.006s	sys 0.013s
I20260709 12:10:56.517581 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2231) took 1401 ms. Trace:
I20260709 12:10:56.473917 15220 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.484472 15237 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.484524 14689 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.530998 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.484745 15329 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.514343 15193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.269s	user 0.009s	sys 0.013s
I20260709 12:10:56.518321 12013 rpcz_store.cc:276] 0709 12:10:55.116119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.731718 (+615599us) service_pool.cc:224] Handling call
0709 12:10:55.751594 (+ 19876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.752150 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:56.232508 (+480358us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.483422 (+250914us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.516413 (+ 32991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.516564 (+   151us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.516698 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.516951 (+   253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.517404 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11810,"prepare.queue_time_us":5823,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":5265,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":726707,"threads_started":2}
I20260709 12:10:56.540760 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.519773 15222 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.495327 15283 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:56.546226 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:56.549209 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48481.8us
I20260709 12:10:56.514415 15140 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.535830 15335 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.535483 15264 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.537868 15224 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.562582 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 81858.3us
I20260709 12:10:56.563717 15264 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.543411 15364 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:56.532085 15220 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.535458 15319 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:10:56.552632 15202 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.540968 15329 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.552419 15351 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.551213 15350 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:56.584568 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.570997 15330 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.573963 15271 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.551273 15222 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.592024 12015 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:10:56.567077 15264 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.580853 15364 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:56.595202 12015 pending_rounds.cc:85] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:10:56.578728 15355 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:56.599633 12015 pending_rounds.cc:107] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:10:56.583420 15351 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.592445 15202 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:56.563153 15335 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.583436 14689 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:56.598027 11864 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:56.621076 15329 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.580065 15158 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:56.574431 15366 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:10:56.569257 15224 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:56.616170 15278 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 2.788s	user 0.013s	sys 0.034s
I20260709 12:10:56.619019 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1789) took 1799 ms. Trace:
I20260709 12:10:56.622781 15140 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.594852 15271 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.605715 15330 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.625722 15222 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:56.628396 15358 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:56.632207 15335 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.634797 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2123) took 1979 ms. Trace:
I20260709 12:10:56.599936 12015 raft_consensus.cc:2889] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.663738 11864 rpcz_store.cc:276] 0709 12:10:54.655927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.502853 (+1846926us) service_pool.cc:224] Handling call
0709 12:10:56.597835 (+ 94982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.634369 (+ 36534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.634701 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.602248 15283 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.649029 11940 rpcz_store.cc:276] 0709 12:10:54.819477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.819804 (+   327us) service_pool.cc:224] Handling call
0709 12:10:54.820232 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.404877 (+584645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.618573 (+1213696us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400426654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:56.618917 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198198528}
I20260709 12:10:56.604625 15351 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.600842 15217 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:56.659701 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70480.1us
W20260709 12:10:56.659862 15211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.362s	user 0.004s	sys 0.012s
I20260709 12:10:56.660243 15379 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.661787 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 121122us
I20260709 12:10:56.670637 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:56.655274 15264 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.659341 15271 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.648255 15242 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.679877 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 583) took 3523 ms. Trace:
I20260709 12:10:56.672262 15335 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.666208 15222 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.680497 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.606739 15355 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:56.680317 11947 rpcz_store.cc:276] 0709 12:10:53.156087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.156296 (+   209us) service_pool.cc:224] Handling call
0709 12:10:53.156786 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.184607 (+ 27821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.184639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.185137 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.529996 (+344859us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:53.530038 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.533463 (+  3425us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.615130 (+3081667us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:10:56.674542 (+ 59412us) raft_consensus.cc:1685] finished
0709 12:10:56.674571 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.679793 (+  5222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11816,"raft.queue_time_us":28126,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":10461,"spinlock_wait_cycles":25965312,"thread_start_us":334190,"threads_started":1,"wal-append.queue_time_us":487500}
W20260709 12:10:56.674469 15211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.005s	sys 0.012s
I20260709 12:10:56.661357 15329 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:56.676270 11864 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:10:56.686421 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:56.667294 15283 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.687846 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:56.691870 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.665477 15295 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:56.694818 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.682588 15363 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:56.693094 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:56.663133 15330 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.706666 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:56.682713 15129 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:56.710237 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.712517 15329 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.714480 15284 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:56.714773 15224 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.688827 15222 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.695477 15283 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.690115 15382 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:56.705904 15193 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:56.706804 15381 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.682487 15379 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:56.723729 15367 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:10:56.724835 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:56.751840 15327 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.753044 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:56.739414 15381 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.754021 15381 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.753811 15327 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:56.691742 15202 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.754457 15381 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.754654 15202 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.754997 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:56.755182 15202 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.756542 15148 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:56.757052 15148 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:56.739941 15193 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:56.753089 15222 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.758405 15222 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.725936 15329 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.684566 15242 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.744285 15198 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.746575 15274 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.748594 15283 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.728353 15158 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.750275 15295 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:56.683399 15264 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:56.697062 15245 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 3.731s	user 0.015s	sys 0.033s
I20260709 12:10:56.734467 15224 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.774752 15224 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.775573 15242 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.775344 15224 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:56.725090 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 55319.1us
I20260709 12:10:56.759016 15222 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.758292 15193 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.767227 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:56.769439 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.722936 15220 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:56.770949 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 64434.6us
I20260709 12:10:56.687474 15335 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.759248 15329 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.768456 15284 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.768502 15274 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:56.687836 15364 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.690619 14689 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.805405 15351 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.785713 15264 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.772974 15158 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:56.787003 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.790416 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:56.791146 15198 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:56.841717 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51358.2us
I20260709 12:10:56.790762 15271 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.793386 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.842865 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:56.794358 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:56.795634 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:56.861119 12015 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:56.861564 12013 raft_consensus.cc:2410] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:56.796569 15242 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:56.794338 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.798599 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.864317 11940 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:56.798707 15355 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.803213 15379 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.766011 15318 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.811755 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.814795 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:56.800096 15283 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.837862 15274 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.874060 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:56.822966 15244 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.826452 15237 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.828676 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:55.485165 11868 rpcz_store.cc:276] 0709 12:10:53.997642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.279849 (+1282207us) service_pool.cc:224] Handling call
0709 12:10:55.302630 (+ 22781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.302867 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:55.303128 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.466848 (+163720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.466928 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.467021 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.467126 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.467295 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16491,"prepare.queue_time_us":2416,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":114,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":17371,"thread_start_us":163277,"threads_started":1}
W20260709 12:10:56.830440 12019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1679) took 3802 ms (client timeout 2324 ms). Trace:
W20260709 12:10:56.831378 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.832888 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:56.877290 11941 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:10:56.855472 11839 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.892s (SENT)
I20260709 12:10:56.879161 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:56.864511 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70249.6us
W20260709 12:10:56.877202 12019 rpcz_store.cc:269] 0709 12:10:53.027637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.027773 (+   136us) service_pool.cc:224] Handling call
0709 12:10:56.830171 (+3802398us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54000aa854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:56.830349 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5797942656}
I20260709 12:10:56.881855 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:56.865231 15380 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:56.837795 15351 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:56.870452 11945 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:56.870548 11939 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:56.821074 15381 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.840623 15202 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.859815 15158 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.777709 15148 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.890812 11872 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:56.869082 15198 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:56.892073 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:56.874701 11947 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.892737 11864 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.901337 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:56.912032 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.881443 15355 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.862603 15329 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:56.872562 15383 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.900357 15264 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.868935 15242 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:56.888804 15274 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.890033 15244 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.930917 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56068.4us
I20260709 12:10:56.885568 15380 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:57.024170 15385 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.024448 15380 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.892887 15371 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.885917 15283 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.885613 15223 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:10:57.014799 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.889s (SENT) [suppressed 28 similar messages]
I20260709 12:10:57.016623 15237 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:56.930943 15386 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:56.974233 15198 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.020838 11947 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:10:56.889215 15219 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:57.047789 15219 raft_consensus.cc:3055] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.048177 15219 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:57.023459 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:10:57.031054 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 143100us
I20260709 12:10:57.029035 15329 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.024595 15222 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.046942 15386 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:57.052882 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2115) took 3212 ms. Trace:
W20260709 12:10:57.057073 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.034713 15371 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.059648 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:57.053500 11869 rpcz_store.cc:276] 0709 12:10:53.836645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.836829 (+   184us) service_pool.cc:224] Handling call
0709 12:10:53.838889 (+  2060us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.847814 (+  8925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.847860 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.858981 (+ 11121us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.538914 (+1679933us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b1800437a40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946557 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:56.834445 (+1295531us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b1800437a40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:56.907002 (+ 72557us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:56.907066 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.907175 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.048731 (+141556us) raft_consensus.cc:1685] finished
0709 12:10:57.048755 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.048926 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10804,"raft.queue_time_us":9165,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":58734,"spinlock_wait_cycles":34721408,"thread_start_us":72260,"threads_started":1,"wal-append.queue_time_us":3164054}
I20260709 12:10:57.066473 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:57.071535 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:57.072235 11869 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.024863 15385 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.073156 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:57.074000 11947 raft_consensus.cc:2376] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8. Re-sending same reply.
I20260709 12:10:57.074239 15237 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.074760 15237 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.075911 15385 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.076570 12022 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:57.076936 15237 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.078047 15224 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.055306 15383 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:57.052027 15330 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.052747 15386 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:57.086103 12013 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.062639 15371 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.094417 11869 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:10:57.067778 15222 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:57.094497 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.093847 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:57.098418 12022 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:10:57.098839 11947 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:10:57.045100 15283 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.096197 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.100453 11869 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:10:57.109956 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.124600 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:10:57.094626 15257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.015s	sys 0.022s
I20260709 12:10:57.128054 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.087649 15383 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:57.079545 15378 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:57.094744 15147 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.131310 15257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.887s	user 0.015s	sys 0.023s
W20260709 12:10:57.143395 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51437.8us
I20260709 12:10:57.126724 15330 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.139640 15393 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 12:10:57.128882 15271 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.149806 15257 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:57.103787 15223 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:57.133037 15318 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.154301 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.155102 15284 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:57.135946 15202 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.137117 15381 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.098655 15385 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:57.162712 11869 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:10:57.172000 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.198683 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.213707 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.214807 11869 raft_consensus.cc:2410] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:10:57.094678 15219 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:57.153343 15364 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:10:57.161088 15378 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:57.194861 15216 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.256393 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99106us
I20260709 12:10:57.270663 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:57.157617 15330 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.279075 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:57.278513 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.281912 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:10:57.278970 15271 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.283376 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.279263 15381 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:57.284034 15222 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.194408 15383 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.284698 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.285017 15383 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.286010 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:57.275655 15184 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.275877 15378 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:10:57.307776 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.308266 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.280537 15237 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:57.281267 15293 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:57.310050 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.310899 12603 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:57.311517 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.310195 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:57.330971 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.331488 11869 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:57.281591 15360 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:57.332672 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.298623 15381 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.279042 15385 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:57.296480 15222 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.277884 15216 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.341054 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:57.342025 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.305795 15036 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.308362 15219 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.306066 15242 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.298938 15400 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:10:57.375595 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:57.298326 15284 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.378664 15283 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:57.382753 15398 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:10:57.388091 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.387840 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:57.390547 15330 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.394134 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:57.307403 15112 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:57.330175 15257 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:57.341230 15222 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:57.342753 15381 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:57.334225 15271 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:57.338824 15237 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.375234 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:57.421631 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 113745us
I20260709 12:10:57.344043 15360 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.335676 15293 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.424947 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:57.426154 11869 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:10:57.445351 15216 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.445994 15237 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.411072 15222 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.416404 15381 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.454360 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:57.455869 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:57.459187 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:57.466992 15401 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:10:57.467676 15293 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.472818 15283 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.473449 15283 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.463287 12020 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:57.458055 15244 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.462324 15319 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.463984 11837 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:57.480238 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2211) took 2582 ms. Trace:
I20260709 12:10:57.484324 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:57.488962 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 95969.2us
I20260709 12:10:57.464178 15198 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.483000 12016 rpcz_store.cc:276] 0709 12:10:54.897973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.898079 (+   106us) service_pool.cc:224] Handling call
0709 12:10:54.898452 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.898790 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.898816 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.025595 (+2126779us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:57.035301 (+  9706us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.154909 (+119608us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:57.154955 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.155460 (+   505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.474931 (+319471us) raft_consensus.cc:1685] finished
0709 12:10:57.474956 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.480162 (+  5206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":144205,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6406,"spinlock_wait_cycles":21027584,"thread_start_us":105346,"threads_started":1,"wal-append.queue_time_us":231097}
I20260709 12:10:57.457787 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.503661 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:57.505908 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.506657 12016 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:57.480659 15202 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.511886 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.512923 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.425232 15378 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:57.485723 15293 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.482272 15319 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.515266 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:57.527699 11939 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.515400 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.520987 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.531530 11869 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:57.532861 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.501434 15198 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.495298 15355 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.004s
I20260709 12:10:57.522311 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:57.522898 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.524564 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.539206 11869 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:57.539206 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.540009 12013 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:10:57.540704 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:57.540899 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.537863 12022 raft_consensus.cc:2376] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9. Re-sending same reply.
I20260709 12:10:57.492533 15392 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:57.530234 15319 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.548674 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.556475 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:57.548038 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45408.4us
I20260709 12:10:57.557425 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:57.559477 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.560199 11869 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:10:57.548590 15378 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.543576 15198 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:57.538654 15405 consensus_queue.cc:1175] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "46f08e8ff3774f25acad18252e5cd57d" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:10:57.545223 15355 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.546046 15360 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:57.539747 15223 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:57.572214 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:57.573442 11942 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
W20260709 12:10:57.582304 11839 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39778 dropped due to backpressure: service queue is full with 50 items [suppressed 8 similar messages]
W20260709 12:10:57.567624 15274 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.006s
W20260709 12:10:57.584483 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 87454.4us
I20260709 12:10:57.591933 11939 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:57.599589 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:57.600287 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:57.600950 11869 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:10:57.602306 12021 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:57.566725 15410 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:57.582841 15283 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:57.600560 15220 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:57.608911 15274 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.619680 15413 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:57.600992 15202 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:57.650213 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.629747 15220 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:10:57.671101 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.640656 15158 consensus_meta.cc:287] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.718s	user 0.014s	sys 0.001s
I20260709 12:10:57.638702 15274 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.582890 11839 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39778 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1730)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1735)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1736)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1737)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1738)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1743)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 390)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2129)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1747)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1749)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1751)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1753)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2158)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 397)
I20260709 12:10:57.689774 15158 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:57.642695 15413 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:57.667274 15410 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.692538 15274 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.712774 15220 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.714480 15220 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.716105 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.716845 12607 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:57.717796 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.718433 12608 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:57.719317 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.725790 12015 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:57.726226 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.724546 12603 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:57.728730 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:57.731196 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:57.732254 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:57.709143 15410 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:57.743500 15293 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.745803 15360 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.748349 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:10:57.790802 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.852192 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.766891 15293 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.764257 15371 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.640s	user 0.016s	sys 0.000s
W20260709 12:10:57.896291 15184 consensus_meta.cc:287] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.004s
I20260709 12:10:57.749619 15202 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:57.987360 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.099874 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:58.112963 12016 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:58.098589 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.899055 15400 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.898686 15283 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.895253 15360 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:58.116706 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.117328 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:57.899302 15227 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:57.936532 15219 consensus_meta.cc:287] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.000s
I20260709 12:10:57.901542 15293 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:58.104734 15319 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
W20260709 12:10:58.102836 15378 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.004s
I20260709 12:10:57.934492 15158 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.120819 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:58.058535 15222 consensus_meta.cc:287] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.003s
I20260709 12:10:57.903025 15416 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:10:57.940876 15380 consensus_meta.cc:287] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.004s
I20260709 12:10:58.137094 15416 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.137775 15380 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.138864 12609 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.139699 15416 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:57.937898 15229 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.056740 15383 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.771s	user 0.015s	sys 0.000s
I20260709 12:10:58.113705 15218 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.143473 15218 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:57.930048 15237 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:58.144632 15237 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.146754 15237 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:58.129757 15381 consensus_meta.cc:287] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.001s
I20260709 12:10:58.147440 15381 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.123737 15360 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.027865 15244 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:57.936488 15274 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:57.906975 15410 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.135926 15222 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:57.942015 15371 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.124378 15400 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.130827 15283 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:58.133450 15319 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.152329 15229 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.159173 15244 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.169653 15244 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.169678 15229 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.153429 15381 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.173642 15371 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.178539 15380 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.178198 15360 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.181121 15400 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:57.943188 11839 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.274s (SENT)
I20260709 12:10:58.232918 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:58.235772 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 292575us
I20260709 12:10:58.239169 11865 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:10:58.243026 11871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1742) took 2771 ms (client timeout 1793 ms). Trace:
W20260709 12:10:58.243712 11871 rpcz_store.cc:269] 0709 12:10:55.471509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.858190 (+386681us) service_pool.cc:224] Handling call
0709 12:10:58.242383 (+2384193us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54002d9454. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.242703 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178547456}
I20260709 12:10:58.246969 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1740) took 2776 ms. Trace:
I20260709 12:10:58.247417 11866 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:58.247514 11872 rpcz_store.cc:276] 0709 12:10:55.470531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.435790 (+965259us) service_pool.cc:224] Handling call
0709 12:10:58.246358 (+1810568us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002f5b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.246709 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035756928}
I20260709 12:10:58.249317 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.250623 11872 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
W20260709 12:10:58.250962 11865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1707) took 4357 ms (client timeout 2149 ms). Trace:
W20260709 12:10:58.258178 11865 rpcz_store.cc:269] 0709 12:10:53.893308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.942711 (+ 49403us) service_pool.cc:224] Handling call
0709 12:10:58.250559 (+4307848us) spinlock_profiling.cc:243] Waited 4.25 s on lock 0x7b5400069fd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.250844 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9779006208}
I20260709 12:10:58.260109 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.262691 11865 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:58.264249 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.241354 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.272949 11870 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:58.273295 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:58.255658 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2125) took 3572 ms. Trace:
I20260709 12:10:58.276219 11866 rpcz_store.cc:276] 0709 12:10:54.682811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.507960 (+1825149us) service_pool.cc:224] Handling call
0709 12:10:58.246681 (+1738721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.248025 (+  1344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.255338 (+  7313us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002f5b50. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.255553 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3996890496}
I20260709 12:10:58.279100 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.280083 11866 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:10:58.280416 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.282305 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.283335 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.285521 11947 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:58.256605 11836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1738) took 2787 ms. Trace:
I20260709 12:10:58.257627 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2128) took 3556 ms. Trace:
I20260709 12:10:58.287014 11864 rpcz_store.cc:276] 0709 12:10:54.700937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.704494 (+2003557us) service_pool.cc:224] Handling call
0709 12:10:56.705032 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.914005 (+208973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.257018 (+1343013us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400355cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:58.257384 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431193856}
I20260709 12:10:58.287636 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1817) took 1464 ms. Trace:
I20260709 12:10:58.288272 11941 rpcz_store.cc:276] 0709 12:10:56.822658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.822820 (+   162us) service_pool.cc:224] Handling call
0709 12:10:56.823226 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.877932 (+ 54706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.286764 (+1408832us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b5400425c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:58.287345 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123580800}
I20260709 12:10:58.288720 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.252540 11873 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:10:58.289755 11873 pending_rounds.cc:85] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:58.290181 11873 pending_rounds.cc:107] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:10:58.290555 11873 raft_consensus.cc:2889] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.293167 11864 raft_consensus.cc:2410] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:58.128041 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.295629 12013 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:10:58.296448 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 661) took 1225 ms. Trace:
I20260709 12:10:58.223569 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:58.297005 12015 rpcz_store.cc:276] 0709 12:10:57.071194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.071352 (+   158us) service_pool.cc:224] Handling call
0709 12:10:57.071636 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.726481 (+654845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.295601 (+569120us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400298bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:58.296129 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503776128}
I20260709 12:10:58.299024 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.300164 12015 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:58.297422 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:58.301898 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.303453 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.254324 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.305814 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.306252 11871 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:10:58.306818 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:58.306978 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.307665 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.308528 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.308888 11871 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:58.274459 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:58.255267 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:58.309378 11836 rpcz_store.cc:276] 0709 12:10:55.469454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.256393 (+2786939us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:58.310122 11869 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.309486 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1714) took 4414 ms. Trace:
I20260709 12:10:58.310869 11873 rpcz_store.cc:276] 0709 12:10:53.895272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.039659 (+144387us) service_pool.cc:224] Handling call
0709 12:10:58.251672 (+4212013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.292035 (+ 40363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.309238 (+ 17203us) spinlock_profiling.cc:243] Waited 4.19 s on lock 0x7b5400069fd0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.309410 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9636830592}
I20260709 12:10:58.312049 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.313037 11866 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:58.313608 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1754) took 1516 ms. Trace:
I20260709 12:10:58.314114 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1760) took 1500 ms. Trace:
I20260709 12:10:58.314085 11866 rpcz_store.cc:276] 0709 12:10:56.797057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.280832 (+1483775us) service_pool.cc:224] Handling call
0709 12:10:58.313520 (+ 32688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.315011 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.305238 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:58.317595 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.318585 12013 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:58.319753 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:58.320788 12013 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:58.314699 11870 rpcz_store.cc:276] 0709 12:10:56.813235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.274077 (+1460842us) service_pool.cc:224] Handling call
0709 12:10:58.314037 (+ 39960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.252434 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.149504 12609 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:10:58.308471 11864 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:58.157421 15198 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.581s	user 0.014s	sys 0.000s
I20260709 12:10:58.343093 15229 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:58.349689 12014 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:58.349520 15198 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.348294 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1730) took 2882 ms. Trace:
I20260709 12:10:58.354679 11864 rpcz_store.cc:276] 0709 12:10:55.463393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.307636 (+2844243us) service_pool.cc:224] Handling call
0709 12:10:58.308050 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.345206 (+ 37156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.345569 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.181934 15360 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.361701 11866 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.399664 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.404510 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1736) took 2937 ms. Trace:
I20260709 12:10:58.405085 11866 rpcz_store.cc:276] 0709 12:10:55.468046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.341156 (+2873110us) service_pool.cc:224] Handling call
0709 12:10:58.358411 (+ 17255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.403996 (+ 45585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.404363 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.405790 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.362003 11865 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.415359 15244 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:58.416443 15244 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:58.422821 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.424181 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.425202 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.426450 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.427685 15381 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.429229 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.428819 15381 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:10:58.436434 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:58.441404 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.443444 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.443778 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:58.445089 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.424245 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:58.370313 15220 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.005s
I20260709 12:10:58.437505 15229 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.375488 15319 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:58.452770 15218 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.455696 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 659) took 1338 ms. Trace:
I20260709 12:10:58.432469 15381 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.370164 15227 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.374090 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:58.438987 15222 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.469138 15235 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.471203 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.471720 15264 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.372829 15274 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:58.474166 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66580.7us
I20260709 12:10:58.480139 15264 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.483470 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.484905 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.486951 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.489450 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:10:58.491012 15436 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:10:58.177397 15293 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.493222 12013 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.498009 12021 raft_consensus.cc:2410] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:10:58.499142 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.500564 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.500679 15325 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.502681 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.503849 12021 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:10:58.497627 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1815) took 1687 ms. Trace:
I20260709 12:10:58.508724 11869 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:58.514247 11943 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.514640 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.516132 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.516501 15335 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.517442 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.518119 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:58.520354 15335 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.520627 11869 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:58.520946 15335 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:58.521752 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 390) took 3036 ms. Trace:
I20260709 12:10:58.521780 15335 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.518848 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.523691 11940 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:58.510452 12015 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:58.525214 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.524274 15283 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:58.527715 15148 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.516390 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.530903 15198 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.533172 11868 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:10:58.534194 12604 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:58.529870 11943 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:58.536115 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:58.522228 11869 rpcz_store.cc:276] 0709 12:10:55.485188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.519658 (+3034470us) service_pool.cc:224] Handling call
0709 12:10:58.520157 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.521325 (+  1168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.521648 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.539288 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:58.537076 11868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1762) took 1723 ms (client timeout 1726 ms). Trace:
I20260709 12:10:58.504787 11944 rpcz_store.cc:276] 0709 12:10:56.809782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.809934 (+   152us) service_pool.cc:224] Handling call
0709 12:10:56.810478 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.810993 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.811035 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.295250 (+1484215us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:58.296282 (+  1032us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.337179 (+ 40897us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.337243 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.346629 (+  9386us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.492882 (+146253us) raft_consensus.cc:1685] finished
0709 12:10:58.492902 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.497355 (+  4453us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10682,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":64337152,"thread_start_us":40150,"threads_started":1,"wal-append.queue_time_us":46751}
W20260709 12:10:58.540783 11868 rpcz_store.cc:269] 0709 12:10:56.813842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.886288 (+ 72446us) service_pool.cc:224] Handling call
0709 12:10:58.536741 (+1650453us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000695d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.536941 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3726205312}
I20260709 12:10:58.542689 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.543617 15271 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.547529 15386 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.552690 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:58.552208 15413 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.555565 15413 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:58.556902 15355 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:58.553670 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:58.558197 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.559319 12017 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:10:58.559820 12017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1698) took 3072 ms (client timeout 2274 ms). Trace:
W20260709 12:10:58.560236 12017 rpcz_store.cc:269] 0709 12:10:55.487292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.542407 (+ 55115us) service_pool.cc:224] Handling call
0709 12:10:58.557791 (+3015384us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:58.559706 (+  1915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26519296}
I20260709 12:10:58.565258 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:58.568199 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:58.569218 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:10:58.570276 12018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1694) took 3227 ms (client timeout 2548 ms). Trace:
W20260709 12:10:58.570708 12018 rpcz_store.cc:269] 0709 12:10:55.342414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.549727 (+207313us) service_pool.cc:224] Handling call
0709 12:10:58.568871 (+3019144us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:58.570194 (+  1323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9443200}
I20260709 12:10:58.549224 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.573566 11943 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:10:58.570578 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:58.575903 15271 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.575903 12018 pending_rounds.cc:85] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:10:58.580705 12018 pending_rounds.cc:107] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:58.464675 12019 rpcz_store.cc:276] 0709 12:10:57.066811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.066988 (+   177us) service_pool.cc:224] Handling call
0709 12:10:57.067393 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.067786 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.067820 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.079681 (+ 11861us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.406374 (+326693us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:57.493454 (+ 87080us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.404183 (+910729us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b1800301b40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287
0709 12:10:58.404609 (+   426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.404747 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.404859 (+   112us) raft_consensus.cc:1685] finished
0709 12:10:58.404997 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.405239 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8995,"prepare.queue_time_us":130646,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2830,"raft.queue_time_us":77603,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":12053,"spinlock_wait_cycles":13371136,"thread_start_us":475509,"threads_started":3,"wal-append.queue_time_us":388734}
I20260709 12:10:58.585517 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:58.582489 15319 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.587024 15319 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.588496 15243 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.581148 12018 raft_consensus.cc:2889] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.594048 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.601465 15329 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.602710 15329 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.603477 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:58.604907 15239 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.605377 15239 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:58.605896 15239 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.601740 15198 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:58.607329 15284 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:58.607843 15198 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:58.609882 15286 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:10:58.610641 15286 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.612848 15286 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.310453 11836 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36526 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 390)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2129)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1747)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1749)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1751)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1753)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2158)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 397)
I20260709 12:10:58.609383 15198 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.612668 15335 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.605224 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:58.628866 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.630949 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.624183 15319 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:58.642820 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.630131 15355 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:58.652225 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.653004 15304 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.654223 11939 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:58.653239 11943 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
W20260709 12:10:58.683530 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 100186us
I20260709 12:10:58.686534 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.649335 15329 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:58.700213 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.701185 11944 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:10:58.702131 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.702423 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.703778 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:58.704267 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.705876 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.706712 11940 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:10:58.702814 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 122) took 7318 ms. Trace:
I20260709 12:10:58.707298 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1737) took 3238 ms. Trace:
W20260709 12:10:58.707973 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103019us
I20260709 12:10:58.707857 11870 rpcz_store.cc:276] 0709 12:10:55.468569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.706235 (+3237666us) service_pool.cc:224] Handling call
0709 12:10:58.706687 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.706935 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.706962 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.707014 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.707047 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.707105 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.707214 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.709606 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:58.712163 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:58.713224 15304 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.714874 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.703812 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.716522 11939 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:10:58.705282 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.719798 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2268) took 1120 ms. Trace:
W20260709 12:10:58.730553 15437 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:10:58.733047 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1819) took 1909 ms. Trace:
I20260709 12:10:58.734274 12020 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:10:58.733577 11946 rpcz_store.cc:276] 0709 12:10:56.823310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.825613 (+  2303us) service_pool.cc:224] Handling call
0709 12:10:56.825946 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.826300 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.826331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.309612 (+1483281us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:58.310715 (+  1103us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.355474 (+ 44759us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:58.355511 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.361255 (+  5744us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.732452 (+371197us) raft_consensus.cc:1685] finished
0709 12:10:58.732483 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.732838 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1448,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":63,"spinlock_wait_cycles":27702656,"thread_start_us":44094,"threads_started":1,"wal-append.queue_time_us":271702}
I20260709 12:10:58.740163 15264 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.662549 15355 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:58.742293 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.743139 11866 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:58.743377 11939 raft_consensus.cc:2410] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:58.743482 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.746568 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2267) took 1169 ms. Trace:
I20260709 12:10:58.747946 15355 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:58.749305 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:58.747148 12017 rpcz_store.cc:276] 0709 12:10:57.580871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.561392 (+980521us) service_pool.cc:224] Handling call
0709 12:10:58.562484 (+  1092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.584683 (+ 22199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.584717 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.585422 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.632715 (+ 47293us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.632769 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.632848 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.746274 (+113426us) raft_consensus.cc:1685] finished
0709 12:10:58.746304 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.746489 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19601,"raft.queue_time_us":23415,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":230,"thread_start_us":46806,"threads_started":1,"wal-append.queue_time_us":132617}
I20260709 12:10:58.751830 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:58.752194 11986 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:58.752642 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.754371 15308 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.743525 11866 pending_rounds.cc:85] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 4
I20260709 12:10:58.755517 11866 pending_rounds.cc:107] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:58.755810 11866 raft_consensus.cc:2889] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.756031 15244 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.756649 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1744) took 3283 ms. Trace:
I20260709 12:10:58.749197 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:58.762392 12606 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.725569 12021 rpcz_store.cc:276] 0709 12:10:57.594152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.566534 (+972382us) service_pool.cc:224] Handling call
0709 12:10:58.567069 (+   535us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.601641 (+ 34572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.601702 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.602655 (+   953us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.637580 (+ 34925us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.685121 (+ 47541us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.685414 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.685500 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.714455 (+ 28955us) raft_consensus.cc:1685] finished
0709 12:10:58.714484 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.714714 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28585,"prepare.queue_time_us":92163,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":33735,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":300,"thread_start_us":71914,"threads_started":2,"wal-append.queue_time_us":82639}
I20260709 12:10:58.758318 15335 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.764268 15335 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:58.765586 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.765790 11866 rpcz_store.cc:276] 0709 12:10:55.473670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.742338 (+3268668us) service_pool.cc:224] Handling call
0709 12:10:58.742730 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.756365 (+ 13635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.756574 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.752942 12017 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:58.718981 15329 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:10:58.780157 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68133.3us
W20260709 12:10:58.781376 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 57970.4us
I20260709 12:10:58.782384 11865 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:10:58.780033 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 567) took 1042 ms. Trace:
W20260709 12:10:58.759486 15439 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:58.784355 12603 rpcz_store.cc:276] 0709 12:10:57.729256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.735457 (+  6201us) service_pool.cc:224] Handling call
0709 12:10:58.417495 (+682038us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:58.752313 (+334818us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890ee9c 00007f1f1890ea5b 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:10:58.770224 (+ 17911us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8866560}
I20260709 12:10:58.789754 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.761739 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:10:58.796124 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.790038 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2162) took 1217 ms. Trace:
I20260709 12:10:58.811216 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.819263 11944 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:58.824321 11865 rpcz_store.cc:276] 0709 12:10:57.566657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.272796 (+706139us) service_pool.cc:224] Handling call
0709 12:10:58.784050 (+511254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.811919 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:58.760669 15193 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.811563 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:58.790753 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:58.827773 12609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 401) took 1387 ms. Trace:
I20260709 12:10:58.827983 11943 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.828349 12609 rpcz_store.cc:276] 0709 12:10:57.379337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.379502 (+   165us) service_pool.cc:224] Handling call
0709 12:10:58.761423 (+1381921us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540040b354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:58.766719 (+  5296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725005696}
I20260709 12:10:58.829918 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:58.830880 12611 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.831225 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2129) took 3100 ms. Trace:
I20260709 12:10:58.810446 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:58.740239 15293 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:58.831651 11869 rpcz_store.cc:276] 0709 12:10:55.731184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.579091 (+2847907us) service_pool.cc:224] Handling call
0709 12:10:58.600033 (+ 20942us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.615036 (+ 15003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.615075 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.615953 (+   878us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.681078 (+ 65125us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.681141 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.681246 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.830915 (+149669us) raft_consensus.cc:1685] finished
0709 12:10:58.830935 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.831120 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":203,"thread_start_us":62859,"threads_started":1,"wal-append.queue_time_us":212339}
I20260709 12:10:58.830768 11870 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
W20260709 12:10:58.841404 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79731.4us
W20260709 12:10:58.843544 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.845224 11946 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.843408 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:59.019142 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.850095 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.898065 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.884357 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 74123.1us
I20260709 12:10:59.033784 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.042009 12611 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:10:58.892518 11940 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:58.887727 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.874845 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.845679 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1818) took 1989 ms. Trace:
I20260709 12:10:58.985647 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 389) took 3500 ms. Trace:
I20260709 12:10:58.899307 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1750) took 2633 ms. Trace:
I20260709 12:10:59.008783 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:59.068454 11868 rpcz_store.cc:276] 0709 12:10:56.266266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.846607 (+2580341us) service_pool.cc:224] Handling call
0709 12:10:58.898384 (+ 51777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.898698 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.898737 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.898825 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.898887 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.899009 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.899202 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.845018 15224 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.894412 11946 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.075340 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.076748 11870 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.077574 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1749) took 2820 ms. Trace:
I20260709 12:10:59.078675 11870 rpcz_store.cc:276] 0709 12:10:56.257603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.846207 (+2588604us) service_pool.cc:224] Handling call
0709 12:10:59.076482 (+230275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.077241 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.077496 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.836635 15421 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:58.899860 15449 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:10:58.974617 11866 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 3.
I20260709 12:10:58.845567 15335 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.030347 15235 consensus_meta.cc:287] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.009s
W20260709 12:10:59.084098 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.084898 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:59.087960 11865 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:59.067709 11864 rpcz_store.cc:276] 0709 12:10:55.484902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.754146 (+3269244us) service_pool.cc:224] Handling call
0709 12:10:58.754625 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.754968 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:58.882803 (+127835us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.984594 (+101791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.984746 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.984886 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.985128 (+   242us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.985466 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11112,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":19330,"thread_start_us":178999,"threads_started":2}
I20260709 12:10:58.897743 15147 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.092327 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:59.094725 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2131) took 3298 ms. Trace:
I20260709 12:10:59.095675 11865 rpcz_store.cc:276] 0709 12:10:55.792653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.837797 (+3045144us) service_pool.cc:224] Handling call
0709 12:10:59.007161 (+169364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.090906 (+ 83745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.091156 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.833196 15239 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:58.903967 15413 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 12:10:59.067531 11948 rpcz_store.cc:276] 0709 12:10:56.822998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.824492 (+  1494us) service_pool.cc:224] Handling call
0709 12:10:56.824858 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.825281 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.825311 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.283540 (+1458229us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:10:58.285168 (+  1628us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.344228 (+ 59060us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.737340 (+393112us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18000c6880. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf
0709 12:10:58.767018 (+ 29678us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.777055 (+ 10037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.781926 (+  4871us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.781983 (+    57us) raft_consensus.cc:1685] finished
0709 12:10:58.781994 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.812815 (+ 30821us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4176,"prepare.queue_time_us":129789,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":15634,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":20157,"spinlock_wait_cycles":35691008,"thread_start_us":89123,"threads_started":2,"wal-append.queue_time_us":149665}
I20260709 12:10:59.095921 15264 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:59.111599 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 169887us
I20260709 12:10:59.111845 15323 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.112532 15323 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.114418 11867 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:59.115034 15413 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.085929 15271 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.117188 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 304827us
I20260709 12:10:59.108122 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1703) took 1202 ms. Trace:
I20260709 12:10:59.118098 12017 rpcz_store.cc:276] 0709 12:10:57.901001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.803084 (+902083us) service_pool.cc:224] Handling call
0709 12:10:58.983529 (+180445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.103122 (+119593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.103168 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.103228 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:59.103277 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.103349 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.103502 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.106401 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:59.121186 12013 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.000s
I20260709 12:10:59.121706 12013 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:59.122278 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1717) took 1031 ms. Trace:
I20260709 12:10:59.122577 12015 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:59.122591 12013 rpcz_store.cc:276] 0709 12:10:58.091279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.337199 (+245920us) service_pool.cc:224] Handling call
0709 12:10:59.122212 (+785013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680640}
I20260709 12:10:59.115568 15413 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:59.092705 15147 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.139642 12607 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:59.140034 15147 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.143878 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.146451 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:59.148438 15391 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.150851 15448 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:59.125895 15158 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.152467 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 388) took 3668 ms. Trace:
I20260709 12:10:58.707440 11768 rpcz_store.cc:276] 0709 12:10:51.384129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.395724 (+ 11595us) service_pool.cc:224] Handling call
0709 12:10:58.702539 (+7306815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:54.096041 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:54.116241 (+ 20200us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:54.116285 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:54.116304 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:54.263624 (+147320us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:54.263693 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:54.263720 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:54.264514 (+   794us) tablet.cc:701] Row locks acquired
0709 12:10:54.264535 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:54.264705 (+   170us) write_op.cc:270] Start()
0709 12:10:54.264837 (+   132us) write_op.cc:276] Timestamp: P: 1783599054264650 usec, L: 0
0709 12:10:54.264863 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:54.265619 (+   756us) log.cc:844] Serialized 3601 byte log entry
0709 12:10:55.728909 (+1463290us) op_driver.cc:464] REPLICATION: finished
0709 12:10:56.208107 (+479198us) write_op.cc:301] APPLY: starting
0709 12:10:56.233494 (+ 25387us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:56.282217 (+ 48723us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:56.307604 (+ 25387us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:56.314629 (+  7025us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:56.314881 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:56.314925 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:56.315203 (+   278us) log.cc:844] Serialized 71 byte log entry
0709 12:10:56.315392 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:56.315542 (+   150us) write_op.cc:454] Released schema lock
0709 12:10:56.315591 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:56.316041 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:56.316067 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1470610,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":451599,"apply.run_cpu_time_us":3408,"apply.run_wall_time_us":120999,"num_ops":9,"prepare.queue_time_us":312690,"prepare.run_cpu_time_us":18232,"prepare.run_wall_time_us":277259,"raft.queue_time_us":435227,"raft.run_cpu_time_us":6329,"raft.run_wall_time_us":515405,"replication_time_us":1296263,"thread_start_us":880181,"threads_started":4,"wal-append.queue_time_us":413496,"wal-append.run_cpu_time_us":31150,"wal-append.run_wall_time_us":2640364}]]}
I20260709 12:10:59.147434 15382 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:59.111871 15335 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.159691 15382 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:59.153359 11872 rpcz_store.cc:276] 0709 12:10:55.484563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.619008 (+3134445us) service_pool.cc:224] Handling call
0709 12:10:58.619606 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.620243 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.620269 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.640258 (+ 19989us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.826277 (+186019us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.826330 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.826406 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.152185 (+325779us) raft_consensus.cc:1685] finished
0709 12:10:59.152209 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.152373 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4350,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":6534,"thread_start_us":157787,"threads_started":1,"wal-append.queue_time_us":194751}
I20260709 12:10:59.161837 15335 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.152465 11939 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.164610 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2264) took 1602 ms. Trace:
I20260709 12:10:59.130801 15271 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.157740 12611 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:59.105212 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2270) took 1491 ms. Trace:
I20260709 12:10:59.161469 15382 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.146848 15413 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.169983 12019 rpcz_store.cc:276] 0709 12:10:57.616418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.588943 (+972525us) service_pool.cc:224] Handling call
0709 12:10:58.595643 (+  6700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.656110 (+ 60467us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:58.824180 (+168070us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.099185 (+275005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.099257 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:59.099326 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.099403 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.099539 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10460,"prepare.queue_time_us":43909,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":44181,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8416,"thread_start_us":312231,"threads_started":2}
I20260709 12:10:59.194819 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2139) took 2716 ms. Trace:
I20260709 12:10:59.195730 11872 rpcz_store.cc:276] 0709 12:10:56.449703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.160634 (+2710931us) service_pool.cc:224] Handling call
0709 12:10:59.161116 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.161442 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.161469 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.166180 (+  4711us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.166240 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.166304 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.166410 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.172248 11946 raft_consensus.cc:2368] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
W20260709 12:10:59.172423 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.172559 12606 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:10:59.165072 12022 rpcz_store.cc:276] 0709 12:10:57.562368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.751447 (+189079us) service_pool.cc:224] Handling call
0709 12:10:57.751913 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.752786 (+   873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.752824 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.894387 (+141563us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.376038 (+481651us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18002f26c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:10:58.525707 (+149669us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.525749 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.525857 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.164031 (+638174us) raft_consensus.cc:1685] finished
0709 12:10:59.164052 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.164415 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":137401,"spinlock_wait_cycles":24004864,"thread_start_us":101839,"threads_started":1,"wal-append.queue_time_us":704364}
W20260709 12:10:59.176113 15423 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.278s	user 0.000s	sys 0.003s
I20260709 12:10:59.206478 11939 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:10:59.178203 15271 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.180261 15405 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.181317 12020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2249) took 1681 ms (client timeout 1556 ms). Trace:
W20260709 12:10:59.230890 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.127665 15198 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:59.222877 12020 rpcz_store.cc:269] 0709 12:10:57.499723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.505639 (+  5916us) service_pool.cc:224] Handling call
0709 12:10:59.181059 (+1675420us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000776d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:59.181206 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822690176}
W20260709 12:10:59.239372 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 205615us
W20260709 12:10:59.248509 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.253621 11865 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 10. Ops: []
I20260709 12:10:59.254634 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2138) took 2805 ms. Trace:
I20260709 12:10:59.255035 11865 rpcz_store.cc:276] 0709 12:10:56.449396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.155661 (+2706265us) service_pool.cc:224] Handling call
0709 12:10:59.253318 (+ 97657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.254274 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.254557 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.284747 12606 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.290115 11872 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:59.291038 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2141) took 2840 ms. Trace:
I20260709 12:10:59.291441 11872 rpcz_store.cc:276] 0709 12:10:56.450264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.225791 (+2775527us) service_pool.cc:224] Handling call
0709 12:10:59.289657 (+ 63866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.290732 (+  1075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.290966 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.309242 12022 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:59.304831 11866 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.311986 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 168210us
I20260709 12:10:59.312984 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1752) took 3039 ms. Trace:
I20260709 12:10:59.313385 11866 rpcz_store.cc:276] 0709 12:10:56.273948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.097283 (+2823335us) service_pool.cc:224] Handling call
0709 12:10:59.197642 (+100359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.312676 (+115034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.312916 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:59.318681 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 133117us
I20260709 12:10:59.317560 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:10:59.320158 12013 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:59.320940 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1713) took 1239 ms. Trace:
I20260709 12:10:59.321319 12013 rpcz_store.cc:276] 0709 12:10:58.081392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.138456 (+1057064us) service_pool.cc:224] Handling call
0709 12:10:59.284525 (+146069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.320626 (+ 36101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.320879 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.312062 15413 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.327868 12019 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:59.330853 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1714) took 1246 ms. Trace:
I20260709 12:10:59.330988 12022 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.331243 12019 rpcz_store.cc:276] 0709 12:10:58.084051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.186619 (+1102568us) service_pool.cc:224] Handling call
0709 12:10:59.294831 (+108212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.330590 (+ 35759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.330793 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.338960 15291 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:59.340379 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2269) took 1726 ms. Trace:
I20260709 12:10:59.340937 12018 rpcz_store.cc:276] 0709 12:10:57.604174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.571752 (+967578us) service_pool.cc:224] Handling call
0709 12:10:58.572298 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.620988 (+ 48690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.621036 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.630668 (+  9632us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.825217 (+194549us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.825258 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.825341 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.330114 (+504773us) raft_consensus.cc:1685] finished
0709 12:10:59.330140 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.330282 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":138291,"threads_started":1,"wal-append.queue_time_us":193690}
I20260709 12:10:59.342777 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2271) took 1717 ms. Trace:
I20260709 12:10:59.343336 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2265) took 1777 ms. Trace:
I20260709 12:10:59.343760 12015 rpcz_store.cc:276] 0709 12:10:57.567034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.525026 (+957992us) service_pool.cc:224] Handling call
0709 12:10:59.122233 (+597207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.127187 (+  4954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.343130 (+215943us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002684d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:59.343273 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372052224}
I20260709 12:10:59.344414 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:59.348296 15158 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.349478 12017 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:59.343168 12021 rpcz_store.cc:276] 0709 12:10:57.625500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.763245 (+1137745us) service_pool.cc:224] Handling call
0709 12:10:58.769588 (+  6343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.812318 (+ 42730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.812362 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.882662 (+ 70300us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.134425 (+251763us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.134483 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.134560 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.342552 (+207992us) raft_consensus.cc:1685] finished
0709 12:10:59.342575 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.342716 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28557,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7935,"thread_start_us":45125,"threads_started":1,"wal-append.queue_time_us":273424}
I20260709 12:10:59.345368 12015 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.358995 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:10:59.364161 12013 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.365988 12019 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.366300 11865 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:59.367084 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2142) took 2916 ms. Trace:
I20260709 12:10:59.367473 11865 rpcz_store.cc:276] 0709 12:10:56.450534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.309904 (+2859370us) service_pool.cc:224] Handling call
0709 12:10:59.331914 (+ 22010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.366785 (+ 34871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.367002 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.368914 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:59.368958 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.369859 11866 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:59.370568 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2143) took 2919 ms. Trace:
I20260709 12:10:59.370869 11866 rpcz_store.cc:276] 0709 12:10:56.450796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.326894 (+2876098us) service_pool.cc:224] Handling call
0709 12:10:59.363112 (+ 36218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.370297 (+  7185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.370509 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.371855 11865 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
W20260709 12:10:59.381255 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 69391us
I20260709 12:10:59.316988 15405 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.385787 15383 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.386271 15383 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.386719 15383 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.388195 15405 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.388926 15291 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:59.389743 12611 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:10:59.389963 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:59.391400 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:59.392117 11866 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:10:59.393090 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:10:59.394464 15386 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.400382 11873 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:59.401088 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1743) took 3929 ms. Trace:
I20260709 12:10:59.401391 11873 rpcz_store.cc:276] 0709 12:10:55.472413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.399605 (+3927192us) service_pool.cc:224] Handling call
0709 12:10:59.400020 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.400798 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.401027 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.379323 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.401595 15291 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.410555 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.412119 11873 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.419157 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.376154 15239 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:59.423609 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2144) took 2972 ms. Trace:
I20260709 12:10:59.424049 11873 rpcz_store.cc:276] 0709 12:10:56.451069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.411389 (+2960320us) service_pool.cc:224] Handling call
0709 12:10:59.411898 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.422840 (+ 10942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.423539 (+   699us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:59.423913 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60423us
I20260709 12:10:59.427189 11866 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:10:59.427848 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:10:59.428574 11865 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.378576 15264 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.436805 15240 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.437429 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.430999 15158 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.429695 15405 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.443377 11873 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:59.443929 15271 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.447649 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.450034 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2146) took 2998 ms. Trace:
I20260709 12:10:59.450472 11873 rpcz_store.cc:276] 0709 12:10:56.451601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.436506 (+2984905us) service_pool.cc:224] Handling call
0709 12:10:59.443164 (+  6658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.449757 (+  6593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.449955 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:59.454586 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 104843us
W20260709 12:10:59.449242 15193 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.000s
I20260709 12:10:59.458701 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.446869 15405 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:10:59.476217 15383 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.467212 15405 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:59.483832 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.464097 15264 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.484109 12016 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:10:59.488775 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 394) took 2917 ms. Trace:
I20260709 12:10:59.489264 11873 rpcz_store.cc:276] 0709 12:10:56.571229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.453586 (+2882357us) service_pool.cc:224] Handling call
0709 12:10:59.469842 (+ 16256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.485897 (+ 16055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.485942 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.488435 (+  2493us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:59.488492 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.488560 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.488701 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.482285 15271 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.490569 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:10:59.515805 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.492012 15271 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.525466 12018 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:59.540171 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.524435 15193 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:59.542564 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.543365 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1753) took 2746 ms. Trace:
I20260709 12:10:59.547089 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.547541 15264 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.548278 15264 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.548673 15264 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.549069 15264 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.549881 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75486.2us
I20260709 12:10:59.549919 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.550632 11872 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:59.550979 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.551481 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1756) took 2752 ms. Trace:
I20260709 12:10:59.551867 15382 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.552330 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:10:59.553247 15158 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.553700 15158 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.554059 15158 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.555413 11771 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:59.558009 15407 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.559254 15407 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.560005 15407 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.560360 15407 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.560763 15407 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.562839 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.551930 11872 rpcz_store.cc:276] 0709 12:10:56.799490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.549928 (+2750438us) service_pool.cc:224] Handling call
0709 12:10:59.550379 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.551110 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.551391 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.529677 15271 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.569799 11941 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:10:59.571672 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2273) took 1258 ms. Trace:
I20260709 12:10:59.574496 11865 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:10:59.576202 11865 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.574430 12020 rpcz_store.cc:276] 0709 12:10:58.313717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.244350 (+930633us) service_pool.cc:224] Handling call
0709 12:10:59.300457 (+ 56107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.307136 (+  6679us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:59.324662 (+ 17526us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.571037 (+246375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.571109 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.571171 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.571411 (+   240us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.571586 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14731,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":157,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":213382,"threads_started":1}
I20260709 12:10:59.578776 11771 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:59.580971 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.581681 15416 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.581936 15202 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.582334 15202 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:59.582298 15416 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.582858 15202 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.582712 15239 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:59.584894 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:59.578502 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1747) took 3336 ms. Trace:
I20260709 12:10:59.576902 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 395) took 2486 ms. Trace:
I20260709 12:10:59.587023 11865 rpcz_store.cc:276] 0709 12:10:57.090639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.575576 (+2484937us) service_pool.cc:224] Handling call
0709 12:10:59.575995 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.576623 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.576847 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.588135 12019 raft_consensus.cc:2368] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:59.580893 11771 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 7, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:59.586611 11869 rpcz_store.cc:276] 0709 12:10:56.241786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.849172 (+2607386us) service_pool.cc:224] Handling call
0709 12:10:58.999622 (+150450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.029461 (+ 29839us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:59.326392 (+296931us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.578162 (+251770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.578219 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.578279 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.578342 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.578443 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1162,"prepare.queue_time_us":214734,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"thread_start_us":421568,"threads_started":2,"wal-append.queue_time_us":214094}
I20260709 12:10:59.578397 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1751) took 3307 ms. Trace:
I20260709 12:10:59.520318 15147 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:59.591428 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 142989us
I20260709 12:10:59.590902 15400 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.592682 11872 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:59.595386 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2132) took 3206 ms. Trace:
I20260709 12:10:59.577737 15335 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:59.596825 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.594357 15239 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.586071 15291 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.542192 15458 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:10:59.606088 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1763) took 2784 ms. Trace:
I20260709 12:10:59.608374 11872 rpcz_store.cc:276] 0709 12:10:56.814113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.567072 (+2752959us) service_pool.cc:224] Handling call
0709 12:10:59.592390 (+ 25318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.597828 (+  5438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.598711 (+   883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.590734 11868 rpcz_store.cc:276] 0709 12:10:56.271036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.097223 (+2826187us) service_pool.cc:224] Handling call
0709 12:10:59.225323 (+128100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.306486 (+ 81163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.306523 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.327639 (+ 21116us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.571605 (+243966us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.571650 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.571736 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.578163 (+  6427us) raft_consensus.cc:1685] finished
0709 12:10:59.578195 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.578340 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7571,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":12208,"thread_start_us":199050,"threads_started":1,"wal-append.queue_time_us":214550}
I20260709 12:10:59.615768 11868 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.616652 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2157) took 2080 ms. Trace:
I20260709 12:10:59.617105 11868 rpcz_store.cc:276] 0709 12:10:57.536377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.614567 (+2078190us) service_pool.cc:224] Handling call
0709 12:10:59.615181 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.616277 (+  1096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.616544 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:59.628130 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.599570 15335 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:59.601801 15239 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:10:59.637928 15239 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.598927 15400 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.645103 15240 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.630611 15461 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
W20260709 12:10:59.647526 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.639222 15335 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.652217 15229 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:10:59.653275 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.660738 15410 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:59.661697 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.699671 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.662181 11869 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:10:59.637420 15158 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.651778 15382 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.665117 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.664927 15424 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:59.668661 15416 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:10:59.671147 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.673358 15413 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:59.675110 15383 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:10:59.676277 11867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1705) took 5785 ms (client timeout 2824 ms). Trace:
I20260709 12:10:59.676556 11871 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:10:59.709846 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 160080us
I20260709 12:10:59.710533 11871 pending_rounds.cc:85] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:10:59.710911 11871 pending_rounds.cc:107] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:59.711202 11871 raft_consensus.cc:2889] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.711515 15193 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:59.712494 15413 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.713063 15413 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.714418 15392 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.714879 15392 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:59.715451 15413 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.686146 12606 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:10:59.695988 11868 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:59.715986 15392 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.701067 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2148) took 2240 ms. Trace:
W20260709 12:10:59.701625 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.708873 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.718439 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44059us
I20260709 12:10:59.722465 11869 rpcz_store.cc:276] 0709 12:10:57.461081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.594657 (+2133576us) service_pool.cc:224] Handling call
0709 12:10:59.626037 (+ 31380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.700647 (+ 74610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.700988 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.683054 15147 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:10:59.716181 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 1712) took 1642 ms. Trace:
I20260709 12:10:59.717103 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2158) took 2169 ms. Trace:
W20260709 12:10:59.710387 11867 rpcz_store.cc:269] 0709 12:10:53.890429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.891130 (+   701us) service_pool.cc:224] Handling call
0709 12:10:59.675969 (+5784839us) spinlock_profiling.cc:243] Waited 5.18 s on lock 0x7b54002d9954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:59.676190 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11908326272}
I20260709 12:10:59.724542 12017 rpcz_store.cc:276] 0709 12:10:58.074324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.131115 (+1056791us) service_pool.cc:224] Handling call
0709 12:10:59.177231 (+ 46116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.349868 (+172637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.715864 (+365996us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400346054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:59.716103 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395124608}
I20260709 12:10:59.724591 11868 rpcz_store.cc:276] 0709 12:10:57.547615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.621088 (+2073473us) service_pool.cc:224] Handling call
0709 12:10:59.695462 (+ 74374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.716753 (+ 21291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.717034 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.740906 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 667) took 1052 ms. Trace:
I20260709 12:10:59.744719 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2152) took 2241 ms. Trace:
I20260709 12:10:59.745332 11872 rpcz_store.cc:276] 0709 12:10:57.502483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.620386 (+2117903us) service_pool.cc:224] Handling call
0709 12:10:59.649944 (+ 29558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.650309 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:59.651201 (+   892us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.743729 (+ 92528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.743818 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.743889 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.744008 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.744203 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":76059,"threads_started":1}
I20260709 12:10:59.747848 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.741508 12018 rpcz_store.cc:276] 0709 12:10:58.689982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.342421 (+652439us) service_pool.cc:224] Handling call
0709 12:10:59.342807 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.527990 (+185183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.740453 (+212463us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540015c054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:10:59.740810 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417206528}
I20260709 12:10:59.750572 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.751581 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.754528 12013 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:59.754649 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:59.755064 11867 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:59.755730 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2165) took 1116 ms. Trace:
I20260709 12:10:59.756080 11867 rpcz_store.cc:276] 0709 12:10:58.639053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.747673 (+1108620us) service_pool.cc:224] Handling call
0709 12:10:59.754715 (+  7042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.755461 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.755671 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.704797 15469 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:10:59.756738 12020 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:10:59.762389 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 185424us
I20260709 12:10:59.762471 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:59.748014 11771 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:59.765828 12019 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:10:59.771970 12577 leader_election.cc:400] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:59.772372 12577 leader_election.cc:403] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.762077 15413 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.773977 15147 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.763809 15229 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.739521 15421 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:59.742071 15202 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.785926 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:10:59.788560 15464 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 12:10:59.785486 15396 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 2.539s	user 0.007s	sys 0.008s
I20260709 12:10:59.759245 15271 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:59.799880 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57850.6us
I20260709 12:10:59.781667 15147 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.802469 11867 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:59.805497 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55054.8us
I20260709 12:10:59.595715 11864 rpcz_store.cc:276] 0709 12:10:56.388634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.107165 (+2718531us) service_pool.cc:224] Handling call
0709 12:10:59.305372 (+198207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.326306 (+ 20934us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:59.355301 (+ 28995us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.591850 (+236549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.591911 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:59.594796 (+  2885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.595194 (+   398us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.595334 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16111,"prepare.queue_time_us":30548,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":56,"raft.queue_time_us":21415,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2565,"thread_start_us":189153,"threads_started":1,"wal-append.queue_time_us":194048}
I20260709 12:10:59.784063 15392 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.804199 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:10:59.803165 15444 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.069s	user 0.003s	sys 0.010s
I20260709 12:10:59.814491 15202 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:59.815001 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2266) took 2244 ms. Trace:
I20260709 12:10:59.816401 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39764 (request call id 11) took 1177 ms. Trace:
I20260709 12:10:59.815407 12014 rpcz_store.cc:276] 0709 12:10:57.570502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.560816 (+990314us) service_pool.cc:224] Handling call
0709 12:10:58.561349 (+   533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.586590 (+ 25241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.586628 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.587515 (+   887us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.635497 (+ 47982us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.635574 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.635679 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.803002 (+1167323us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b2000129e78. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b5e1b91 00007f1f1b603a19 00007f1f1b5ce8c3 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169 00007f1f1b5d7131 00007f1f1b5d642d 0000000000388634
0709 12:10:59.814640 (+ 11638us) raft_consensus.cc:1685] finished
0709 12:10:59.814667 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.814915 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24046,"raft.queue_time_us":24391,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":39663872,"thread_start_us":47404,"threads_started":1,"wal-append.queue_time_us":108094}
I20260709 12:10:59.816804 11867 rpcz_store.cc:276] 0709 12:10:58.638629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.805874 (+1167245us) service_pool.cc:224] Handling call
0709 12:10:59.816310 (+ 10436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.811414 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.821856 15383 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.822422 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1735) took 4355 ms. Trace:
I20260709 12:10:59.822878 11871 rpcz_store.cc:276] 0709 12:10:55.466537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.338432 (+2871895us) service_pool.cc:224] Handling call
0709 12:10:59.676144 (+1337712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.711765 (+ 35621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.822164 (+110399us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002d9950. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:59.822346 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033079680}
I20260709 12:10:59.819779 11771 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:59.827489 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:10:59.813230 12016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1720) took 1693 ms (client timeout 2016 ms). Trace:
I20260709 12:10:59.783178 15264 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.832291 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.807708 15147 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.829372 12016 rpcz_store.cc:269] 0709 12:10:58.119843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.120516 (+   673us) service_pool.cc:224] Handling call
0709 12:10:59.804100 (+1683584us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002675d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:10:59.813150 (+  9050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104382336}
I20260709 12:10:59.836532 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.835749 15235 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:59.840870 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 123767us
I20260709 12:10:59.833637 15383 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.852965 15202 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.853410 15198 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:59.854763 15198 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.855183 15198 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:10:59.855684 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:59.856318 15198 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.858687 15202 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.857462 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:10:59.857710 11939 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.836117 15240 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.860915 11944 raft_consensus.cc:2410] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:10:59.827111 15239 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.858443 11948 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:59.858179 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:59.863715 11942 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:10:59.830315 15477 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:10:59.864166 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.867551 15264 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.870180 15239 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:59.871714 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2147) took 2412 ms. Trace:
I20260709 12:10:59.872418 11865 rpcz_store.cc:276] 0709 12:10:57.459422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.592013 (+2132591us) service_pool.cc:224] Handling call
0709 12:10:59.606902 (+ 14889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.624800 (+ 17898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.624836 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.630437 (+  5601us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.783177 (+152740us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:59.783222 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.783309 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.871378 (+ 88069us) raft_consensus.cc:1685] finished
0709 12:10:59.871403 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.871619 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"thread_start_us":78641,"threads_started":1,"wal-append.queue_time_us":134365}
I20260709 12:10:59.849659 15158 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:10:59.878082 11771 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 7, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:59.851552 15291 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.851832 15235 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:10:59.862416 15202 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:10:59.889267 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 132852us
I20260709 12:10:59.888480 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.890159 15264 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.895354 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1820) took 3071 ms. Trace:
I20260709 12:10:59.895720 15264 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:59.843345 15405 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:10:59.899288 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.890427 15240 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:59.901778 11947 raft_consensus.cc:1217] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-7.5]   Dedup: 5.4->[7.5-7.5]
I20260709 12:10:59.902444 11947 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:10:59.886159 15383 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:10:59.903209 15323 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.902947 15291 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.904476 15202 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.904907 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2159) took 2356 ms. Trace:
W20260709 12:10:59.906396 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.907714 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43669.2us
I20260709 12:10:59.895817 11945 rpcz_store.cc:276] 0709 12:10:56.823611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.889596 (+ 65985us) service_pool.cc:224] Handling call
0709 12:10:56.890112 (+   516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.893459 (+  3347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.893488 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:56.894235 (+   747us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.049896 (+155661us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.069993 (+ 20097us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.082920 (+ 12927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.083016 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.749366 (+1666350us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b18002d89e0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:10:59.677152 (+927786us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b24002ad4d8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f1898509d 00007f1f1b5b710e 00007f1f1b5ce88c 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221
0709 12:10:59.884609 (+207457us) raft_consensus.cc:1685] finished
0709 12:10:59.884636 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.895131 (+ 10495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15412,"prepare.queue_time_us":20131,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1558,"raft.queue_time_us":48872,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":17463,"spinlock_wait_cycles":9470976,"thread_start_us":114425,"threads_started":1,"wal-append.queue_time_us":162697}
I20260709 12:10:59.906371 11870 rpcz_store.cc:276] 0709 12:10:57.548908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.656629 (+2107721us) service_pool.cc:224] Handling call
0709 12:10:59.657096 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.657416 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.657447 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.658093 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.760688 (+102595us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:59.760726 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.760797 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.904635 (+143838us) raft_consensus.cc:1685] finished
0709 12:10:59.904662 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.904832 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":102189,"threads_started":1,"wal-append.queue_time_us":152681}
I20260709 12:10:59.896879 15264 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:10:59.838397 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:10:59.920524 11940 raft_consensus.cc:606] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:10:59.890318 15198 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.905344 15271 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.878140 15229 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:59.899742 15405 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:10:59.905709 15291 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:10:59.936966 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2166) took 1294 ms. Trace:
I20260709 12:10:59.931064 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:10:59.933776 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:10:59.917429 15413 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:10:59.908016 15407 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:10:59.940847 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2370792770000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:10:59.967283 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0136284960001376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 12:10:59.966343 11771 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:59.967893 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.939123 15291 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.971985 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:59.971756 11771 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 6 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:59.972776 12014 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:10:59.973162 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:10:59.975622 15392 raft_consensus.cc:2764] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:59.972786 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:59.980499 15413 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.983498 15224 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.984066 15224 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.984476 15224 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:59.985936 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.988379 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:59.989962 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:10:59.936187 15240 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:10:59.545485 11873 rpcz_store.cc:276] 0709 12:10:56.796641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.493806 (+2697165us) service_pool.cc:224] Handling call
0709 12:10:59.527245 (+ 33439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.539541 (+ 12296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.539590 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.542885 (+  3295us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:59.542957 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.543061 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.543251 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12213,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3613}
I20260709 12:10:59.974154 15235 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.001284 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:10:59.991641 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.017972 11943 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:00.017593 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:10:59.974084 11771 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 4 to 10, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:00.021171 11771 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:10:59.904469 15383 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.025461 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.025462 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:10:59.993434 15202 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.025969 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.030047 11940 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:10:59.994033 15480 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.999110 15112 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.990741 15458 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.045121 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 397) took 2493 ms. Trace:
W20260709 12:11:00.037676 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 99ffb9377dca4ebd94a32fd00a581fb5: Illegal state: Replica 4d7b7ec0a2604d808698037dbd6fa1ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:00.048861 11869 rpcz_store.cc:276] 0709 12:10:57.551534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.730536 (+2179002us) service_pool.cc:224] Handling call
0709 12:11:00.043931 (+313395us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800002798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:11:00.044268 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.044582 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.044621 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.044685 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:00.044772 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.044854 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.045016 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4547456}
I20260709 12:11:00.037739 15112 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:00.039340 15271 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:00.039937 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.019788 15424 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.061754 15424 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:00.040974 15386 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:00.041249 15471 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:00.063449 15424 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.045794 15458 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.031546 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.071187 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:00.071811 11944 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.072137 15458 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.074100 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.074934 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.076213 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.076501 15478 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.077922 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.078565 11948 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:00.079409 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.079918 11948 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:00.080736 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:00.084771 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:00.088526 12018 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:10:59.937420 11868 rpcz_store.cc:276] 0709 12:10:58.643059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.751039 (+1107980us) service_pool.cc:224] Handling call
0709 12:10:59.755322 (+  4283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.755641 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:59.755998 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.933961 (+177963us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.936527 (+  2566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.936589 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:59.936646 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.936740 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.936899 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2327,"prepare.queue_time_us":4266,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":39,"raft.queue_time_us":12272,"thread_start_us":172030,"threads_started":1}
I20260709 12:11:00.077412 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:00.040412 15400 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.053115 15158 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.091488 15158 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:00.092479 15158 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.093909 15407 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.054210 15460 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:00.054844 15480 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.054270 15112 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.055390 15485 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:00.065927 11943 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:00.067277 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.068075 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.112007 12013 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:00.072726 11939 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.051574 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:00.051623 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 130965us
I20260709 12:11:00.090878 15386 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.090389 11944 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:00.104216 11940 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.110638 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1628) took 1683 ms. Trace:
W20260709 12:11:00.041795 11941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1631) took 1557 ms (client timeout 1777 ms). Trace:
I20260709 12:11:00.113001 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.105301 15460 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.113981 11945 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:00.120916 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69480.4us
I20260709 12:11:00.114112 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.114426 15112 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.122210 12020 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:00.115144 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:00.123361 11939 raft_consensus.cc:606] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:00.123955 11939 raft_consensus.cc:614] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:00.124306 12018 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.118729 11948 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:11:00.118221 11941 rpcz_store.cc:269] 0709 12:10:58.484696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.493802 (+  9106us) service_pool.cc:224] Handling call
0709 12:11:00.041448 (+1547646us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54002e5ed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:00.041647 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267316992}
W20260709 12:11:00.119320 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.118026 11947 rpcz_store.cc:276] 0709 12:10:58.427203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.438580 (+ 11377us) service_pool.cc:224] Handling call
0709 12:10:59.889156 (+1450576us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.902768 (+ 13612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.110326 (+207558us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540014b250. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:00.110546 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292481920}
W20260709 12:11:00.125816 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.126756 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92241us
I20260709 12:11:00.126793 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.132021 12017 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:00.133119 15432 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.133296 15335 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.133868 15432 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.136053 15264 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.136611 15264 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.137670 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.138723 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.139209 15264 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.140054 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.140051 15458 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.140712 15458 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.141395 15471 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.123713 15460 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:00.142385 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.147591 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:00.149147 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.151438 12606 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:00.122114 15424 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.153597 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:00.129943 15240 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.107821 15291 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.142316 15458 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.167721 12606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:00.141880 15400 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:11:00.171139 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:00.165930 15383 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:11:00.174088 15264 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:00.174480 15383 consensus_queue.cc:1243] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:00.111478 15480 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.123569 15386 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.171484 12606 raft_consensus.cc:606] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:00.167068 15240 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:00.205020 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43943us
I20260709 12:11:00.206143 12608 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:00.160439 15432 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.213938 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:00.216149 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.217450 15386 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.218039 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:00.218888 12611 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 3.
I20260709 12:11:00.219966 15475 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.220659 15475 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.225750 15486 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.226514 15486 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.227005 15486 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.227537 15478 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.228020 15478 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:00.234289 15271 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.234858 15271 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:00.235776 15271 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.161998 15407 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:11:00.237920 12014 raft_consensus.cc:2410] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:00.237920 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:00.240130 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:00.240708 15410 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.241802 15410 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:00.242210 15410 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.242262 15291 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.242654 15410 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:00.211710 15240 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.243006 11837 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:00.218091 15386 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:00.246553 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:00.262111 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61541.2us
I20260709 12:11:00.197827 15480 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.277904 12606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:00.278384 15421 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:00.278764 12606 raft_consensus.cc:606] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:00.279273 12606 raft_consensus.cc:614] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:00.263621 15323 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.265311 15229 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:11:00.267069 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.266873 15147 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.215013 15239 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.270262 15271 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.292484 15416 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:00.293017 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:00.293918 11939 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:00.294004 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.295212 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.296399 11947 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.274560 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.274925 11948 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:11:00.276121 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.276355 15193 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:00.282655 12577 connection.cc:256] RPC call timeout handler was delayed by -1.0826663299999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:11:00.286692 15229 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.296283 11945 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
W20260709 12:11:00.303072 12577 connection.cc:256] RPC call timeout handler was delayed by -1.0160663299998305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 12:11:00.303344 12608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41000 (request call id 826) took 1510 ms (client timeout 1929 ms). Trace:
W20260709 12:11:00.306494 12608 rpcz_store.cc:269] 0709 12:10:58.792889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.793085 (+   196us) service_pool.cc:224] Handling call
0709 12:11:00.303167 (+1510082us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003bc254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:00.303274 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005274368}
I20260709 12:11:00.308346 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.308629 15410 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.287545 15323 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:00.283171 15471 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:00.302384 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:11:00.313907 12014 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:11:00.317981 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:00.229113 15478 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.313802 15323 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.311281 15229 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:00.326112 11986 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:00.305703 15475 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.319113 15235 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:00.326386 15486 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.335602 15486 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.336665 15478 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.341710 12610 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:00.344453 15224 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.345599 15147 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.346025 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.346714 12608 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.303115 15239 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.355661 12019 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:00.353641 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:00.357964 11946 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:00.367031 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.367832 12017 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.353672 15193 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.374060 15193 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.374529 15193 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.375063 15224 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.381690 15410 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.384111 15471 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:00.386377 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.387135 15475 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:00.388376 15491 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 12:11:00.388610 15475 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:00.389736 15469 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.390126 15469 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:00.391086 15469 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.392755 15469 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.392983 15458 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.394678 15486 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.395149 15486 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.387050 15460 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.395398 15458 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.395573 15486 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.395867 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.396142 11942 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:00.397321 15460 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.349695 15235 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.398742 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:00.406114 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.399868 12577 leader_election.cc:400] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6.
I20260709 12:11:00.417403 12608 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:00.397511 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:00.433388 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:00.435498 12017 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
W20260709 12:11:00.439311 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 176658us
W20260709 12:11:00.447244 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 139040us
I20260709 12:11:00.450685 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:00.463703 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 66244.9us
I20260709 12:11:00.464814 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:00.442152 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:00.402187 15235 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:00.398542 15424 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.406404 15480 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.495923 12609 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:11:00.496189 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.496645 12607 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.449769 15432 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.497490 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.500489 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.501721 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.399365 15475 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:11:00.405279 15486 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.507278 12603 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:00.438616 15240 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:00.510483 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 59896.3us
I20260709 12:11:00.493258 15392 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:00.511322 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 232048us
I20260709 12:11:00.491317 15291 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.489303 15424 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:00.514590 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51397.4us
I20260709 12:11:00.496645 15224 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.513615 12604 raft_consensus.cc:2376] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6. Re-sending same reply.
I20260709 12:11:00.521088 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.518236 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.508093 15480 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.524514 11941 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.521807 12607 raft_consensus.cc:2376] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8. Re-sending same reply.
I20260709 12:11:00.510211 15432 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:00.530018 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:00.530681 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 65996.8us
I20260709 12:11:00.531457 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.513298 15392 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:00.534698 11912 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecd86af74b304d58a84939321319d52b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:00.541895 15392 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.535185 15240 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.544624 15229 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.537724 15239 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:00.517201 15382 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:00.538262 12603 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:11:00.516027 15291 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:00.545692 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.615293 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.547472 15486 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.546754 15432 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.519173 15400 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.526221 15480 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.637699 15400 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.637873 15480 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.638252 15400 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.644709 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.563436 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45290.1us
I20260709 12:11:00.645958 15486 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.646060 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:00.647727 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.648871 15158 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:00.586791 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.589322 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.612613 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.614116 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.650839 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:00.540966 15323 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:11:00.619769 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 88404.3us
I20260709 12:11:00.626950 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.628427 15239 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.628604 15382 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.611729 15224 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:00.617717 15500 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.617516 15485 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:00.631412 15483 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:00.628502 15504 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:11:00.631842 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70793.6us
I20260709 12:11:00.618235 15291 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.649344 15158 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:00.613547 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49653.7us
I20260709 12:11:00.658193 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:00.679736 12610 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:11:00.661659 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.665236 12606 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.670233 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:00.671054 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.674489 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.682292 12013 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.677985 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.678217 12019 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.631446 15229 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.685947 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.676383 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.678581 12603 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:00.684783 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.688123 11946 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:00.688189 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.689044 12018 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 6: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:00.685165 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.661327 15500 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.694960 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.690320 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:00.688476 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:00.696367 11868 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:00.666226 15483 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:00.702772 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.660631 15202 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:00.700340 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.700009 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.681313 15158 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.729818 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.756194 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:00.761664 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 134783us
I20260709 12:11:00.728603 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:00.702679 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.700886 11914 connection.cc:256] RPC call timeout handler was delayed by -1.2849168830000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 12:11:00.767670 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.767743 12610 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 4.
I20260709 12:11:00.768556 11868 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.729476 11873 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:00.771325 11945 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.772449 12013 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:11:00.773612 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.700774 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:00.774864 11869 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:00.727967 12611 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:00.778658 11948 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:00.699218 15500 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.681896 15392 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.782877 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:00.701516 15478 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.760129 15501 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.730233 15410 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.760584 15509 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.734210 15198 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:00.728802 15239 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.785827 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.699923 15413 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:11:00.731653 15485 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:00.789631 15493 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:00.814672 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:00.792035 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.729427 15382 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:00.698127 15471 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:11:00.728703 15416 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:00.802103 11872 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:00.804965 11870 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.773931 15193 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.730283 15147 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:00.771158 15480 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:00.788743 11914 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.556s (SENT)
I20260709 12:11:00.815697 11869 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:00.793349 15410 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.788229 15501 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:00.827766 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2667526530001396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:11:00.856560 11839 connection.cc:256] RPC call timeout handler was delayed by -1.2469526530001076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 12:11:00.840308 11948 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.823438 15493 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.862954 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.863845 11940 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:00.842555 15495 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.843101 15416 consensus_queue.cc:1243] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:00.843461 15382 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:00.800729 15198 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:00.857005 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1938526530000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:11:00.876663 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1911526530000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:11:00.877178 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1911526530000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:11:00.877606 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0489526530000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 12:11:00.877933 15202 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:00.878607 15202 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.879760 15478 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:00.880067 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:00.881711 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:00.882836 11866 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 4: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:00.870786 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:00.883982 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.884742 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 94529.6us
I20260709 12:11:00.886016 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.887638 15516 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.888095 15522 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:00.888473 15516 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:00.890623 15517 raft_consensus.cc:993] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:00.891081 15475 raft_consensus.cc:1081] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:00.891285 15516 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:00.894768 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 132276us
I20260709 12:11:00.895949 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.902951 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:00.786917 15505 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:00.859494 15410 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.846359 15323 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:00.856067 15471 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.928200 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:00.933813 11867 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.869515 15495 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:00.936798 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:00.940681 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.943614 12018 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.793704 15224 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.905809 15198 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:00.952178 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.880995 15202 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:00.962584 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:00.971903 11867 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:00.972638 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 187448us
W20260709 12:11:00.973412 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.963361 11864 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:00.880859 15478 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.818688 15509 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.947636 15485 consensus_queue.cc:1243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:00.996235 11865 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:11:00.997370 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:00.946929 15471 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:01.002701 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 106787us
I20260709 12:11:01.004835 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:01.005846 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74227.6us
I20260709 12:11:01.013203 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:01.014225 11871 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 4.
I20260709 12:11:00.999343 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:11:01.021245 11873 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:01.021785 11873 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:01.022265 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.029356 15495 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.030910 15495 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.033099 15421 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:01.033856 15421 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.035022 15475 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:01.036507 15511 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.308s	user 0.002s	sys 0.008s
I20260709 12:11:01.004806 15392 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.040299 15509 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.036453 15475 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.041355 15239 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.041721 15475 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:01.041859 15239 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.042088 15480 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.043111 15193 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:00.984596 15501 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:00.991539 15515 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:01.042956 15239 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.044523 15501 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.045004 15521 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.045524 15239 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.015666 15416 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:01.042951 15475 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:01.066531 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49481.2us
W20260709 12:11:01.070029 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.015054 15323 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:01.088896 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:01.088016 15235 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.006s
I20260709 12:11:01.122264 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.122160 11868 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:11:01.127596 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 123668us
I20260709 12:11:01.087569 15521 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.098500 15493 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.094592 15515 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.137683 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:01.116804 15193 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.139621 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:01.142367 11986 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:01.142753 11868 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.124403 15475 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.125923 15235 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.150451 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:01.151211 11871 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.149673 15235 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.125931 15532 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:01.158910 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:01.158181 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:01.132510 15202 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:01.181126 15291 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:01.194089 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.201632 15198 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.203125 12022 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:01.204988 15198 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.204694 15158 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.213891 12020 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:01.220000 11868 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:01.221252 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:01.222874 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:01.223568 11868 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.227376 15539 ts_tablet_manager.cc:933] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.146831 15478 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:11:01.229154 12021 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:01.184705 15505 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.182293 15202 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.229979 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:01.230340 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.230779 11865 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.144693 15533 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:11:01.233829 11866 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.229646 12021 pending_rounds.cc:85] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:01.145920 15515 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.249356 12021 pending_rounds.cc:107] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:01.238015 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:01.240298 11866 pending_rounds.cc:85] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 3
I20260709 12:11:01.250094 12021 raft_consensus.cc:2889] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.250485 11866 pending_rounds.cc:107] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:01.251001 11866 raft_consensus.cc:2889] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.238736 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:01.246090 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.254985 11867 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:01.257002 11870 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:01.230020 15202 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.239110 15158 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.235131 15291 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.267424 15392 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.267642 15514 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 12:11:01.268043 15392 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.270594 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:01.270980 15392 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.272109 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:01.272765 12019 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.274729 12018 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:01.278277 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:01.207121 15500 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:01.286224 11868 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:01.236516 15507 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.608s	user 0.000s	sys 0.012s
I20260709 12:11:01.292344 11868 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:01.305331 15400 consensus_meta.cc:287] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 12:11:01.310504 15400 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.310786 15421 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.264918 15486 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.311874 11943 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.312319 15421 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.313202 15400 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.307343 15500 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.284359 11873 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.317685 15471 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.318825 15410 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.319339 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:01.302428 12018 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.331022 11865 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:01.324694 15505 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.331245 12604 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:11:01.191733 15532 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.325242 15478 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:01.334887 11873 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.335649 12019 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:01.339948 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:01.346361 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:01.346508 12603 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:01.340204 15522 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:01.352602 15424 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:01.353911 15534 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:11:01.354272 15424 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.356217 11869 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.354899 15515 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:01.363454 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 210061us
I20260709 12:11:01.338922 15478 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.364853 11986 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:11:01.370081 11986 leader_election.cc:403] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.346627 15469 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:01.381810 15515 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:01.382409 15520 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:01.334087 15517 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:01.384615 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.392392 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.372382 15158 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:11:01.393097 11942 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:01.383636 15520 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.396696 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:01.391747 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:01.405898 12609 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.402828 11941 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:11:01.382373 15483 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.409281 15532 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.375010 15539 tablet_copy_client.cc:323] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
W20260709 12:11:01.424391 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.394327 15291 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.393759 15505 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.425460 11837 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:01.431418 15520 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.432626 15520 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:01.433156 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.383652 15469 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:01.426263 15291 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.433974 15291 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.434403 15469 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.435479 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:01.426659 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:01.430924 12608 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:01.430553 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:01.443043 12014 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:01.447432 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.448805 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:01.449764 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 65286.4us
I20260709 12:11:01.450706 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.345026 15521 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.454327 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.438124 15416 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.455143 15416 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.455878 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:01.456529 11944 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.456046 15416 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.458426 12603 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.454535 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:01.430770 15537 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:11:01.459858 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.460307 11945 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.462317 11942 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:01.466144 15486 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.462962 15509 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:01.463994 12605 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:01.464843 11940 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:01.429512 15235 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.427771 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:01.449811 15158 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.445470 15323 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:01.489813 15158 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.489908 15323 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.451288 15432 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:11:01.492342 15158 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.492697 15432 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:01.480408 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 82921.9us
W20260709 12:11:01.493916 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.496622 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.497284 12017 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:01.446812 15532 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.498466 15532 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.498749 15235 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.500478 15486 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:01.501176 15235 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.488842 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.464847 15416 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.443763 15478 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.502544 15432 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.492354 15323 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.512023 12013 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:01.483314 11944 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:01.501286 15532 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.531318 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:01.533897 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 143498us
I20260709 12:11:01.575538 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.575654 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:01.580212 12603 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:01.594189 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:01.530195 15323 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.531205 15532 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:01.600796 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.603276 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:01.604079 12014 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:01.608203 15545 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.196s	user 0.001s	sys 0.002s
I20260709 12:11:01.614352 12609 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:01.591007 15519 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:01.615772 12611 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:11:01.578545 15533 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.595317 15522 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.596204 15235 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.599386 15410 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.632790 12606 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:11:01.639889 12014 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:01.632874 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.612964 15291 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.620885 15522 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.644006 15323 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:01.644570 15542 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.308s	user 0.002s	sys 0.000s
I20260709 12:11:01.645774 15509 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.646978 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.627616 15519 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.674636 15519 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.627230 15533 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.669584 15382 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:01.670817 15548 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
I20260709 12:11:01.671862 15522 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.688997 12014 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:11:01.675524 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.685237 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:01.690960 15509 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.691882 15509 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.692428 15509 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:01.700809 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.684500 15382 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.695704 15480 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.690084 15158 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:11:01.729841 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.730890 15486 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.731333 15486 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.731416 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:01.731787 15486 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.733841 15480 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.734025 15421 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.734426 15480 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:01.734951 15480 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.734872 15421 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.705214 15509 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.706215 15432 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:01.734445 15158 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:01.738260 15158 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.739112 15158 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.740468 15158 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:01.741436 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.711611 15291 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.706775 15517 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.718022 15533 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.722813 15202 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.726117 15382 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.726224 15483 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.760452 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.760955 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.767241 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.881s (SENT)
I20260709 12:11:01.746325 15532 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:01.769054 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:01.755357 15202 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.770061 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.771732 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.774060 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.776499 15532 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.776806 15501 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.776978 15532 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:01.777096 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.756923 15421 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.777460 15501 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.778074 11944 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:01.748308 15517 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.776392 15519 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:01.779232 11944 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.779181 15519 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.781387 15519 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.783257 15501 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:01.788082 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1856) took 1022 ms. Trace:
I20260709 12:11:01.790225 15532 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.792028 15532 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.792405 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:01.793184 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.769924 11946 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.749193 15432 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:01.798426 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 64965.3us
I20260709 12:11:01.776397 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.794502 15405 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.776818 11940 raft_consensus.cc:1217] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-12.8]   Dedup: 10.7->[12.8-12.8]
I20260709 12:11:01.770831 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:01.797125 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.799677 11940 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: [8.6-12.8]
I20260709 12:11:01.807816 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:01.808698 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1853) took 1044 ms. Trace:
I20260709 12:11:01.808964 15335 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.803546 15147 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.800141 11945 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:01.810179 15147 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:01.801767 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.805711 15405 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:01.812526 15147 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.812788 15517 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:01.803894 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.813622 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.814224 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.814551 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.815012 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.817782 11943 rpcz_store.cc:276] 0709 12:11:00.764403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.765603 (+  1200us) service_pool.cc:224] Handling call
0709 12:11:00.776509 (+ 10906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.312306 (+535797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.808437 (+496131us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540013d3d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:01.808634 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230675712}
I20260709 12:11:01.774523 15382 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.819716 15493 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.820263 15493 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.822345 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.812485 15405 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.809021 15478 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:01.834182 15522 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.836829 15522 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:01.837662 15335 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:01.838845 15335 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.822788 15493 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:01.849252 11944 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:01.829406 11946 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:01.788740 11939 rpcz_store.cc:276] 0709 12:11:00.765397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.770232 (+  4835us) service_pool.cc:224] Handling call
0709 12:11:00.782062 (+ 11830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.786750 (+  4688us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:00.885520 (+ 98770us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.929717 (+ 44197us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.031030 (+101313us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b180042c160. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1
0709 12:11:01.380377 (+349347us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180042c160. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:01.411790 (+ 31413us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4800190158. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:11:01.787238 (+375448us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b180042c160. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:01.787482 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.787571 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.787661 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.787774 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.787977 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440921,"prepare.queue_time_us":31655,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":3470,"raft.queue_time_us":913242,"raft.run_cpu_time_us":3408,"raft.run_wall_time_us":455355,"spinlock_wait_cycles":68040704,"thread_start_us":81275,"threads_started":2,"wal-append.queue_time_us":99180}
W20260709 12:11:01.861999 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.879647 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:01.886143 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:01.830920 15432 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.895815 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:01.898267 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.893733 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:01.900163 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77904.8us
I20260709 12:11:01.909207 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:01.913847 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.897783 15493 raft_consensus.cc:2764] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:01.897800 15501 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.914268 15519 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.945246 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:01.942140 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:01.946501 11947 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.948715 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.944480 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:01.952502 11945 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:01.896359 15386 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:01.948082 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:01.934971 15516 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.956233 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:01.918905 15239 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:11:01.973048 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.984002 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:01.922174 15486 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:01.954720 15519 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.995419 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.007391 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:01.983070 15240 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:02.014882 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.156s (SENT) [suppressed 24 similar messages]
I20260709 12:11:01.961229 15224 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:01.945870 15501 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:01.987496 15413 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.025502 12022 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:02.002014 15493 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.986259 15516 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:02.012558 15519 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.034880 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.004846 15509 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:01.986654 15147 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:11:02.021718 15291 raft_consensus.cc:2764] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:02.038364 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:02.063481 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet ecd86af74b304d58a84939321319d52b from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
W20260709 12:11:02.064375 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 78234.5us
I20260709 12:11:02.070237 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:02.075402 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:02.030691 15413 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:02.081365 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:02.084272 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:02.065150 15405 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.079145 15147 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:02.087934 15570 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:02.091959 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:02.092645 11871 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 10: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:02.088174 15486 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.093381 15486 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.094213 15486 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:02.094534 15566 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:02.083348 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet ecd86af74b304d58a84939321319d52b from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-ecd86af74b304d58a84939321319d52b
I20260709 12:11:02.096961 11866 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:02.073796 15235 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.083153 15413 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.109549 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:02.111088 12021 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.085703 15291 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.112457 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:02.107764 11871 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.108261 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:02.089109 15386 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.134174 15480 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.139412 11866 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:02.142289 12611 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:02.142226 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:02.142736 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:02.090569 15147 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:02.146169 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:02.143004 12013 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:02.147717 15486 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:02.155630 12607 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:02.153427 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:02.158885 12017 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:02.104573 15235 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:02.090963 15271 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:11:02.064188 15516 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:02.141378 15480 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.105408 15471 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:02.098821 15405 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.174803 15235 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.217914 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.229629 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.232254 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 166256us
I20260709 12:11:02.240502 12607 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:02.286182 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 43917.5us
W20260709 12:11:02.291914 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.289062 15386 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:02.333740 15581 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:11:02.334748 15405 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.294503 15392 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:02.236152 15147 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.338656 15147 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.309506 15271 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.341650 15271 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.344583 15271 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.342059 15533 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.349829 15291 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.363850 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.374620 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.366686 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.294413 15520 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:11:02.384392 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.385982 11947 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
W20260709 12:11:02.380337 15478 consensus_meta.cc:287] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 12:11:02.439733 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:02.441440 15532 consensus_meta.cc:287] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.004s
W20260709 12:11:02.443214 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 359001us
I20260709 12:11:02.443780 12022 raft_consensus.cc:2410] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:02.452855 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:02.453263 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:02.451192 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:02.461246 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.444792 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:02.474877 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.475281 12021 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:02.476686 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:02.477694 12014 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
W20260709 12:11:02.480461 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.449352 15382 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.003s
W20260709 12:11:02.481707 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.485337 12608 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:02.380896 15533 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.471429 15483 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.702s	user 0.014s	sys 0.000s
I20260709 12:11:02.384657 15291 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.458684 15432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.006s
W20260709 12:11:02.644496 15432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.007s
I20260709 12:11:02.644816 15432 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:02.645798 15432 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.646337 15533 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:02.646521 11771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 224) took 12562 ms (client timeout 15000 ms). Trace:
I20260709 12:11:02.527217 15224 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.494932 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:02.495086 15592 raft_consensus.cc:2764] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:02.447916 15271 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.649724 15271 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.651108 15291 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.651998 15271 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.478837 15407 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.652928 15407 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:02.653692 15407 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.654608 15578 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:02.655167 15578 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.657254 15578 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.479135 15560 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.658586 15560 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:02.658735 15592 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.659521 15592 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:02.660060 15592 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.659642 15560 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.525938 15202 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.000s
I20260709 12:11:02.487701 15386 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:02.662981 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.561484 15323 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:02.667313 15323 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.571978 15569 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.502s	user 0.002s	sys 0.000s
I20260709 12:11:02.611195 15495 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.670996 15495 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:02.672221 15495 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:02.635071 15483 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:02.634582 11769 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 10, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 10 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:02.676532 11769 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 6 to 9, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 9 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:11:02.679725 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.679035 11769 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 6 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.617775 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.622931 15501 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:02.687541 15519 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.000s
I20260709 12:11:02.688159 15519 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:02.623764 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.689713 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.632372 15505 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:02.693818 15505 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:02.695047 15505 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.696488 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.701370 11947 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:02.701642 15291 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.681259 11769 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.702198 15291 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.703085 11940 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:02.703861 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.704347 15291 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.704684 15323 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.598238 11958 tablet_copy_source_session.cc:215] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:11:02.616137 15158 consensus_meta.cc:287] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.875s	user 0.013s	sys 0.002s
I20260709 12:11:02.630681 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:02.708139 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77582.7us
I20260709 12:11:02.696488 15505 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.712531 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.712772 15483 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.713382 15483 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.713872 15483 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.636803 15509 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:02.717330 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.718262 15509 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.629949 15400 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.719533 15400 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:02.720916 15400 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.722671 15400 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.728437 15509 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:02.652689 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.527809 15600 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:02.501628 15486 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:02.658713 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 163895us
I20260709 12:11:02.569324 12605 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 12:11:02.571199 15587 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:11:02.608688 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.704427 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:02.614084 15553 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.616003 15235 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.452237 15480 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:02.729315 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.689745 15495 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.735836 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 291070us
I20260709 12:11:02.764467 12605 pending_rounds.cc:85] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 7
I20260709 12:11:02.741001 15539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd86af74b304d58a84939321319d52b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:02.647011 11771 rpcz_store.cc:269] 0709 12:10:50.084580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.084768 (+   188us) service_pool.cc:224] Handling call
0709 12:11:02.646429 (+12561661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:00.371987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:00.372791 (+   804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:00.372844 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:11:00.372862 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:00.374060 (+  1198us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:00.374150 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:00.374183 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:00.403406 (+ 29223us) tablet.cc:701] Row locks acquired
0709 12:11:00.403464 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:11:00.403687 (+   223us) write_op.cc:270] Start()
0709 12:11:00.403861 (+   174us) write_op.cc:276] Timestamp: P: 1783599060403621 usec, L: 0
0709 12:11:00.403885 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:00.404810 (+   925us) log.cc:844] Serialized 4034 byte log entry
0709 12:11:00.786414 (+381604us) op_driver.cc:464] REPLICATION: finished
0709 12:11:01.134798 (+348384us) write_op.cc:301] APPLY: starting
0709 12:11:01.145601 (+ 10803us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:01.148736 (+  3135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:01.148933 (+   197us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:01.374920 (+225987us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:01.409794 (+ 34874us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:11:01.409861 (+    67us) write_op.cc:312] APPLY: finished
0709 12:11:01.410311 (+   450us) log.cc:844] Serialized 77 byte log entry
0709 12:11:01.410549 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.410715 (+   166us) write_op.cc:454] Released schema lock
0709 12:11:01.410795 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:01.411257 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.411287 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39016,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":293991,"apply.run_cpu_time_us":5963,"apply.run_wall_time_us":294597,"num_ops":10,"prepare.queue_time_us":276175,"prepare.run_cpu_time_us":13662,"prepare.run_wall_time_us":109160,"raft.queue_time_us":213509,"raft.run_cpu_time_us":30318,"raft.run_wall_time_us":275703,"replication_time_us":361984,"spinlock_wait_cycles":75520,"thread_start_us":536566,"threads_started":4,"wal-append.queue_time_us":76076,"wal-append.run_cpu_time_us":12642,"wal-append.run_wall_time_us":1932650}]]}
I20260709 12:11:02.731009 11769 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 10 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:02.753939 11942 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:02.793174 12020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.066s	sys 0.140s
W20260709 12:11:02.737176 15413 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.005s
W20260709 12:11:02.861168 12020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.067s	sys 0.140s
I20260709 12:11:02.859899 11942 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:02.819406 15501 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.828320 15533 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.874846 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.864603 11942 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.884374 11942 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.828068 15486 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:02.864523 12605 pending_rounds.cc:107] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:11:02.917658 15533 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:02.870512 15480 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.916007 15323 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:02.923314 15480 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.923730 15323 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.932112 15592 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.933585 11940 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.935065 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:02.935587 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.937500 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.936926 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 173321us
I20260709 12:11:02.948449 11945 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:02.941494 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:02.963267 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.964586 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:02.965817 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.967949 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:02.915683 15147 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.576s	user 0.016s	sys 0.000s
I20260709 12:11:02.828958 15553 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.945662 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 115068us
I20260709 12:11:02.975466 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.974248 15578 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.978158 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:02.939476 12605 raft_consensus.cc:2889] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.978835 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.874239 15239 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:11:02.940383 15158 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.985707 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:02.934628 15509 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:02.871716 15413 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:02.995146 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.005259 12608 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:02.941345 15521 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:02.977613 15112 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.972250 15224 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:02.996026 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:02.918622 15501 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:02.986114 15493 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:03.030251 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.972371 15240 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.975611 15601 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.011454 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.043371 11871 raft_consensus.cc:2410] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:02.986644 12605 pending_rounds.cc:107] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:03.002077 15147 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.044471 12611 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:02.992374 15578 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:03.005162 15480 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.005028 15323 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:02.989151 15600 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:11:03.007248 15595 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.019157 15224 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:03.060838 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.067569 11871 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.062547 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.069458 11870 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.019507 15521 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.087427 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.004822 15158 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.086432 11865 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:03.092061 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.087738 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.088624 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.098229 11868 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.099835 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:03.088191 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.101483 11872 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:03.094807 11873 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.102684 11866 raft_consensus.cc:2368] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:03.094818 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.047932 12605 raft_consensus.cc:2889] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.049269 15533 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.026762 15509 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.120800 12606 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:03.062203 15493 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:03.123109 11871 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:03.073436 15224 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.150004 11769 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:03.163853 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.121951 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.166762 11870 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.079356 15240 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:03.088528 15501 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:03.082084 15598 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:11:03.173314 11866 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.103499 15519 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.184041 11866 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:03.097956 15480 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:03.119320 15595 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:03.079610 15147 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:03.174368 15432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.043s	sys 0.066s
I20260709 12:11:03.048259 15486 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.192806 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:03.201678 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.201896 11866 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.055492 15483 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:03.195544 15432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.044s	sys 0.066s
I20260709 12:11:03.180480 15235 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:03.179256 15551 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.097740 15407 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.236865 11871 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:03.226166 15519 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.241886 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.251811 11870 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.236905 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:03.190614 15240 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.236409 15592 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:03.270228 15147 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.271987 15413 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.272941 15240 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:03.276377 15483 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:03.265600 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.278815 15407 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:03.266630 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.279322 11873 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:03.279923 11872 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.282940 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 400868us
I20260709 12:11:03.240739 15509 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:03.290019 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.291478 11866 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:03.291842 11942 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:03.292372 11942 pending_rounds.cc:85] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
I20260709 12:11:03.292671 11942 pending_rounds.cc:107] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:03.292985 11942 raft_consensus.cc:2889] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:03.301811 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.201781 15578 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.240305 15551 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.317440 11870 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:03.285264 15501 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.317435 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 259571us
I20260709 12:11:03.308940 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:03.314977 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.320148 11866 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.299741 15432 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.329998 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.265653 15519 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:03.332278 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.333004 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:03.328883 11866 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.346632 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:03.353160 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:03.343176 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 321169us
I20260709 12:11:03.367153 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:03.246002 15493 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.372665 11870 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:03.364763 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.375070 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:03.368463 11940 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.375826 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:03.364364 15604 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.174s	user 0.000s	sys 0.004s
I20260709 12:11:03.376816 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.379467 11866 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:03.332670 15601 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:03.305925 15480 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.384377 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:03.375237 15609 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:03.338796 15112 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:03.392686 15607 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:11:03.393150 15112 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.420527 15553 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:03.380591 15608 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:03.388368 11866 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.305711 15595 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.329735 15432 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.386327 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:03.328346 15501 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.383536 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:03.389622 11942 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:03.383472 15407 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.438793 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55366.5us
I20260709 12:11:03.448109 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:03.449810 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:03.449995 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:03.450774 11941 raft_consensus.cc:2410] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:03.451220 11943 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:03.452889 11939 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:03.453732 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:03.454738 11946 raft_consensus.cc:2410] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:11:03.457127 12014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.018s	sys 0.026s
I20260709 12:11:03.452905 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:03.465179 11944 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.405527 15551 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:03.387003 15579 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:11:03.466446 12014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.019s	sys 0.026s
I20260709 12:11:03.467262 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:03.456175 15400 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.733s	user 0.015s	sys 0.001s
I20260709 12:11:03.484689 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:03.488898 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:03.489933 12016 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.463655 12602 raft_consensus.cc:2368] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9.
I20260709 12:11:03.455663 15495 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.499291 11872 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:11:03.477147 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.504376 12021 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:03.509764 11868 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:03.515048 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.458935 15592 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:03.517390 12013 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:03.519292 12013 pending_rounds.cc:85] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 3
I20260709 12:11:03.519580 12013 pending_rounds.cc:107] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:03.519815 12013 raft_consensus.cc:2889] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.515697 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:03.521324 12021 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:03.522812 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:03.523538 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.524320 11868 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.526242 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:03.522907 15601 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.530993 12013 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:03.531481 12013 pending_rounds.cc:85] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:11:03.531741 12013 pending_rounds.cc:107] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:03.532007 12013 raft_consensus.cc:2889] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.535400 12605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 425) took 1737 ms. Trace:
I20260709 12:11:03.540529 11946 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.540985 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:03.521522 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.497566 15158 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.501564 15495 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.528400 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:03.508504 15400 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:03.545408 12606 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 4.
I20260709 12:11:03.512506 15509 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.546973 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.557083 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:03.559254 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:03.535936 12605 rpcz_store.cc:276] 0709 12:11:01.798037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.801043 (+  3006us) service_pool.cc:224] Handling call
0709 12:11:01.805117 (+  4074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.172668 (+1367551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.535050 (+362382us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400211bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:03.535293 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755813632}
I20260709 12:11:03.564292 15475 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.565603 15475 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.565969 15475 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:03.566993 15475 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.568297 15475 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.571213 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.571089 15224 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.571667 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:03.572139 11872 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.572894 11945 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:03.573215 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.574441 12022 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:03.555590 15400 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.580236 15400 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:03.580611 15158 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.581233 15158 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.583535 15158 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:03.583896 15501 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.563370 15509 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:03.585767 15553 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:03.470690 15202 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:03.586838 15509 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:03.541409 15614 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.543089 15521 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:03.547514 15495 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.545639 15519 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:03.643918 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 159341us
I20260709 12:11:03.604570 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.611825 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.649214 11865 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.633404 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:03.645558 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:03.621891 15622 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:03.603475 11986 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:03.682945 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 79739.7us
I20260709 12:11:03.596655 11940 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:03.640827 12016 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:03.689409 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:03.694209 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.602414 15224 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:03.622831 15603 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.632s	user 0.002s	sys 0.009s
I20260709 12:11:03.701695 11868 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:03.706139 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:03.722652 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.723963 11868 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.705700 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.726052 11872 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:03.708259 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.733636 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.734488 11865 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.600576 15553 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:11:03.707700 15521 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:03.707590 15551 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.737594 15501 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.702193 15629 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.779546 11865 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
W20260709 12:11:03.793263 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.791064 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:03.795600 11865 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:03.707829 15519 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:11:03.784557 11868 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:03.776017 15521 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.706730 15622 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:03.849952 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 142528us
W20260709 12:11:03.850695 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.781230 15629 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.874522 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.882966 11866 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:03.910081 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:03.815099 15605 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.512s	user 0.001s	sys 0.002s
I20260709 12:11:03.799015 15551 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:03.922814 11866 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:03.835978 15521 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:03.939502 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.957104 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.910066 15323 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.898938 15629 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:03.968185 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.799453 15501 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:03.942945 15224 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.991477 15623 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
W20260709 12:11:03.983438 15598 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:04.003692 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:03.941984 15601 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:04.012816 11866 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:04.014046 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:04.020488 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 137048us
W20260709 12:11:04.011902 15634 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:11:04.023272 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.024009 11873 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:04.024760 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 690) took 1566 ms. Trace:
I20260709 12:11:04.026443 11866 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:03.984140 15323 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.030083 11872 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:04.026427 12015 rpcz_store.cc:276] 0709 12:11:02.457980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.458154 (+   174us) service_pool.cc:224] Handling call
0709 12:11:02.484236 (+ 26082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.485455 (+  1219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:02.485486 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.487562 (+  2076us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.982743 (+495181us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.982797 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.982873 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.626577 (+643704us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:04.014912 (+388335us) raft_consensus.cc:1685] finished
0709 12:11:04.014938 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.024672 (+  9734us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":293,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":2471,"spinlock_wait_cycles":11299712,"thread_start_us":492425,"threads_started":1,"wal-append.queue_time_us":738292}
I20260709 12:11:04.032868 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:04.043103 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:04.044579 15627 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:04.005380 15224 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:04.029492 15400 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.036795 15618 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:11:04.064281 12022 pending_rounds.cc:85] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:11:04.064733 12022 pending_rounds.cc:107] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:11:04.064990 12022 raft_consensus.cc:2889] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.045246 11868 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:04.067983 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:04.045073 15595 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:04.021248 15551 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.072328 15642 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:04.068701 15400 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:11:04.078352 15628 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:11:04.079692 15501 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.085985 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.087944 15323 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.094916 11912 leader_election.cc:400] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9.
I20260709 12:11:04.122673 11912 leader_election.cc:403] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:04.097877 15618 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:11:04.099663 15645 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:04.125986 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:04.104398 15407 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.005s
I20260709 12:11:04.106128 15224 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:04.109754 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.073823 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.113421 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:04.078475 15611 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.747s	user 0.004s	sys 0.000s
I20260709 12:11:04.117273 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.121930 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.132735 11866 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:04.133315 11868 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:04.113684 15495 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:11:04.111187 15595 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:04.100040 15475 consensus_meta.cc:287] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.006s
I20260709 12:11:04.126946 11873 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:04.157761 11870 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:04.158545 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 45215.6us
I20260709 12:11:04.117868 15539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41000 (request call id 840) took 3357 ms. Trace:
W20260709 12:11:04.162797 11839 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.659s (SENT)
I20260709 12:11:04.164247 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.166885 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.168498 11870 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 5: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:04.169137 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.170029 11868 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:11:04.169351 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.171032 11870 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 7: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:04.172062 11870 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.172359 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.173429 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.174247 11866 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10. Re-sending same reply.
I20260709 12:11:04.177111 11870 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:04.177341 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 114609us
I20260709 12:11:04.178284 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:04.128746 15633 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.151392 15407 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.160188 15595 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:04.128666 15648 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9.
I20260709 12:11:04.180522 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:04.187325 11942 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.175519 15597 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:04.193699 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:04.194475 12013 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:04.194525 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.195504 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.195899 12013 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:04.196934 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.197190 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.197896 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.198706 11940 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:04.198700 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:04.201212 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.201857 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.202965 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.204033 11945 raft_consensus.cc:2368] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7.
I20260709 12:11:04.159971 15495 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.204591 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.209761 11943 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:04.215493 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.215493 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.216712 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.204847 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.208006 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1884) took 1511 ms. Trace:
I20260709 12:11:04.216856 11939 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.217484 11940 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:04.188773 15642 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.183840 15224 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.217370 11948 rpcz_store.cc:276] 0709 12:11:02.696940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.708384 (+ 11444us) service_pool.cc:224] Handling call
0709 12:11:02.708804 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.751052 (+ 42248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.751115 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.751866 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.218212 (+466346us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.218271 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.218372 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.077843 (+859471us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:04.200123 (+122280us) raft_consensus.cc:1685] finished
0709 12:11:04.200148 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.207915 (+  7767us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44063,"raft.queue_time_us":43533,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4287,"spinlock_wait_cycles":24917760,"thread_start_us":465794,"threads_started":1,"wal-append.queue_time_us":571084}
I20260709 12:11:04.224584 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.191258 15597 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.203649 15493 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.232138 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 72734.6us
W20260709 12:11:04.239347 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 76570.1us
W20260709 12:11:04.240341 11839 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.682s (SENT)
I20260709 12:11:04.242419 11944 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:04.243498 11944 pending_rounds.cc:85] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 8
I20260709 12:11:04.243806 11944 pending_rounds.cc:107] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:04.244127 11944 raft_consensus.cc:2889] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.186292 15633 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.234004 15597 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.259809 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.265609 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:04.241050 15112 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:04.268524 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.278496 11939 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:04.285853 11940 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:04.335644 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 97790.3us
I20260709 12:11:04.242384 15493 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.291208 15112 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.330757 15648 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:04.289305 15652 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.366942 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:04.378551 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.164036 15539 rpcz_store.cc:276] 0709 12:11:00.740072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.740274 (+   202us) service_pool.cc:224] Handling call
0709 12:11:01.227834 (+487560us) ts_tablet_manager.cc:934] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
0709 12:11:02.739436 (+1511602us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:04.023339 (+1283903us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:04.028464 (+  5125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:04.096320 (+ 67856us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:04.096696 (+   376us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:04.097087 (+   391us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:04.097157 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43076,"tablet-copy.queue_time_us":411732,"thread_start_us":440769,"threads_started":2}
W20260709 12:11:04.384502 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 45574.9us
I20260709 12:11:04.363011 15407 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.367713 15652 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:04.445511 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.467334 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 195292us
I20260709 12:11:04.377460 15656 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.455729 15400 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.467303 15519 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.467088 15501 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.466611 15646 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:04.457377 15652 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.457870 15407 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.485033 15147 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.486326 15666 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.509456 15629 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.003s
I20260709 12:11:04.501802 15539 tablet_copy_client.cc:806] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:04.510295 15495 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:04.531908 15651 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:11:04.508637 15519 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.506035 15501 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.510644 15646 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.547613 11871 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.545902 15539 tablet_copy_client.cc:670] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:04.552747 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.553392 11871 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:04.556018 15493 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:04.559115 15644 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.562s	user 0.001s	sys 0.002s
I20260709 12:11:04.525774 15147 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.531283 15629 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.578383 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:04.526034 15666 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.584990 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:04.582283 15659 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 12:11:04.590322 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.590514 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:04.591080 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 99117.2us
I20260709 12:11:04.595986 11872 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
W20260709 12:11:04.596407 11839 connection.cc:256] RPC call timeout handler was delayed by -2.7879256940002506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27940000000000004s for a response
I20260709 12:11:04.591348 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:04.598645 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.599762 11873 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:04.598626 11871 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:11:04.601754 11866 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:04.602852 11868 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:04.604322 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:04.606081 15662 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:11:04.605983 11839 connection.cc:256] RPC call timeout handler was delayed by -1.9162552670002242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 12:11:04.607630 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8397552670001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:11:04.611069 11839 connection.cc:256] RPC call timeout handler was delayed by -1.4752552670001933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:11:04.610532 15647 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.566s	user 0.003s	sys 0.000s
I20260709 12:11:04.616955 15495 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:04.608331 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.612233 15400 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.617686 15495 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:04.614332 15664 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:11:04.615401 15668 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:04.620020 15495 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.617178 15501 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:04.622792 11839 connection.cc:256] RPC call timeout handler was delayed by -1.266455267000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23670000000000002s for a response
W20260709 12:11:04.623314 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0531552670001929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2604s for a response
I20260709 12:11:04.627800 15629 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.635740 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.636859 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.637766 15646 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:04.638556 15655 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:11:04.639755 11866 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:04.640383 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.640945 11868 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:04.639633 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.642733 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.648978 15658 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:04.651108 15147 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.646756 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.659245 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.643049 11872 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.605193 15407 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.644663 15519 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:04.664983 15521 consensus_meta.cc:287] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.008s
I20260709 12:11:04.645464 15629 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.686740 15521 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.688000 15629 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:04.645805 15661 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:11:04.587060 15493 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.646677 15400 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.647537 15633 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.659668 15614 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.645058 15648 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.642921 15666 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.667158 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.672736 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.674687 15615 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.675787 15595 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.678213 15676 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.678717 15323 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.679234 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:04.732038 11867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2207) took 2640 ms (client timeout 1802 ms). Trace:
W20260709 12:11:04.732869 11867 rpcz_store.cc:269] 0709 12:11:02.091884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.092569 (+   685us) service_pool.cc:224] Handling call
0709 12:11:04.731683 (+2639114us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400355cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:04.731925 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586973056}
W20260709 12:11:04.685370 15620 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.003s	user 0.000s	sys 0.001s
W20260709 12:11:04.717996 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 258069us
W20260709 12:11:04.718883 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.723402 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68933.2us
W20260709 12:11:04.693392 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.744316 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:04.740648 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.746361 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:04.748208 15493 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.749373 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:04.749840 15646 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:04.750140 11939 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.750475 15646 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.746030 11948 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:04.711086 15614 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:04.753057 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:04.761561 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.754251 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:04.716857 15521 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.763765 11946 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:04.720351 15615 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:04.765242 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.761153 11948 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:04.768975 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:04.771898 12610 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:04.776718 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:04.777493 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.778020 11948 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:04.778589 11988 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 3.302s (SENT)
I20260709 12:11:04.779727 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.743099 15648 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:04.710680 15400 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.792006 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.796001 11866 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:04.792111 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.777325 15112 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.777130 15493 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:11:04.763489 15597 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:04.798446 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.827351 11939 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
W20260709 12:11:04.906764 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.907145 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:04.907637 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:04.867022 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 88456us
I20260709 12:11:04.908368 11939 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:04.786878 15658 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.786243 15579 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.781733 15674 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.798382 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:04.909134 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.880839 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1783) took 1793 ms. Trace:
I20260709 12:11:04.779560 15578 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:04.915532 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.912710 11869 rpcz_store.cc:276] 0709 12:11:03.087343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.121341 (+ 33998us) service_pool.cc:224] Handling call
0709 12:11:03.165508 (+ 44167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.166033 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.166073 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.166726 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.464386 (+297660us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:03.830616 (+366230us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.830952 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.831039 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.684552 (+853513us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:04.853786 (+169234us) raft_consensus.cc:1685] finished
0709 12:11:04.880551 (+ 26765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.880733 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36282,"prepare.queue_time_us":177648,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":19447,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":52222,"spinlock_wait_cycles":46913408,"thread_start_us":614534,"threads_started":2,"wal-append.queue_time_us":426362}
W20260709 12:11:04.923251 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 125125us
I20260709 12:11:04.794488 15521 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.924774 15400 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.922474 15579 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.796989 15676 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:04.781215 15618 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 12:11:04.878343 15551 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.907694 15629 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.918097 15658 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.781797 15407 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 12:11:04.931962 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:04.786288 15495 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 12:11:04.919525 15674 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.917599 15112 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:04.919915 15501 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.939461 11869 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:04.937527 15400 raft_consensus.cc:2764] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:04.956806 15689 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:04.962742 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 320055us
I20260709 12:11:04.964659 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:04.957063 15680 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:04.938211 15646 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.940228 15658 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.957083 15652 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:04.978585 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:04.979194 15579 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.979331 12602 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.868773 15614 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.936734 15685 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:04.980510 15614 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.980715 15637 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.038s	user 0.006s	sys 0.007s
I20260709 12:11:04.970765 15689 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.950752 15112 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.977191 15597 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.938093 15676 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:04.987905 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 660) took 1021 ms. Trace:
W20260709 12:11:04.988210 11988 connection.cc:256] RPC call timeout handler was delayed by -1.6331310530001701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:11:04.988435 11942 rpcz_store.cc:276] 0709 12:11:03.966569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.966780 (+   211us) service_pool.cc:224] Handling call
0709 12:11:03.967258 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.187894 (+220636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.987608 (+799714us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001c20d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:04.987837 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505400192}
W20260709 12:11:04.990099 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.990617 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.991904 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:04.968983 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:04.940723 15674 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.941977 15578 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:04.974287 15687 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:04.974447 15622 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:04.957623 15684 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:11:04.911538 15648 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:04.969029 15323 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:04.988662 11988 connection.cc:256] RPC call timeout handler was delayed by -1.585431053000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:11:04.985297 15112 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:04.995947 12016 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:05.197055 12016 pending_rounds.cc:85] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:05.197376 12016 pending_rounds.cc:107] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:05.197649 12016 raft_consensus.cc:2889] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:05.163439 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.196655 11988 connection.cc:256] RPC call timeout handler was delayed by -1.5719310530002986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:11:05.203594 11988 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.541s (SENT)
I20260709 12:11:05.204185 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.195024 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:04.942463 15551 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:05.266261 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 62727.7us
W20260709 12:11:05.282426 11988 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.636s (SENT)
I20260709 12:11:05.283305 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:05.296348 11988 connection.cc:256] RPC call timeout handler was delayed by -1.4832188250002218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:11:05.298837 11988 connection.cc:256] RPC call timeout handler was delayed by -1.3903064840001207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:11:04.979490 15652 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.299965 15685 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.308959 15678 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:11:05.310578 15697 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.329298 11947 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.330353 15578 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.333509 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:05.020699 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:05.032073 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.370432 12020 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:05.374475 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:05.336354 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.336490 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:05.338328 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 369379us
I20260709 12:11:05.346961 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:05.377607 12019 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:05.378309 12606 raft_consensus.cc:2410] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:11:05.301720 15676 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.379065 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.379928 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:05.347893 11988 connection.cc:256] RPC call timeout handler was delayed by -1.3631310530001883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:11:05.381193 11988 connection.cc:256] RPC call timeout handler was delayed by -1.3560760350001146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.41600000000000004s for a response
I20260709 12:11:05.381326 12019 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:05.383332 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:05.338297 15666 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.388816 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.335330 15323 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:05.402107 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.403059 12020 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:05.398604 11912 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.414113 11839 leader_election.cc:400] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7.
I20260709 12:11:05.414707 11839 leader_election.cc:403] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.418051 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.350749 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1897) took 1008 ms. Trace:
W20260709 12:11:05.381708 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2067467960000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:11:05.418931 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.419094 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1691188250001687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:11:05.419515 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1525691209999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2877s for a response
I20260709 12:11:05.420377 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.418931 11948 rpcz_store.cc:276] 0709 12:11:04.340767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.336865 (+996098us) service_pool.cc:224] Handling call
0709 12:11:05.337298 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.337524 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.337580 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.337653 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:05.337701 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.348400 (+ 10699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.348757 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:05.426357 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 495316us
I20260709 12:11:05.428748 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.394465 15676 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.430737 12020 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.429653 11868 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:05.416713 15386 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.446329 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.427678 15697 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.458901 15700 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:05.459039 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.461592 11871 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.463971 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.431315 15689 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.427251 15666 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.469358 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.464959 11866 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:05.440955 15521 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.401022 15323 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.467911 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:05.475456 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.478914 12020 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:05.482532 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64597.5us
I20260709 12:11:05.484163 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.484992 15666 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.485031 15323 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.473052 15676 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.466823 15711 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 6. Current term is 7.
I20260709 12:11:05.478555 15706 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:05.502384 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:05.504694 12020 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.507778 11866 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:05.488202 15691 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:05.509179 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.489260 15551 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:05.466478 15697 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.510195 15711 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:11:05.515221 15697 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:05.515893 15697 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.508086 15706 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.516348 15697 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:05.516952 15697 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.518261 15658 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.002s
I20260709 12:11:05.518422 15706 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.518800 15658 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:05.519315 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.520354 15701 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:05.520913 15658 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:05.521493 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.521741 11866 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
W20260709 12:11:05.521549 15695 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 12:11:05.469345 15700 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.523645 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.523984 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.524412 11866 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:05.524614 11867 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:11:05.525590 15700 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:05.525421 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.527285 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.528524 11867 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.529368 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:05.525316 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.530081 12015 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:05.531116 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:05.532953 15643 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.489s	user 0.002s	sys 0.008s
I20260709 12:11:05.536738 11871 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:05.537653 15553 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:05.538553 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1895) took 1250 ms. Trace:
I20260709 12:11:05.538446 15553 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.538854 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:05.538969 11939 rpcz_store.cc:276] 0709 12:11:04.287907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.917613 (+629706us) service_pool.cc:224] Handling call
0709 12:11:04.928823 (+ 11210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.941476 (+ 12653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.941528 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.953845 (+ 12317us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.448426 (+494581us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:05.448514 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.448616 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.538324 (+ 89708us) raft_consensus.cc:1685] finished
0709 12:11:05.538348 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.538481 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9639,"raft.queue_time_us":13690,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":8122,"thread_start_us":306350,"threads_started":2,"wal-append.queue_time_us":534977}
I20260709 12:11:05.541021 15691 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.543409 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:05.544564 15711 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:05.545192 15711 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.544922 15674 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:05.545583 15711 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:05.546439 15711 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.547346 15674 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.547760 15711 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.550503 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:05.504436 12602 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.004s
W20260709 12:11:05.510583 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48638.9us
I20260709 12:11:05.565595 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.566479 11871 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:05.567324 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.567637 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.568349 11871 raft_consensus.cc:2368] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:05.570494 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.560297 12602 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:05.604489 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:05.605324 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:05.602623 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 127273us
I20260709 12:11:05.606287 11866 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:05.607300 11867 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:05.611492 15719 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:05.604190 15666 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:05.612349 15719 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.612550 15666 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.614758 15666 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.614825 15719 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:05.611690 15323 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.618106 11866 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:05.617990 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.619465 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:05.616125 12577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.010s	sys 0.028s
I20260709 12:11:05.619755 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:05.620756 12577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.010s	sys 0.028s
I20260709 12:11:05.611126 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.622057 11867 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.622402 11871 raft_consensus.cc:2368] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
W20260709 12:11:05.621183 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 698912us
I20260709 12:11:05.624732 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.615388 15666 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.626825 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.629323 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.630532 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.631595 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.632604 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.633606 11871 raft_consensus.cc:2368] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:05.625509 11866 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:05.637282 11867 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:05.638195 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.640101 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:05.641821 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.642537 11866 raft_consensus.cc:2376] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7. Re-sending same reply.
I20260709 12:11:05.643939 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.645774 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.647274 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:05.648178 11867 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:05.649706 11866 raft_consensus.cc:2376] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12. Re-sending same reply.
I20260709 12:11:05.657516 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:05.655172 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46254.7us
I20260709 12:11:05.622305 15323 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.660899 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.662225 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.646315 15666 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:05.676247 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 71949.3us
I20260709 12:11:05.679610 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:05.645192 15224 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:05.724017 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.685871 15712 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.725786 12577 leader_election.cc:400] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:05.718003 15648 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.755646 12577 leader_election.cc:403] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.720446 15553 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.767048 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:05.724426 15726 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.758880 15712 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:05.763152 15714 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:11:05.722311 15706 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:05.721607 15578 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:05.766217 15386 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.726948 15705 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:11:05.754928 15699 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:11:05.794276 15723 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:11:05.784217 15323 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.784703 15224 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.795348 15224 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.795812 15224 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.781122 15666 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.785969 15725 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:05.783823 15724 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:11:05.826612 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.777402 15712 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.781191 15726 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:05.866008 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99060.8us
W20260709 12:11:05.865075 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 202916us
I20260709 12:11:05.865314 15706 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:05.872692 15705 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.779641 15728 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:11:05.863767 15725 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:05.868261 15714 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:11:05.879900 15521 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:05.880275 15712 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.851903 15224 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:05.888255 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 163980us
I20260709 12:11:05.866860 15720 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.894676 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:05.894639 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.892578 15705 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:05.900996 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.905234 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.904628 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:05.906488 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.886932 15697 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:05.931865 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:05.905719 15592 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.936403 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.938759 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.902431 15720 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:05.900027 15735 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:05.943315 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:05.930014 15614 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:05.910019 15739 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:05.959488 12611 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.946669 12577 leader_election.cc:400] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:05.911779 15521 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.968133 15521 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.971040 15725 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:05.972153 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.972260 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:05.973896 15641 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.970s	user 0.007s	sys 0.010s
I20260709 12:11:05.975335 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 701) took 2288 ms. Trace:
I20260709 12:11:05.975687 15705 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.977272 15705 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.984328 15636 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.985s	user 0.008s	sys 0.007s
I20260709 12:11:05.987375 15697 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:05.959445 15551 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.909782 15740 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:11:05.957486 15729 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:05.955158 15735 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.964459 15728 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:05.997409 12577 connection.cc:256] RPC call timeout handler was delayed by -1.2962621000001491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:11:06.615444 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:05.994990 12607 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 5 LEARNER]: Advancing to term 7
I20260709 12:11:05.993526 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:05.993311 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:05.975713 12021 rpcz_store.cc:276] 0709 12:11:03.686426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.686706 (+   280us) service_pool.cc:224] Handling call
0709 12:11:03.687013 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.703866 (+ 16853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.703897 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.704455 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.811416 (+106961us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:03.811463 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.811542 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.903004 (+2091462us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:05.974988 (+ 71984us) raft_consensus.cc:1685] finished
0709 12:11:05.975013 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.975246 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17368,"raft.queue_time_us":17736,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3005,"spinlock_wait_cycles":220855680,"thread_start_us":106611,"threads_started":1,"wal-append.queue_time_us":299089}
I20260709 12:11:06.015221 15741 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.623291 15741 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.623778 15741 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.995136 12019 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:06.248383 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1678) took 2051 ms. Trace:
I20260709 12:11:06.428030 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1686) took 2204 ms. Trace:
I20260709 12:11:06.886708 11944 rpcz_store.cc:276] 0709 12:11:04.197397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.217693 (+ 20296us) service_pool.cc:224] Handling call
0709 12:11:04.229771 (+ 12078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.244718 (+ 14947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.247927 (+2003209us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54001c1954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:06.248282 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27773184}
I20260709 12:11:06.577389 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:06.579103 11869 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.592540 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1680) took 2394 ms. Trace:
W20260709 12:11:06.649838 11946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1672) took 2455 ms (client timeout 2431 ms). Trace:
W20260709 12:11:06.891893 11946 rpcz_store.cc:269] 0709 12:11:04.194071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.194231 (+   160us) service_pool.cc:224] Handling call
0709 12:11:06.649476 (+2455245us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400426b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:06.649702 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301245696}
W20260709 12:11:06.892388 12019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2356) took 1436 ms (client timeout 1742 ms). Trace:
W20260709 12:11:06.396737 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.654419 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:06.896502 15685 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.896854 11873 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:06.409024 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:06.898798 12013 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:06.335332 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:06.900983 12016 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.612506 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:06.906595 12017 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.910995 15147 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.911659 15147 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:05.975718 12605 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 4: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:11:06.340492 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 401800us
I20260709 12:11:06.919269 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:06.920258 15202 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:06.920708 15202 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.921114 15202 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.290946 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:06.927259 12015 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:06.266144 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:06.347837 12610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40986 (request call id 620) took 1480 ms. Trace:
I20260709 12:11:06.928989 12020 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
W20260709 12:11:06.582151 12611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.022s	sys 0.011s
W20260709 12:11:06.932046 12611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.024s	sys 0.012s
W20260709 12:11:06.359266 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.934450 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:06.935379 15521 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.936528 15519 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.937495 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:06.942893 12604 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:06.943082 11771 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 9, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 9 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:06.929369 12610 rpcz_store.cc:276] 0709 12:11:04.867285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.867561 (+   276us) service_pool.cc:224] Handling call
0709 12:11:06.343494 (+1475933us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b5800003c98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:11:06.343736 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.343963 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:06.346165 (+  2202us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.347357 (+  1192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.347419 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.347476 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.347573 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.347754 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1190,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":112,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":13467008,"thread_start_us":2559,"threads_started":2,"wal-append.queue_time_us":1497}
I20260709 12:11:06.946411 11771 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 7, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:06.638176 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:06.950155 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 312089us
I20260709 12:11:06.950171 15705 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.950788 15705 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:06.951200 15705 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.266856 15224 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:06.025420 15432 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:05.997759 15551 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:06.486231 15595 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:06.558373 15614 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:06.961704 15521 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.962499 15521 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:06.963281 15519 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:06.963541 15521 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:06.447827 15622 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:06.967015 15622 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:06.968098 15622 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:06.462292 15632 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 2.465s	user 0.021s	sys 0.002s
I20260709 12:11:06.619709 15646 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:06.068915 15649 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.994s	user 0.000s	sys 0.021s
I20260709 12:11:06.998512 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1801) took 3534 ms. Trace:
W20260709 12:11:06.246649 15660 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.757s	user 0.003s	sys 0.014s
I20260709 12:11:06.998994 11864 rpcz_store.cc:276] 0709 12:11:03.463710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.464185 (+   475us) service_pool.cc:224] Handling call
0709 12:11:03.482480 (+ 18295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.483031 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.483079 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.483831 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.788439 (+304608us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:03.788485 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.788562 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.461608 (+2673046us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:06.998182 (+536574us) raft_consensus.cc:1685] finished
0709 12:11:06.998206 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.998438 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10403,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7871,"spinlock_wait_cycles":173036416,"thread_start_us":263177,"threads_started":1,"wal-append.queue_time_us":487957}
I20260709 12:11:06.993734 15413 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.486693 15673 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.459856 15678 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:06.391825 15691 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:06.308761 15707 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.803s	user 0.004s	sys 0.000s
I20260709 12:11:06.507473 15706 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:07.039022 15706 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:07.039973 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2341) took 2009 ms. Trace:
I20260709 12:11:07.040041 12611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 437) took 1077 ms. Trace:
I20260709 12:11:07.040340 12018 rpcz_store.cc:276] 0709 12:11:05.030580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.030741 (+   161us) service_pool.cc:224] Handling call
0709 12:11:05.031200 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.031671 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.031711 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.032364 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.405646 (+373282us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:05.405708 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.406750 (+  1042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.307988 (+901238us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:07.039627 (+731639us) raft_consensus.cc:1685] finished
0709 12:11:07.039649 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.039916 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":246888,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":19339,"spinlock_wait_cycles":4194560,"thread_start_us":372751,"threads_started":1,"wal-append.queue_time_us":440557}
I20260709 12:11:05.996778 15712 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:06.031337 15720 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:06.029870 15726 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.946432 15736 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.021190 15735 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:06.265229 15746 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:06.264937 15749 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:06.647559 15741 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:06.639532 15750 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:06.776473 15689 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.793795 15509 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.796073 15656 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.807891 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2215) took 3215 ms. Trace:
I20260709 12:11:06.839315 15158 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:06.852087 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:07.049481 12602 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:07.058157 12022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2347) took 2007 ms (client timeout 1719 ms). Trace:
W20260709 12:11:07.058740 12022 rpcz_store.cc:269] 0709 12:11:05.050585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.117494 (+ 66909us) service_pool.cc:224] Handling call
0709 12:11:06.851840 (+1734346us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:11:07.058070 (+206230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8099200}
W20260709 12:11:06.860217 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 928358us
I20260709 12:11:06.873077 15742 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.061331 12602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40986 (request call id 627) took 1092 ms. Trace:
I20260709 12:11:07.062301 12602 rpcz_store.cc:276] 0709 12:11:05.968974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.969218 (+   244us) service_pool.cc:224] Handling call
0709 12:11:05.969760 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.058426 (+1088666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.061024 (+  2598us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400624b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:07.061252 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482421120}
W20260709 12:11:06.875667 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 914008us
I20260709 12:11:06.878391 15578 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.878609 15386 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.069754 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:06.546875 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:07.070827 11872 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:11:07.071352 11872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2242) took 2281 ms (client timeout 1719 ms). Trace:
W20260709 12:11:06.892913 12019 rpcz_store.cc:269] 0709 12:11:05.455906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.467660 (+ 11754us) service_pool.cc:224] Handling call
0709 12:11:06.891855 (+1424195us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54000474d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:06.892247 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986473856}
W20260709 12:11:07.050916 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.887256 11941 rpcz_store.cc:276] 0709 12:11:04.225210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.751876 (+526666us) service_pool.cc:224] Handling call
0709 12:11:06.427659 (+1675783us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540038fed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:06.427920 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945763712}
I20260709 12:11:06.897181 15685 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:06.232385 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:06.914093 15147 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:06.632675 12607 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 7 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:07.055645 15689 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.076437 12607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 441) took 1083 ms. Trace:
I20260709 12:11:07.076879 12607 rpcz_store.cc:276] 0709 12:11:05.992869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.994399 (+  1530us) service_pool.cc:224] Handling call
0709 12:11:05.994798 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.076183 (+1081385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.076387 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.956795 15480 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:06.958089 15539 tablet_copy_client.cc:538] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:07.078327 15689 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.056015 15509 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.056105 15656 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:06.958526 15725 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:07.083149 15725 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.083973 15656 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.085351 15725 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:06.959512 15551 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.056257 11865 rpcz_store.cc:276] 0709 12:11:03.592371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.813205 (+220834us) service_pool.cc:224] Handling call
0709 12:11:06.803918 (+2990713us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5800002798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:11:06.804246 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.804577 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:06.806533 (+  1956us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.807424 (+   891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.807485 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.807538 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.807620 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.807786 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1037,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":1526,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":11907328,"thread_start_us":2120,"threads_started":2,"wal-append.queue_time_us":914}
I20260709 12:11:06.961884 15614 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:06.586815 15615 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.092504 15615 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:06.463136 15619 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 2.465s	user 0.016s	sys 0.002s
I20260709 12:11:07.057235 15706 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:06.971827 12016 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:07.096650 15706 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:07.096797 12016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2348) took 2045 ms (client timeout 2061 ms). Trace:
I20260709 12:11:06.972827 12017 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:07.097247 12016 rpcz_store.cc:269] 0709 12:11:05.050949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.331142 (+280193us) service_pool.cc:224] Handling call
0709 12:11:06.335094 (+1003952us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:11:07.096735 (+761641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8350592}
W20260709 12:11:07.097836 12017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2342) took 2066 ms (client timeout 2220 ms). Trace:
I20260709 12:11:06.972316 15432 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:06.982215 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:07.098529 15432 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.057518 15158 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.100721 15432 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.013994 11771 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 2 to 4, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 4 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.101867 11771 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.103389 11771 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.104727 11771 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.016963 11870 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:07.018069 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:07.015322 15597 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:07.127117 15597 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:07.025952 11769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 192) took 15720 ms (client timeout 15000 ms). Trace:
I20260709 12:11:07.023365 15673 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:07.027982 11802 debug-util.cc:398] Leaking SignalData structure 0x7b080031a000 after lost signal to thread 10700
I20260709 12:11:07.030555 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:07.145969 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 115519us
I20260709 12:11:07.021760 15705 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.040556 12611 rpcz_store.cc:276] 0709 12:11:05.962302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.962475 (+   173us) service_pool.cc:224] Handling call
0709 12:11:05.962968 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.932478 (+969510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.932516 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.933070 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.993138 (+ 60068us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.993183 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.993262 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.039816 (+ 46554us) raft_consensus.cc:1685] finished
0709 12:11:07.039840 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.039976 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1951,"raft.queue_time_us":11007,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":1026574,"threads_started":2,"wal-append.queue_time_us":87079}
I20260709 12:11:07.044656 15413 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:07.147230 15673 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.029081 15678 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.148170 15705 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:06.889777 11940 rpcz_store.cc:276] 0709 12:11:04.197979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.222245 (+ 24266us) service_pool.cc:224] Handling call
0709 12:11:04.279402 (+ 57157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.286288 (+  6886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.592312 (+2306024us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54003d5c50. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:06.592466 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130379520}
I20260709 12:11:07.149258 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:07.149566 15678 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.051481 15749 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.074451 15685 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:07.069015 15578 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.156015 15742 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.156493 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.157168 11939 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:07.075120 12603 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:07.050590 15746 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:07.154227 15553 consensus_queue.cc:1175] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:07.159499 15746 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:07.094568 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.969389 15622 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.098834 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 693) took 4378 ms. Trace:
W20260709 12:11:07.098737 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 116663us
I20260709 12:11:07.163152 12014 rpcz_store.cc:276] 0709 12:11:02.720745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.720893 (+   148us) service_pool.cc:224] Handling call
0709 12:11:02.721278 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.721666 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.721696 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.759274 (+ 37578us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:11:02.759907 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.472430 (+712523us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.472492 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.472608 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.462480 (+2989872us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:07.097447 (+634967us) raft_consensus.cc:1685] finished
0709 12:11:07.097472 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.098742 (+  1270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":405,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":272111872,"thread_start_us":712011,"threads_started":1,"wal-append.queue_time_us":1237029}
I20260709 12:11:06.972620 15202 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.016842 11864 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:07.098250 12017 rpcz_store.cc:269] 0709 12:11:05.030949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.033381 (+  2432us) service_pool.cc:224] Handling call
0709 12:11:06.612249 (+1578868us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:11:07.097767 (+485518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8248064}
W20260709 12:11:07.107549 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46076.7us
W20260709 12:11:07.071738 11872 rpcz_store.cc:269] 0709 12:11:04.790231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.790359 (+   128us) service_pool.cc:224] Handling call
0709 12:11:06.546652 (+1756293us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b5800002798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:11:07.071277 (+524625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4710656}
I20260709 12:11:07.108600 15519 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.109787 15158 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:07.081269 15509 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.054381 15741 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:07.113858 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 3.026s (SENT) [suppressed 31 similar messages]
W20260709 12:11:07.187399 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 73579.1us
I20260709 12:11:07.118399 15224 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:07.119059 15147 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.119555 15595 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.120072 15712 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:07.121320 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:11:07.145326 11769 rpcz_store.cc:269] 0709 12:10:51.306035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.306232 (+   197us) service_pool.cc:224] Handling call
0709 12:11:07.025831 (+15719599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:03.762672 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:03.995346 (+232674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:04.001606 (+  6260us) write_op.cc:435] Acquired schema lock
0709 12:11:04.004698 (+  3092us) tablet.cc:662] Decoding operations
0709 12:11:04.079272 (+ 74574us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:04.079348 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:04.079380 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:11:04.080095 (+   715us) tablet.cc:701] Row locks acquired
0709 12:11:04.080115 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:11:04.080322 (+   207us) write_op.cc:270] Start()
0709 12:11:04.080452 (+   130us) write_op.cc:276] Timestamp: P: 1783599064080261 usec, L: 0
0709 12:11:04.080474 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:04.188606 (+108132us) log.cc:844] Serialized 2482 byte log entry
0709 12:11:04.920169 (+731563us) op_driver.cc:464] REPLICATION: finished
0709 12:11:05.462702 (+542533us) write_op.cc:301] APPLY: starting
0709 12:11:05.469586 (+  6884us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:05.479162 (+  9576us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:05.479342 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:05.504681 (+ 25339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:05.514358 (+  9677us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:11:05.514423 (+    65us) write_op.cc:312] APPLY: finished
0709 12:11:05.514778 (+   355us) log.cc:844] Serialized 53 byte log entry
0709 12:11:05.514976 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.515119 (+   143us) write_op.cc:454] Released schema lock
0709 12:11:05.515174 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:05.904967 (+389793us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2ee28 00007f1f1f469581 00007f1f1f468d58 00007f1f1f46d9f1 00007f1f1f46d9a9 00007f1f1f46d939 00007f1f1f46d901 00007f1f1f46cb2d 0000000000388634 0000000000388479
0709 12:11:05.935988 (+ 31021us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.937705 (+  1717us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1689829,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":521715,"apply.run_cpu_time_us":3931,"apply.run_wall_time_us":67507,"num_ops":6,"prepare.queue_time_us":380012,"prepare.run_cpu_time_us":52588,"prepare.run_wall_time_us":2168805,"raft.queue_time_us":261369,"raft.run_cpu_time_us":10369,"raft.run_wall_time_us":457184,"replication_time_us":820425,"spinlock_wait_cycles":69838592,"thread_start_us":965084,"threads_started":4,"wal-append.queue_time_us":189622,"wal-append.run_cpu_time_us":19160,"wal-append.run_wall_time_us":2136157}]]}
I20260709 12:11:07.212514 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:07.212740 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:07.128579 11771 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index -1 to 4, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:11:07.215267 11771 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 7, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.142068 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.144601 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.134716 15597 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:07.146080 15770 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.071926 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.150767 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.151122 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:07.152134 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800331f20 after lost signal to thread 11805
W20260709 12:11:07.259245 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08002ecfe0 after lost signal to thread 11819
W20260709 12:11:07.226289 10702 debug-util.cc:398] Leaking SignalData structure 0x7b080000ffc0 after lost signal to thread 11914
I20260709 12:11:07.148567 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:07.152282 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.165177 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.171196 12603 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:11:07.171988 15685 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:07.267480 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 102381us
I20260709 12:11:07.191068 11864 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.176086 15746 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:11:07.202165 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:07.202838 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:07.224233 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:07.268486 11988 leader_election.cc:400] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 5. Current term is 6.
I20260709 12:11:07.268666 11865 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.261859 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 440) took 1269 ms. Trace:
I20260709 12:11:07.231040 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:07.268573 12015 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.262982 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:07.260711 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800035dc0 after lost signal to thread 11897
I20260709 12:11:07.270115 11871 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.270849 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.271639 15553 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.267657 12016 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:07.272547 15158 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.145396 15551 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.269337 12603 rpcz_store.cc:276] 0709 12:11:05.992539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.994281 (+  1742us) service_pool.cc:224] Handling call
0709 12:11:07.261793 (+1267512us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.262705 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 114218us
I20260709 12:11:07.274531 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.274689 15551 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.275278 15720 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.275780 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:07.276964 15736 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.277357 15736 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:11:07.271090 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08000354a0 after lost signal to thread 11972
I20260709 12:11:07.225124 15614 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.275390 12611 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.278277 15614 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.268708 11873 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.280612 15614 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:07.281468 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800035480 after lost signal to thread 11973
I20260709 12:11:07.284790 15578 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.277503 15750 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.285571 15750 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:07.285989 15750 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.267550 11867 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:07.287601 11802 debug-util.cc:398] Leaking SignalData structure 0x7b080037e620 after lost signal to thread 12046
W20260709 12:11:07.287925 11802 debug-util.cc:398] Leaking SignalData structure 0x7b0800395d60 after lost signal to thread 12047
I20260709 12:11:07.272078 15553 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:07.290696 15553 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.292109 15539 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:11:07.225937 15650 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:07.294484 15650 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:07.295475 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1300 after lost signal to thread 12635
W20260709 12:11:07.295845 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08003b12c0 after lost signal to thread 12636
I20260709 12:11:07.296675 15650 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:07.296896 11802 debug-util.cc:398] Leaking SignalData structure 0x7b08003580e0 after lost signal to thread 15637
I20260709 12:11:07.277794 15736 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.282341 15749 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:07.309854 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 710) took 1042 ms. Trace:
I20260709 12:11:07.310582 12013 rpcz_store.cc:276] 0709 12:11:06.266975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.899636 (+632661us) service_pool.cc:224] Handling call
0709 12:11:06.900035 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.161864 (+261829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.161900 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.162517 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.265398 (+102881us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.265434 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.265900 (+   466us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540015d454. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:07.265941 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.266754 (+   813us) raft_consensus.cc:1685] finished
0709 12:11:07.266768 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.309738 (+ 42970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601381760,"thread_start_us":102387,"threads_started":1,"wal-append.queue_time_us":102889}
I20260709 12:11:07.300688 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:07.313858 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.315452 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:07.316857 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.317133 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.208717 15595 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.299710 11871 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:07.283854 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.301028 11865 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:07.323174 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.226634 11771 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.323807 11943 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:07.305260 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:07.308503 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:07.211103 15519 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.319839 11867 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:07.313848 11873 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:07.226836 15509 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.321758 12610 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:07.326488 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.260663 15770 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.324672 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.330462 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:07.322057 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.327653 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:07.338467 11944 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.262384 15691 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.205971 15147 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.346763 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.347402 11943 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:07.314908 15642 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.206566 15224 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.332147 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:07.327625 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:07.355815 11866 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.328985 11871 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:07.358949 12607 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.324513 11771 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 9, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.361492 11771 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.211027 15712 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.340123 11867 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:07.298585 15673 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.297760 15158 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:07.310387 15685 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.342363 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.343360 12019 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:07.345218 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.415777 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.416334 11944 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:07.323450 15615 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.348253 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.226481 15743 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.362996 11771 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.330847 15519 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.316587 15597 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:07.336578 15761 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.359813 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:07.399712 11839 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.777s (SENT)
I20260709 12:11:07.298759 15715 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:07.330639 15749 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:07.344410 15763 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:07.405459 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:07.436550 11867 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:07.408957 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76878.2us
I20260709 12:11:07.339339 15656 raft_consensus.cc:476] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:07.327989 11865 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:07.340397 15770 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.323843 15765 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:11:07.424523 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.416618 11948 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:07.441633 11948 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.412741 11866 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:07.432700 11945 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:07.419860 11771 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.427532 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.434047 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.437836 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:07.449962 11946 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:07.450768 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.437901 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.439021 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.351246 15705 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:07.444893 11939 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:07.447054 11948 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.453173 11771 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:07.458073 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 58399.6us
I20260709 12:11:07.458743 11771 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 8, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:07.414896 15719 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.350894 15691 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:07.459386 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.454427 11943 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:07.341408 15509 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.423266 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.462903 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.432106 15761 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:07.436322 15763 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.401726 15673 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.486085 11988 leader_election.cc:400] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:07.486815 11988 leader_election.cc:403] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.453969 15678 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.368026 15642 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.461197 15413 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.506666 15595 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:07.434509 15615 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.442233 15622 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:07.515033 12015 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:07.514199 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.435092 15743 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.518249 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:07.522099 12021 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.447781 15650 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:11:07.486387 15761 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.489989 15763 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:07.493885 15521 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:07.530265 11941 raft_consensus.cc:606] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:07.501679 15202 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:07.537055 15224 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:07.539393 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.563241 11942 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.542658 11941 raft_consensus.cc:614] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.531309 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:07.557626 15726 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.568442 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:07.570591 12019 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:07.623108 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.634377 11942 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
W20260709 12:11:07.636279 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.564638 15432 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.561395 15764 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
W20260709 12:11:07.670179 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800162c80 after lost signal to thread 10700
W20260709 12:11:07.671998 11969 debug-util.cc:398] Leaking SignalData structure 0x7b080016b500 after lost signal to thread 11805
W20260709 12:11:07.672570 11969 debug-util.cc:398] Leaking SignalData structure 0x7b080016b3e0 after lost signal to thread 11819
W20260709 12:11:07.673012 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800162f20 after lost signal to thread 11825
I20260709 12:11:07.578166 15622 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.567831 15726 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:07.675524 11969 debug-util.cc:398] Leaking SignalData structure 0x7b080037b3e0 after lost signal to thread 11897
W20260709 12:11:07.757011 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08001691a0 after lost signal to thread 11912
W20260709 12:11:07.757386 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1000 after lost signal to thread 11914
W20260709 12:11:07.758817 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab940 after lost signal to thread 11972
W20260709 12:11:07.759231 11969 debug-util.cc:398] Leaking SignalData structure 0x7b080037b060 after lost signal to thread 11973
W20260709 12:11:07.760905 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800318160 after lost signal to thread 12046
W20260709 12:11:07.761281 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ca0 after lost signal to thread 12047
W20260709 12:11:07.753245 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.765164 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08003488e0 after lost signal to thread 12635
W20260709 12:11:07.766877 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800390a00 after lost signal to thread 12636
W20260709 12:11:07.767439 11969 debug-util.cc:398] Leaking SignalData structure 0x7b0800336660 after lost signal to thread 15386
W20260709 12:11:07.768594 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08002f53a0 after lost signal to thread 15544
W20260709 12:11:07.769640 11969 debug-util.cc:398] Leaking SignalData structure 0x7b08000f99a0 after lost signal to thread 15609
W20260709 12:11:07.772482 11839 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.753s (SENT)
I20260709 12:11:07.773015 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:07.777002 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.793s (SENT)
I20260709 12:11:07.777499 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:07.779063 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.780120 11941 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:07.667547 15432 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:07.768564 15619 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:11:07.775352 15621 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.840622 12014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.008s
W20260709 12:11:07.763316 15737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.006s
I20260709 12:11:07.775650 15147 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.787667 15656 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.847421 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.859268 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.784228 15741 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.889783 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.843760 15712 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.788714 15719 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:07.808010 15480 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.873857 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:07.766645 15622 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.851038 15615 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.850708 15652 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:07.889151 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 433902us
W20260709 12:11:07.871496 15737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.007s
W20260709 12:11:07.900868 11940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.012s
I20260709 12:11:07.856763 15685 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:07.885124 15413 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:07.847012 12014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.005s	sys 0.008s
I20260709 12:11:07.893075 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:07.873404 15746 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:07.915074 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:07.920843 11940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.012s	sys 0.012s
I20260709 12:11:07.893934 15147 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:07.926062 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:07.921880 11947 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.024s
W20260709 12:11:07.930490 11947 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.004s	sys 0.024s
I20260709 12:11:07.931278 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:07.933241 11943 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:07.858371 15726 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.859083 15621 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:07.913100 15691 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:07.944775 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.939011 15615 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:07.968140 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 191145us
W20260709 12:11:07.955046 15780 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:11:07.939617 15712 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.975236 15673 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:07.919375 15652 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:07.981328 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.964102 15726 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:07.980733 15553 consensus_meta.cc:287] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.000s
W20260709 12:11:07.985879 11839 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.820s (SENT)
W20260709 12:11:08.028126 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53664.8us
I20260709 12:11:07.894723 15432 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:07.935521 15746 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:08.029011 11839 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.847s (SENT)
I20260709 12:11:08.042407 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:07.983918 15736 consensus_meta.cc:287] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.002s
I20260709 12:11:07.988924 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:07.959976 15509 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:08.048774 11839 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.860s (SENT)
I20260709 12:11:07.983042 15720 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.051466 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:07.954417 15592 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:11:07.983428 15691 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.998926 15147 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:08.068883 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 129127us
W20260709 12:11:08.088430 12020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.006s
W20260709 12:11:08.089521 12020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.005s	sys 0.006s
I20260709 12:11:08.091001 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.091719 11869 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
W20260709 12:11:08.094715 11872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.001s	sys 0.021s
I20260709 12:11:08.050951 15656 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:08.097105 11872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.002s	sys 0.021s
W20260709 12:11:08.100075 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 184993us
W20260709 12:11:08.103224 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.055161 15720 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:08.085611 15761 consensus_meta.cc:287] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:11:08.116093 12609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:08.042757 15553 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.121896 12609 raft_consensus.cc:606] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:08.128415 12609 raft_consensus.cc:614] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:08.071343 15509 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.072302 15592 consensus_queue.cc:1243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:08.070119 15797 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.046172 15719 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.142216 15147 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.146751 15642 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.055586 15736 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.125764 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:08.129401 15781 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:11:08.161273 12608 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.118156 15615 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.046576 15413 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.209987 15615 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.097817 15224 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:08.057489 15763 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.090474 15691 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.197898 15553 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:08.214350 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53855.2us
I20260709 12:11:08.133889 15712 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.250178 15480 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.250943 15480 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.251446 15736 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:08.252583 15807 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:08.252664 15746 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:08.253504 15480 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.253885 15652 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.254106 15763 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:08.254793 15622 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:08.255143 15790 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260709 12:11:08.255602 15735 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.255884 15224 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.256210 15735 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.256397 15224 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.126479 15761 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.255044 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:08.258986 12609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:08.262411 12609 raft_consensus.cc:606] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:08.255002 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 130785us
I20260709 12:11:08.259771 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.265178 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:08.266523 12606 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
W20260709 12:11:08.248004 15782 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:11:08.270213 12609 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.231716 15797 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:08.277081 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2367) took 1056 ms. Trace:
I20260709 12:11:08.282241 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:08.287694 12014 rpcz_store.cc:276] 0709 12:11:07.220319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.220985 (+   666us) service_pool.cc:224] Handling call
0709 12:11:07.221361 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.221661 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:07.922829 (+701168us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.273732 (+350903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.273822 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:08.276450 (+  2628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.276765 (+   315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.276989 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90245,"prepare.queue_time_us":447707,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":297,"thread_start_us":942604,"threads_started":2}
W20260709 12:11:08.294613 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47754.7us
I20260709 12:11:08.297709 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.300145 12607 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:08.254127 15621 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.310993 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.259559 15224 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.299434 15712 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.308290 15761 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.315462 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.317324 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:08.278415 15799 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:11:08.322818 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:08.323196 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.324280 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.321142 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.329039 12016 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:08.281313 15765 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.338792 15224 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.338932 15797 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.341871 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.342645 12609 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:08.343806 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:08.344515 12018 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.344743 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.345455 12020 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:08.346213 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.348968 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:08.349233 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:08.257265 15735 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.274175 15819 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:08.329070 15750 consensus_meta.cc:287] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 1.043s	user 0.017s	sys 0.000s
I20260709 12:11:08.315362 15652 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.244315 15720 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.290082 15616 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:11:08.363569 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.363477 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.364070 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2368) took 1143 ms. Trace:
W20260709 12:11:08.412462 15773 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.998s	user 0.007s	sys 0.000s
I20260709 12:11:08.413724 11946 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:08.416395 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1704) took 1075 ms. Trace:
I20260709 12:11:08.377869 15652 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.383247 15763 raft_consensus.cc:1027] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: attempt to promote peer 189a165e6619406382914fe3075dd436: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 12:11:08.384408 15770 consensus_meta.cc:287] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.004s
I20260709 12:11:08.333133 15621 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:08.404839 12605 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.436172 15652 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.366389 15750 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.447077 12611 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.412719 12017 rpcz_store.cc:276] 0709 12:11:07.220701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.222011 (+  1310us) service_pool.cc:224] Handling call
0709 12:11:07.222386 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.222982 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.223024 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.223688 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.779058 (+555370us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:07.779128 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.779208 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.363790 (+584582us) raft_consensus.cc:1685] finished
0709 12:11:08.363816 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.364002 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":35536,"thread_start_us":479738,"threads_started":1,"wal-append.queue_time_us":667803}
I20260709 12:11:08.448271 15750 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.367776 12013 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:11:08.355345 15656 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.450937 15656 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.451498 15656 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.421698 15820 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.453974 15820 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:08.455567 15519 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.013s	user 0.015s	sys 0.000s
I20260709 12:11:08.456076 15519 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.457067 15820 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:08.457331 12015 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:08.462044 15691 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:08.422433 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.422655 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.469453 11837 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:08.425209 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:08.426874 11946 rpcz_store.cc:276] 0709 12:11:07.340620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.451604 (+110984us) service_pool.cc:224] Handling call
0709 12:11:08.413291 (+961687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.414179 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.416131 (+  1952us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003d5250. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:08.416315 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210911488}
W20260709 12:11:08.471185 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46076.2us
I20260709 12:11:08.430805 12018 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:08.424028 15819 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.441634 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:08.410976 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1694) took 1099 ms. Trace:
I20260709 12:11:08.479985 11942 rpcz_store.cc:276] 0709 12:11:07.311693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.317920 (+  6227us) service_pool.cc:224] Handling call
0709 12:11:08.410703 (+1092783us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003d5254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:08.410877 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517667584}
I20260709 12:11:08.475672 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:08.477247 15621 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.468601 15715 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.482192 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:08.486819 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:08.489624 11946 raft_consensus.cc:606] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:08.497643 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:08.501487 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.504068 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.026s	sys 0.051s
I20260709 12:11:08.503997 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:08.505426 11942 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.510461 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.511598 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.512187 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.512917 11873 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:08.513032 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.512259 11870 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:08.513639 11871 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:08.516256 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.517020 11871 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:08.517158 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.518571 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.519263 11871 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:11:08.519368 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77900.4us
I20260709 12:11:08.523352 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:08.530043 11942 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:08.544402 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:08.532691 15480 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.547009 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:08.488626 15715 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:08.488364 15761 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.483476 15646 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.484540 15621 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.555586 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:08.567453 15821 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:08.569079 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:08.570621 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.593189 12608 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:08.562719 11873 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:08.556553 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57180.1us
I20260709 12:11:08.595022 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:08.596354 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:08.599191 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:08.555884 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:08.496549 15808 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.440515 15770 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.602185 15808 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.602736 15808 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.604038 15770 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:08.604924 12604 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:08.605611 15806 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.607267 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 867) took 1448 ms. Trace:
I20260709 12:11:08.607813 12604 rpcz_store.cc:276] 0709 12:11:07.158848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.163107 (+  4259us) service_pool.cc:224] Handling call
0709 12:11:07.163565 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.605351 (+1441786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.606889 (+  1538us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54005c8d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:08.607185 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314044672}
I20260709 12:11:08.609256 15761 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:08.610378 15814 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:08.610611 15761 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.613914 15673 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:08.614279 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45290.3us
I20260709 12:11:08.614904 15673 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.615270 15673 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:08.615274 15770 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.615409 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:08.616338 15673 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.488674 15819 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.591202 15621 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.627586 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2379) took 1082 ms. Trace:
W20260709 12:11:08.629477 15827 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:11:08.631102 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.600656 11942 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:08.497097 15763 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:11:08.583411 15646 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.552378 15825 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 12:11:08.730007 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:08.577515 15715 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.739270 15622 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.737768 15519 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:08.552738 15712 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.552870 15820 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:11:08.732355 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.029s	sys 0.053s
W20260709 12:11:08.735251 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.574929 15480 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.719806 15815 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:08.741110 11912 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:08.736317 15673 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.746245 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 201954us
I20260709 12:11:08.574610 15737 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:11:08.730240 15720 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:08.920397 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.796784 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56654.1us
I20260709 12:11:08.802294 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:08.752400 12015 rpcz_store.cc:276] 0709 12:11:07.545477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.577663 (+ 32186us) service_pool.cc:224] Handling call
0709 12:11:07.578183 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.457796 (+879613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.627110 (+169314us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540046b254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:08.627486 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021086080}
I20260709 12:11:08.834957 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:08.793874 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 1.30779e+06us
I20260709 12:11:08.947043 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:08.955284 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:08.850790 15413 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:08.957341 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 155033us
I20260709 12:11:08.957511 15413 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:08.954546 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 119481us
I20260709 12:11:08.844587 15521 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:08.858827 15147 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.962209 15147 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.950573 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:08.962589 15521 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.964279 12604 raft_consensus.cc:2410] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:11:08.795974 15480 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:08.964603 15147 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.799155 15519 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:08.966967 15521 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:08.967692 15519 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.848062 12603 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.968012 15413 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:08.757756 15432 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.766124 15763 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.971715 15763 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:08.758966 15597 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.974313 15763 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.975072 15597 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:08.976629 15763 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.759213 15642 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.979851 15224 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.980129 15519 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:08.760728 15726 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:08.760524 15646 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.770931 15715 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.967754 15147 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:08.992412 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.750144 15743 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:08.781077 15828 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:08.814659 15820 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:08.760896 15825 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.002447 15825 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:09.002002 15820 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:08.748356 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.783722 15829 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.007202 15829 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:09.007525 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.980556 15224 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.755389 15821 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.010371 15413 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.010867 15821 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:08.796509 15815 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:09.014266 15158 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.981645 15726 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.016186 15815 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:08.798909 15819 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.022151 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:09.023521 11946 raft_consensus.cc:606] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:09.024209 11946 raft_consensus.cc:614] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:09.035313 15521 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.036057 15521 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:09.038316 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48755.7us
I20260709 12:11:09.004781 15825 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.036608 15521 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:09.052575 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 453228us
W20260709 12:11:09.053660 15656 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.557s	user 0.017s	sys 0.000s
I20260709 12:11:09.012833 15821 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.054534 15820 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.055087 15597 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.059152 15726 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:09.059801 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46041.2us
I20260709 12:11:09.071687 15821 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.067080 15656 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.076058 15656 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.077001 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.079773 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.082314 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.082434 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.083987 12017 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:09.084038 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.085187 12014 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:09.091244 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:09.025643 15224 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:09.097843 15819 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:09.102607 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:09.103407 15820 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.109521 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.109879 11946 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:09.110659 15841 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.113452 12602 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:09.114254 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.077412 15621 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.115994 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.117018 12606 raft_consensus.cc:2393] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:11:09.118523 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.110003 15737 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:09.122313 15786 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.122874 15786 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.123265 15786 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.125599 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:09.126578 11865 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:09.126328 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:09.127985 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:09.128965 11866 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.130772 15642 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.131448 15642 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.133620 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.141140 15595 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.141748 15595 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:09.143906 15761 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.143301 15595 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.149099 15595 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.151547 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.152693 12014 raft_consensus.cc:2368] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8.
W20260709 12:11:09.152822 15837 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 12:11:09.153703 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.158288 12015 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:09.171991 15808 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.012s
I20260709 12:11:09.172765 15808 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.175983 15808 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.144956 15761 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.188205 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.034274 15829 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.199807 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.198385 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.219588 12017 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:09.220542 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:09.223371 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 121072us
I20260709 12:11:09.227334 12018 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.229183 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 450) took 1052 ms. Trace:
I20260709 12:11:09.229715 12603 rpcz_store.cc:276] 0709 12:11:08.101987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.102117 (+   130us) service_pool.cc:224] Handling call
0709 12:11:08.126596 (+ 24479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.968896 (+842300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.073268 (+104372us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400570154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:09.154359 (+ 81091us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658380672}
I20260709 12:11:09.243289 15825 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.250083 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:09.249835 15646 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.251246 12014 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:09.264742 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:09.266033 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.266062 12015 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:09.269802 15621 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.250195 15761 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.283250 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:09.284216 11942 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:09.284446 12019 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:09.285921 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.293357 15735 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:09.269142 15521 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.298755 11866 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:09.303283 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.293968 15615 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.307933 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.308672 12608 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:09.306612 15615 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.319021 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.302268 15763 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:09.323385 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:09.324056 12014 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:09.327772 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:09.323215 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.323352 15797 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:11:09.328724 12602 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:09.332046 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.333228 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.334260 12021 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:09.335041 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.335628 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.335943 12016 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:09.336119 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:09.336491 12021 raft_consensus.cc:2368] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:11:09.337011 11945 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:09.333969 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.332083 12017 raft_consensus.cc:2393] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:09.338651 12020 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:09.340636 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.318970 15615 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.346167 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:09.346362 12015 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:11:09.346980 12015 pending_rounds.cc:85] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
W20260709 12:11:09.346801 11839 leader_election.cc:336] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.018s (SENT)
W20260709 12:11:09.341476 15854 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:11:09.347322 12015 pending_rounds.cc:107] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:11:09.354173 12015 raft_consensus.cc:2889] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.357439 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:09.357934 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.350720 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.361095 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.361430 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.371313 15691 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.371929 15691 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:09.372364 15691 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.362931 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.374354 12016 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:09.363756 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:09.378013 15519 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.381500 12019 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.380535 12017 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
W20260709 12:11:09.383394 15852 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:11:09.386373 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.385951 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.387310 12016 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:09.383857 15726 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.359836 15763 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.391911 12014 raft_consensus.cc:2410] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:09.385914 15646 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.383469 15519 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.402074 11867 raft_consensus.cc:2410] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:11:09.401855 15413 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:09.402956 15806 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.403573 15806 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.406276 15519 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.390522 15726 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.402987 15413 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.407364 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:09.413722 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.417171 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.417940 11945 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.418912 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.422089 15818 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:09.426815 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.427241 15715 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.431227 15763 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.428993 11870 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:09.431818 15797 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.431572 15642 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:09.448810 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58685.2us
I20260709 12:11:09.449229 15650 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:09.449965 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:09.451455 11945 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:09.432283 15797 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.434604 15646 raft_consensus.cc:993] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:09.441047 15539 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:11:09.463442 15539 tablet_bootstrap.cc:492] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:11:09.449811 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.464929 15539 ts_tablet_manager.cc:1403] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 2.173s	user 0.035s	sys 0.038s
I20260709 12:11:09.465031 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:09.461261 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 130085us
I20260709 12:11:09.453563 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.411082 15521 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.478695 15818 raft_consensus.cc:1081] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:09.483450 12604 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.458020 15642 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.480556 15224 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:09.489789 15720 consensus_meta.cc:287] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.012s
I20260709 12:11:09.449982 15650 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:09.492914 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.481010 15646 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:09.470212 15797 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.498924 12018 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:09.498636 15224 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:09.515244 15224 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.503031 15650 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.518813 15646 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:09.523882 15646 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:09.528334 15857 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:11:09.495286 15821 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.529937 15821 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.530448 15821 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.457798 15786 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.534614 12608 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:09.534063 15806 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.547043 15786 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.548338 15413 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.558799 15615 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.600548 15539 raft_consensus.cc:359] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 9 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.603866 15691 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:09.606413 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.617404 15691 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.627504 15615 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.626703 15821 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.613374 15797 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.628875 15539 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:11:09.630668 15821 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.629853 15539 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:09.613075 15650 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.634811 15650 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.634831 15539 ts_tablet_manager.cc:1434] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.169s	user 0.010s	sys 0.000s
I20260709 12:11:09.636252 15797 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.638463 15224 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.640988 15224 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.707525 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.708317 15432 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.709122 15432 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.711534 15432 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:09.708350 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.713703 15715 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.714473 15673 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.714398 15715 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.715072 15673 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:09.716738 15673 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.716917 15715 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.719089 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.721426 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:09.722154 12611 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:09.725415 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:09.726996 11839 leader_election.cc:336] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.148s (SENT)
I20260709 12:11:09.727348 15844 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.727567 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.727870 15844 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.728241 15844 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.729089 15797 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.729686 15797 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:09.730695 15797 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.731318 15845 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:09.736528 11839 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.184s (SENT)
I20260709 12:11:09.737068 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.738022 15808 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.739180 15521 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.739882 15521 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:09.738597 11839 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.431s (SENT)
I20260709 12:11:09.742293 15521 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.742170 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.743417 15808 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:09.746620 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:09.746860 11870 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.747408 11866 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:09.747500 11869 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.749315 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:09.749605 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:09.749914 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:11:09.750602 11870 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:09.750994 11870 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.750181 11869 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:09.762050 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:09.763193 11869 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:09.760273 11870 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.766848 11870 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.770926 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:09.772655 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:09.773376 11869 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.793982 15844 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.796555 15844 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.799782 11869 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:09.802940 15797 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:09.803422 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2283) took 1293 ms. Trace:
I20260709 12:11:09.803897 11867 rpcz_store.cc:276] 0709 12:11:08.510093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.510220 (+   127us) service_pool.cc:224] Handling call
0709 12:11:09.803122 (+1292902us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001b6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:09.803338 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033335040}
W20260709 12:11:09.804391 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.804721 11865 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:11:09.819139 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.822822 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.825459 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:09.826360 11945 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:09.826736 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:09.825663 12611 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.827440 12611 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:09.827504 11946 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:09.828414 12611 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:09.829566 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:09.830214 11941 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.834339 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.834757 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:09.835414 11946 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.834331 12606 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 7 LEARNER]: Advancing to term 8
I20260709 12:11:09.836594 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-ecd86af74b304d58a84939321319d52b received from {username='slave'} at 127.0.0.1:43956
I20260709 12:11:09.837244 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-ecd86af74b304d58a84939321319d52b on tablet ecd86af74b304d58a84939321319d52b with peer 189a165e6619406382914fe3075dd436
I20260709 12:11:09.844298 11940 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.844652 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.844918 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.845593 12019 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.848441 12611 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.853358 12018 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.853479 15761 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:09.855988 11941 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
W20260709 12:11:09.866760 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.593s (SENT)
W20260709 12:11:09.867702 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.593s (SENT)
I20260709 12:11:09.868211 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.869805 15844 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.875129 11946 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
W20260709 12:11:09.880844 11839 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.728s (SENT)
W20260709 12:11:09.881735 11839 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.728s (SENT)
I20260709 12:11:09.882144 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:09.893442 12019 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:09.905309 15726 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:09.920601 15726 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:09.921341 15726 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.930141 15726 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:09.936010 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:09.936975 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 451934us
W20260709 12:11:09.937686 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.942747 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.951157 15615 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.951671 15615 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.952024 15615 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.955298 15621 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.955917 15621 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:09.958740 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.965420 15808 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.980679 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.981456 12016 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.982946 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:09.983599 15642 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.984112 15642 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.984513 15642 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.985087 15821 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.984594 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:09.986465 15821 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.986832 15821 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:09.986982 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.987226 15821 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.987826 12019 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:09.988305 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.988915 12013 raft_consensus.cc:2376] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7. Re-sending same reply.
I20260709 12:11:09.987128 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.989993 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:09.990245 12015 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.990824 12021 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:09.990957 15621 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:09.991791 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.992630 12020 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:09.989331 12017 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.001106 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:10.006366 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.007347 12017 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:10.007339 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.008316 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.008783 12020 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:10.009317 12021 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:10.010326 11839 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.951s (SENT)
I20260709 12:11:10.011015 15735 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.010850 15621 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:10.012516 15808 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:10.013300 15808 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.014367 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.014137 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.016862 12016 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:10.017045 15715 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:10.018043 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.018265 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.019070 11942 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.021013 15642 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.013303 15621 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.023797 15642 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.024820 15621 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.019743 12021 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:10.027426 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.028303 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.029183 12016 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:10.032712 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.033878 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.034869 11946 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.037757 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.038132 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.039172 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.035825 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:10.040604 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 189814us
I20260709 12:11:10.041147 11942 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:10.042820 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.035153 15808 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.044637 15621 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:10.045957 15797 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:10.046967 15621 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.039903 15615 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.045601 15642 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.059218 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.060158 12016 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:10.060568 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.061295 12020 raft_consensus.cc:2410] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:10.061937 11945 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.063560 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:10.072932 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.052237 15621 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.101469 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.102680 11946 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:10.067494 15615 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.107179 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.108541 12606 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:10.109082 12606 pending_rounds.cc:85] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 4
I20260709 12:11:10.109385 12606 pending_rounds.cc:107] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:10.071867 15691 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:10.109715 12606 raft_consensus.cc:2889] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.131956 15726 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.132711 15726 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.133927 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.141286 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.136157 15726 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:10.068984 15861 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:11:10.163131 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.153070 15797 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.167560 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.167362 15797 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.168169 12014 raft_consensus.cc:2376] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9. Re-sending same reply.
I20260709 12:11:10.153362 12020 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.101961 15642 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.173959 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.175117 15642 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.175307 15845 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.176009 15797 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.156421 15691 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:10.176034 15845 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.177954 15691 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.179339 15845 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:10.185686 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.190495 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.191553 11942 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.155011 12611 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
W20260709 12:11:10.199880 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 136255us
I20260709 12:11:10.200475 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.201109 11946 raft_consensus.cc:2376] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10. Re-sending same reply.
I20260709 12:11:10.201875 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.201822 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.202845 12021 raft_consensus.cc:2393] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.203186 15797 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.154222 15615 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:11:10.203563 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:10.204881 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.205454 12020 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:10.206274 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.209494 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.210428 11946 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.214911 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.215718 12020 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.218434 15646 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.221132 15646 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:10.221589 15646 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.224573 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.225291 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.226130 11942 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.227095 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.228343 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.229414 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.229843 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.230711 12016 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.231411 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.231753 11837 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:10.232156 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.233006 15844 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:10.229954 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.233573 15844 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:10.234813 15844 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.225297 11943 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.225322 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:10.249009 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.271768 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62465.6us
I20260709 12:11:10.274600 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.275792 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.276479 12020 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:10.277717 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:10.274142 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.284011 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:10.272782 15866 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:10.288522 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.289215 11946 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.291945 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.266886 15821 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:10.299904 15797 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:10.300920 15869 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.305927 15869 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:10.307070 15869 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.307303 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.308274 12022 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
W20260709 12:11:10.301963 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.300303 15821 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.311162 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.311668 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.312168 12022 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:10.315573 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.324692 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.325965 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.327651 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.328653 12016 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.330216 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.331336 12021 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:10.332985 12020 raft_consensus.cc:2368] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:11:10.334739 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.336040 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.337193 12022 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.338624 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.338845 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.339210 11943 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:10.339470 12014 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.339730 12017 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.337374 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.340848 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.341580 12013 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
W20260709 12:11:10.337353 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59849.8us
I20260709 12:11:10.343686 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.345763 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.346475 11946 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.348073 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.348718 12015 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:10.348409 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.349350 12016 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:10.350927 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.351465 12018 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:10.336932 15715 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.354004 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.354914 12021 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.355595 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:10.356181 12611 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:11:10.358078 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:09.856163 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:10.359790 12604 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.361065 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:10.361306 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.362704 12015 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.362865 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.363436 12018 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:10.376431 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.377732 11945 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.359737 15715 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:10.382386 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.383517 15715 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:10.386956 15621 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.391180 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.392000 11865 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:10.393040 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.393611 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.394166 12017 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:10.395256 12021 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.387254 11869 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:10.396147 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.393859 11870 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:10.396708 12021 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:10.399232 12019 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.405342 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.405723 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.406837 11872 raft_consensus.cc:2410] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:11:10.407332 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.408241 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:10.408556 11872 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:10.402458 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:10.412256 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.413298 11866 raft_consensus.cc:2368] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:10.413144 11986 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:10.416580 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.417775 12021 raft_consensus.cc:2410] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:11:10.418856 12018 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.420897 11946 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:10.424523 11945 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:10.424755 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.425639 12019 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.427417 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.428243 11869 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:10.429726 15818 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:10.431730 15521 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.432245 15521 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.432662 15521 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.421397 11946 pending_rounds.cc:85] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 8
I20260709 12:11:10.433776 11946 pending_rounds.cc:107] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:10.434609 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.435084 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.436940 11868 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:10.434059 11946 raft_consensus.cc:2889] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.435257 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.438555 11872 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:10.448006 12013 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:10.451382 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.452491 11870 raft_consensus.cc:2410] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:10.454296 12015 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.457142 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.463826 12014 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.465516 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.475154 12021 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.478310 11867 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:10.481197 12019 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:10.474846 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:10.492506 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.493731 11870 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:10.497824 11865 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:10.504186 11939 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:10.504904 11869 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:10.505900 12014 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:10.508297 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.515076 11867 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.492107 15870 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:10.521806 11870 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.530915 11939 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.533452 11771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 123) took 4397 ms. Trace:
I20260709 12:11:10.542169 11872 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:10.497658 15861 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:11:10.561442 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.514729 15818 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:11:10.571224 12020 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:10.571908 11865 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:10.571307 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.572902 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:10.577039 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72021.7us
I20260709 12:11:10.534070 11771 rpcz_store.cc:276] 0709 12:11:06.034999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.035245 (+   246us) service_pool.cc:224] Handling call
0709 12:11:10.432014 (+4396769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:07.982023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:07.982680 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:07.982730 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:11:07.982753 (+    23us) tablet.cc:662] Decoding operations
0709 12:11:08.144449 (+161696us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:08.144550 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:08.144588 (+    38us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:08.146029 (+  1441us) tablet.cc:701] Row locks acquired
0709 12:11:08.146052 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:11:08.146257 (+   205us) write_op.cc:270] Start()
0709 12:11:08.146403 (+   146us) write_op.cc:276] Timestamp: P: 1783599068146193 usec, L: 0
0709 12:11:08.146430 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:11:08.147390 (+   960us) log.cc:844] Serialized 5958 byte log entry
0709 12:11:08.880927 (+733537us) op_driver.cc:464] REPLICATION: finished
0709 12:11:09.236960 (+356033us) write_op.cc:301] APPLY: starting
0709 12:11:09.237178 (+   218us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:09.239061 (+  1883us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:09.285889 (+ 46828us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:09.295396 (+  9507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:09.295826 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:11:09.295888 (+    62us) write_op.cc:312] APPLY: finished
0709 12:11:09.330680 (+ 34792us) log.cc:844] Serialized 107 byte log entry
0709 12:11:09.378291 (+ 47611us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:09.469924 (+ 91633us) write_op.cc:454] Released schema lock
0709 12:11:09.480861 (+ 10937us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:09.491520 (+ 10659us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:09.491582 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867353,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":352288,"apply.run_cpu_time_us":7340,"apply.run_wall_time_us":255624,"num_ops":15,"prepare.queue_time_us":386262,"prepare.run_cpu_time_us":34740,"prepare.run_wall_time_us":282163,"raft.queue_time_us":491525,"raft.run_cpu_time_us":62089,"raft.run_wall_time_us":423393,"replication_time_us":733213,"thread_start_us":1257611,"threads_started":4,"wal-append.queue_time_us":220990,"wal-append.run_cpu_time_us":86829,"wal-append.run_wall_time_us":1993452}]]}
I20260709 12:11:10.583838 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.587061 12014 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:10.587427 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.563189 15873 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:10.584877 11939 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:10.562645 15646 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.596073 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.600723 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.604844 12602 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.605700 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.606568 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.607295 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.607872 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.608332 11947 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.609149 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.599597 11870 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.600009 11865 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.614373 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:10.588264 11988 connection.cc:256] RPC call timeout handler was delayed by -5.3945132019998709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:11:10.630483 12014 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:10.634790 11864 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:10.630718 11988 connection.cc:256] RPC call timeout handler was delayed by -5.2820132019999164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:11:10.646584 15879 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:10.648259 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:10.649953 15615 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:11:10.650437 15615 raft_consensus.cc:1068] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:11:10.652352 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.656199 11865 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:10.657696 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.658917 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.659067 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.659564 11871 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.659983 11865 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.665625 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.666465 11873 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.667418 11870 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:10.671670 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.668004 15521 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.683547 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.668710 12604 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:10.669777 15735 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.667725 11865 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:10.670203 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.672569 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.689366 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:10.690207 11946 raft_consensus.cc:2368] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
W20260709 12:11:10.655328 15877 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:10.687454 11867 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:10.688824 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.696887 12020 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.690655 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:10.694993 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.697239 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.700541 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.704754 11945 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:10.708882 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.709730 11867 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.710083 11865 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.712545 11870 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.714215 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:10.718364 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.718401 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.719913 11866 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:10.720878 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.723251 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.724052 11864 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:10.724473 15521 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:10.725085 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:10.725600 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.726629 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.729277 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.729893 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.730098 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.735682 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.737879 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:10.738205 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.739463 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.741618 11867 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:10.742573 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:10.742619 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.743232 11872 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:10.743489 11865 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:10.743602 11941 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:10.744421 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.744998 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:10.750838 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.706568 15615 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:10.752599 11839 leader_election.cc:336] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.037s (SENT)
I20260709 12:11:10.758577 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:10.758584 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.760037 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.760667 11865 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 3.
I20260709 12:11:10.761282 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.761917 11865 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.762445 11868 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:10.756606 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.712123 15844 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.763695 15844 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:10.764720 15844 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.753489 11870 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:10.766397 11865 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: [7.5-10.7]
I20260709 12:11:10.768203 11942 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.768412 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.778786 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:10.784401 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:10.792330 12604 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.766775 11870 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:10.767585 11867 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:10.795699 11868 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.739212 15873 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 12:11:10.801141 11839 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 3.058s (SENT)
I20260709 12:11:10.801930 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.802213 15646 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:10.802538 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:10.803288 11839 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.088s (SENT)
W20260709 12:11:10.804013 11839 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.088s (SENT)
I20260709 12:11:10.804342 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.805245 15845 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.805774 15715 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.808861 11865 raft_consensus.cc:1217] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:11:10.809480 11865 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:10.811719 12020 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:10.813309 11873 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:10.824616 11864 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:11:10.809922 11839 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.129s (SENT)
I20260709 12:11:10.829276 15845 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:10.830355 15845 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.830701 15845 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:10.831559 15845 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:10.832458 15890 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:10.832860 15845 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.755990 15875 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.835060 15875 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.840636 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.842092 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:10.852264 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.855362 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.837324 15875 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:10.858458 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48567us
I20260709 12:11:10.862473 11872 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:10.864012 11864 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:11:10.865967 12022 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
W20260709 12:11:10.870390 11839 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.129s (SENT)
I20260709 12:11:10.871069 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.872416 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.874612 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:10.875260 12013 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.899966 11865 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:10.905507 12604 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:11:10.907039 11988 connection.cc:256] RPC call timeout handler was delayed by -4.1912132019999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32380000000000003s for a response
W20260709 12:11:10.908437 11988 connection.cc:256] RPC call timeout handler was delayed by -4.0121132019999095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3437s for a response
W20260709 12:11:10.909200 11988 connection.cc:256] RPC call timeout handler was delayed by -3.8615191779997531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:11:10.910704 11988 connection.cc:256] RPC call timeout handler was delayed by -3.49341917799984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 12:11:10.882539 12043 debug-util.cc:398] Leaking SignalData structure 0x7b0800368400 after lost signal to thread 10700
W20260709 12:11:10.913767 12043 debug-util.cc:398] Leaking SignalData structure 0x7b08002edac0 after lost signal to thread 11805
W20260709 12:11:10.914168 12043 debug-util.cc:398] Leaking SignalData structure 0x7b080021aa80 after lost signal to thread 11819
W20260709 12:11:10.915701 12043 debug-util.cc:398] Leaking SignalData structure 0x7b0800341340 after lost signal to thread 11897
W20260709 12:11:10.915997 12043 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1b60 after lost signal to thread 11898
W20260709 12:11:10.918531 12043 debug-util.cc:398] Leaking SignalData structure 0x7b0800328560 after lost signal to thread 11972
W20260709 12:11:10.920352 12043 debug-util.cc:398] Leaking SignalData structure 0x7b0800327120 after lost signal to thread 12046
W20260709 12:11:10.920761 12043 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffa60 after lost signal to thread 12047
W20260709 12:11:10.922541 12043 debug-util.cc:398] Leaking SignalData structure 0x7b08001564c0 after lost signal to thread 12635
W20260709 12:11:10.922946 12043 debug-util.cc:398] Leaking SignalData structure 0x7b08000aaea0 after lost signal to thread 12636
I20260709 12:11:10.926657 11986 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:10.927955 11868 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:10.933182 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62841.1us
W20260709 12:11:10.934016 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.934443 11865 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:10.932171 12013 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:10.843894 15650 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:11:10.894237 15642 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:10.945683 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.955446 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 102523us
I20260709 12:11:10.956156 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:10.909859 15715 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:10.959386 11865 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.962353 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:10.963053 11946 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:10.971465 11839 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.200s (SENT)
I20260709 12:11:10.977468 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:10.978279 11943 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
W20260709 12:11:10.980089 11839 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.200s (SENT)
I20260709 12:11:10.980571 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:10.981243 11871 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:10.986296 12604 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.990469 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:10.954960 15642 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:10.994127 12021 raft_consensus.cc:3055] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.994531 12021 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:10.998412 11946 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:10.976187 15896 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:11.009712 15726 raft_consensus.cc:2764] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:11.010161 11944 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:10.991350 15892 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:11:11.021320 15904 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:11.022203 15904 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.028102 15904 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:11.040314 15715 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.039997 11768 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 10 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.041447 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:11.045681 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:11.046983 12602 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 LEARNER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.049746 15726 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:11.050661 15726 consensus_queue.cc:1243] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:11.051218 15726 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.051564 15726 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:11.055512 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.058127 11768 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 8 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.096446 15818 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:11.061903 15900 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:11.098196 15900 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:11.099606 12014 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:11.097368 15906 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:11.096612 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.082047 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 6 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.043897 15896 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:11.069676 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.052841 15726 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.060431 15891 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.111562 11943 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:11.115211 15891 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.115754 15891 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.116796 15905 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:11.120592 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 280178us
W20260709 12:11:11.123139 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.060760 15621 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:11:11.131186 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.128424 11768 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.136945 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.133260 15726 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.113415 15861 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:11.110556 15907 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:11.129205 15870 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.157645 11768 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 6 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.159019 15896 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.099285 15900 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:11.176025 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 58788.9us
I20260709 12:11:11.169461 15844 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.178828 11768 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 8 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.178826 15906 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:11:11.177528 15884 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:11.185803 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:11.171608 15735 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:11.210466 15621 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:11.191946 15642 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:11.204162 15906 consensus_queue.cc:1243] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:11.212678 15735 consensus_queue.cc:1243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:11.213338 15735 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:11.213706 15735 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.212723 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.215153 15615 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:11:11.214893 15735 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.215468 15715 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:11.215634 15615 raft_consensus.cc:1068] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:11.216272 15735 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:11.217614 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.208699 11768 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 6 to 9, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 9 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.210955 15621 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:11.219810 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.229023 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48968us
I20260709 12:11:11.230842 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:11.237843 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:11.243206 15911 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:11.245147 15904 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:11.245713 15904 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.247038 15904 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.239360 15715 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.250965 11768 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.227766 15621 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.256814 11768 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 8 to 9, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 9 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.250699 15715 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:11.262091 15715 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.256986 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:11.285825 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 68272.7us
I20260709 12:11:11.286787 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:11.287703 15844 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.175256 15870 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.301191 11768 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 7 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.309633 11839 leader_election.cc:400] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:11:11.310052 11839 leader_election.cc:403] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:11.254998 15642 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:11:11.333703 15844 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.339820 15870 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.310799 15898 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.342024 15898 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:11.342638 15898 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.323859 11768 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.345450 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:11.359220 11768 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.365794 15911 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.366617 15911 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.367229 15904 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.367820 15911 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.369937 12016 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:11.373059 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:11.382709 11942 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:11.380100 15911 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.385349 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 130670us
I20260709 12:11:11.386582 11768 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 6, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.390046 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:11.363140 12021 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:11.399255 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:11.409343 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 88874.8us
I20260709 12:11:11.411450 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:11.386246 15521 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.388521 11768 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 4 to 5, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 5 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.424450 12021 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.404495 15870 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.407409 15923 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:11:11.438557 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51676.3us
I20260709 12:11:11.439692 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.439881 15914 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.440981 15914 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.441632 15905 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:11.442586 15905 consensus_queue.cc:1243] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:11.442982 11988 leader_election.cc:400] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:11.443174 15905 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.443374 11988 leader_election.cc:403] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:11.443620 15905 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:11.444733 15896 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:11.427575 15861 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:11.444659 15905 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.447917 15905 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.444310 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.439391 11768 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 9 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.453562 11768 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 2 to 3, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 3 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:11.426249 15821 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:11.455317 15726 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.464617 15726 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:11.464918 15821 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.465415 15821 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.465669 15926 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:11:11.466231 15926 raft_consensus.cc:1068] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:11.420714 15521 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:11.466391 15821 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.456554 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.427587 15870 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.467787 15821 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.442767 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:11.468216 15914 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.462534 15924 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.468528 11942 raft_consensus.cc:606] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:11.468869 15924 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.469056 11942 raft_consensus.cc:614] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.470005 15924 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.470549 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.471534 15924 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.469283 11768 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 6, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 6 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.473505 11768 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.461625 15923 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:11.475688 15914 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.475855 15735 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.476440 15735 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.458109 15715 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.467460 15521 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.467909 15870 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.459666 15925 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.465818 15726 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:11.468432 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 178947us
I20260709 12:11:11.477981 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:11.477842 11768 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.489935 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.500687 11944 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:11.500833 12021 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:11.501688 12021 pending_rounds.cc:85] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 4
I20260709 12:11:11.502130 12021 pending_rounds.cc:107] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:11.503345 12021 raft_consensus.cc:2889] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.503970 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 8 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 10 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:11.505893 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92435.1us
I20260709 12:11:11.508677 11988 leader_election.cc:400] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:11.509491 15615 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:11.510603 11941 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.509028 11988 leader_election.cc:403] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:11.518191 15621 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.523804 11768 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.504323 15914 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.528442 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:11.543157 11768 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 8 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.545651 11768 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:11.579438 15650 raft_consensus.cc:993] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
W20260709 12:11:11.581838 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.585796 15521 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.590014 11941 raft_consensus.cc:606] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:11.590464 11941 raft_consensus.cc:614] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.593894 11768 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 6 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:11:11.601045 15902 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:11.601497 15621 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.602298 15621 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.602980 15621 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:11.603528 15621 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.486856 15735 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:11.614032 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 88125us
I20260709 12:11:11.616318 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:11.617583 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.525112 15906 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:11.504148 15896 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
W20260709 12:11:11.622272 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.623571 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.527997 15914 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:11.629185 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.612090 15891 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.630966 15914 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.631574 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:11:11.631814 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 141941us
I20260709 12:11:11.632238 11943 raft_consensus.cc:606] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:11.632634 11943 raft_consensus.cc:614] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.632614 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:11.635198 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.636053 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.631546 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 123019us
I20260709 12:11:11.636801 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:11.637506 11943 raft_consensus.cc:606] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:11.637446 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.595122 15923 raft_consensus.cc:1081] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:11:11.638830 15905 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:11.639623 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:11.660276 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.624742 15845 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:11.663290 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.666093 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:11.636703 15891 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.668329 11943 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.670234 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.654832 15615 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.682485 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:11.683303 11871 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:11.663767 15925 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:11:11.637669 15903 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:11:11.689798 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52468.9us
I20260709 12:11:11.690995 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:11.691911 11941 raft_consensus.cc:606] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:11.692544 11941 raft_consensus.cc:614] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.666672 15904 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.657833 15898 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.721575 15904 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.722847 15904 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.723718 15898 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:11.673609 15845 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:11.725440 15929 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:11:11.697681 12015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:11:11.726464 12015 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:11.726961 12015 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.664541 15923 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:11.707644 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:11.709170 15715 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.711048 15844 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5.
I20260709 12:11:11.738929 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.712301 15621 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:11.712500 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:11.688453 15650 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:11:11.714191 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:11.681267 15821 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:11.730293 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:11.749099 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:11.750586 11943 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:11.694363 15930 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.709308 15927 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.751830 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:11.756990 15905 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.756146 15621 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.755158 15930 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.763774 15927 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:11.762341 15905 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:11.740325 15914 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.797338 12606 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:11.772357 15821 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:11.785092 15891 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.784207 15621 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.794430 15927 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:11.824338 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 184857us
I20260709 12:11:11.789963 15930 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.807034 15905 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.824106 15621 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.827123 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:11.842254 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 151537us
I20260709 12:11:11.845079 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.826684 12606 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 9 LEARNER]: Advancing to term 11
W20260709 12:11:11.832890 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.855114 15930 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:11.859603 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 107300us
I20260709 12:11:11.877518 11941 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:11.879158 11947 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.843819 15891 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:11.864724 15922 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.865068 15932 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.892485 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.838514 15621 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.866302 15861 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.897625 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 70608.8us
I20260709 12:11:11.898557 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.826277 15933 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:11.901885 12015 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.879379 15914 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:11.912048 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.888423 15930 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.913889 12015 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:11.913908 12604 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:11.926205 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:11.928709 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:11.930771 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:11.908900 15845 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:11.922734 15870 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.943446 15621 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:11.945686 12604 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:11.914197 15715 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.908267 15935 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.949267 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:11.949972 11947 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.904946 15861 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:11.942490 15870 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:11.933648 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49952.4us
I20260709 12:11:11.952162 15861 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:11.951920 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:11.948323 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49845.2us
I20260709 12:11:11.953959 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:11.960026 11947 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:11.903697 15821 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:11.989910 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:11.990777 11942 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:11.911293 15905 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:12.004112 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50263us
I20260709 12:11:12.005033 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.006515 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:12.008090 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:12.008872 15621 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.009032 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:12.017454 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:11.995687 15933 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.019282 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:12.019234 15934 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.013983 15621 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.032119 15621 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:12.024266 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.950060 15941 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:11:12.002557 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:12.023590 15844 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.015268 15932 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.022357 15939 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.043090 15715 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.046613 15715 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.047070 15715 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.055932 15735 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.030308 15934 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.992470 15891 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:12.075912 15934 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.038380 15844 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.043133 15932 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.080096 15939 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:12.086424 15905 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:12.084156 15844 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.087354 15939 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.089695 15932 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:12.157930 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.158684 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.197839 15941 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.208644 15941 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:12.211325 15941 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:12.223011 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:12.224788 15924 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.225266 15924 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:12.225708 15924 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.084950 15933 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.226846 15933 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:12.230813 15926 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.231945 15911 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:12.232597 15844 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.234786 15821 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:12.235544 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:12.219800 15946 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 12:11:12.238144 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:12.248910 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.229349 15933 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:12.258620 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:12.083592 15715 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.245853 15821 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:12.289260 12577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.648s (SENT) [suppressed 34 similar messages]
W20260709 12:11:12.299520 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.300133 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.270150 15950 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.261245 15926 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.322623 15844 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.326835 15821 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.315896 15906 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.325142 15927 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.323261 15950 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.362597 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:12.328109 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 308918us
I20260709 12:11:12.364609 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:12.379719 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:12.313458 15933 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:12.378283 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.398555 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.355664 15906 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:12.326463 15715 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:12.415160 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 125964us
I20260709 12:11:12.402164 15926 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.395416 15903 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.421336 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:12.427837 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 65315.9us
I20260709 12:11:12.404157 15933 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.420960 15845 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:12.434984 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:12.418910 15930 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:12.407537 15924 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.426136 15821 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.449780 15642 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.450464 15642 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:12.450909 15642 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.451942 15932 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.416328 15934 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.457083 15934 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.424031 15903 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.458490 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.462239 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:12.467886 11943 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:12.462924 15950 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.464179 15927 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.469125 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:12.429718 15926 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:12.472594 15926 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.474412 15933 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.474323 15926 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:12.476385 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 538893us
W20260709 12:11:12.477012 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 525196us
I20260709 12:11:12.477290 15924 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.477713 11986 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:12.478034 11986 leader_election.cc:403] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:12.478147 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:12.479416 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.479609 15898 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.474412 15934 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.481794 15935 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.482208 15907 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.421965 15621 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.482514 15935 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.438745 15715 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:12.485627 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:12.485374 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:12.506987 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48627.4us
I20260709 12:11:12.508014 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:12.507539 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 60184.5us
I20260709 12:11:12.511399 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:12.484426 15905 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.512624 15905 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:12.488770 15875 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.442247 15906 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.525246 12020 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.526734 11872 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.513475 15642 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:12.538789 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:12.541105 11869 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.541638 15923 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:11:12.544375 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:12.561502 11943 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.561837 11873 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.545058 11866 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:12.547478 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:12.547387 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.554800 15621 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.555766 15932 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.556680 15965 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.586840 15642 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:12.502844 15891 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.559890 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:12.564965 11866 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:11:12.518049 15962 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.568337 11864 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.573499 11865 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.522010 15911 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.582356 11946 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:12.566453 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:12.601600 11870 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.500509 15715 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.590559 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:12.621610 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74306us
I20260709 12:11:12.559257 15875 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:12.633522 11870 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:12.621428 11873 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:12.627259 15911 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.630509 15715 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.629990 15903 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.586830 15965 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:12.577075 15923 raft_consensus.cc:1068] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:12.578090 15900 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.602417 15621 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.590235 15906 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.596123 15891 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:12.634297 15735 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.578s	user 0.016s	sys 0.000s
W20260709 12:11:12.675190 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 100544us
I20260709 12:11:12.670131 15900 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.670313 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:12.633424 15646 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:11:12.706270 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 196937us
I20260709 12:11:12.677079 15891 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:12.714568 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 91686.3us
I20260709 12:11:12.657054 15911 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.698868 15900 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.834080 15905 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:12.835374 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.708453 12019 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:11:12.837399 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 123444us
I20260709 12:11:12.838948 15965 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.840543 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.722533 15875 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:12.841727 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2430) took 1152 ms. Trace:
I20260709 12:11:12.845386 15735 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:12.859606 12013 rpcz_store.cc:276] 0709 12:11:11.689802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.689971 (+   169us) service_pool.cc:224] Handling call
0709 12:11:11.690330 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:11.749022 (+ 58692us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:11.907444 (+158422us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.997841 (+ 90397us) log.cc:844] Serialized 14 byte log entry
0709 12:11:12.475982 (+478141us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b48000615d8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:11:12.481812 (+  5830us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:12.482563 (+   751us) log.cc:844] Serialized 52 byte log entry
0709 12:11:12.482768 (+   205us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:12.483022 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 12:11:12.659081 (+176059us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b1800213ac0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:12.659309 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.659403 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.841401 (+181998us) raft_consensus.cc:1685] finished
0709 12:11:12.841427 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.841617 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689887,"prepare.queue_time_us":71409,"prepare.run_cpu_time_us":198,"prepare.run_wall_time_us":23142,"raft.queue_time_us":689026,"raft.run_cpu_time_us":11738,"raft.run_wall_time_us":731575,"spinlock_wait_cycles":16525056,"thread_start_us":192222,"threads_started":2,"wal-append.queue_time_us":81498}
I20260709 12:11:12.864346 15845 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:12.854929 15907 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:12.856232 15911 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.871660 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.869061 12013 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:12.873077 12013 pending_rounds.cc:85] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:11:12.873451 12013 pending_rounds.cc:107] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:12.873842 12013 raft_consensus.cc:2889] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.875646 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.902477 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.903914 15735 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.904146 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.904461 15735 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.905375 15715 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.905547 15735 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.906283 15715 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.906632 12013 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.906998 15715 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.907189 15735 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.912508 15911 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:12.912760 15971 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.913599 15911 consensus_queue.cc:1243] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:12.913892 15971 consensus_queue.cc:1243] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:12.914289 15926 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.914438 15615 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.914825 15926 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.914983 15615 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:12.917971 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:12.921005 12018 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.926692 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:12.876953 15943 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.006s
I20260709 12:11:12.874775 15934 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.942862 11939 raft_consensus.cc:1217] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:11:12.945079 11939 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:12.919051 15845 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.960829 15715 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.967015 15962 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.972361 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.915925 15615 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.958221 15621 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.915979 15926 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.967708 15962 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:12.979328 15965 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.011509 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53114.7us
I20260709 12:11:12.958686 15642 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:11:13.011521 15965 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.019378 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.026343 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.043502 15965 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.044217 15965 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.044708 15965 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.045961 15621 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.048820 15962 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:12.977442 15904 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:13.059324 11871 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:13.070683 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.071357 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.066200 15972 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.426s	user 0.008s	sys 0.000s
I20260709 12:11:13.066365 15900 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:13.069036 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.069198 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.070070 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.045385 15891 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.074100 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:12.987687 15911 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:11:13.080482 11867 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:13.021845 15615 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.123346 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.152983 12018 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:13.128607 11866 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:13.129201 12020 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
W20260709 12:11:13.084528 15943 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:11:13.133431 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.132124 15925 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:13.149464 15521 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.160351 15925 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:13.160981 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 325701us
I20260709 12:11:13.159075 15900 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.161865 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.161471 15925 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:13.163324 15925 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.163914 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.164919 15906 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.158851 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2424) took 1474 ms. Trace:
I20260709 12:11:13.157662 11865 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:13.159655 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.159543 15922 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.160689 15521 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.160006 15891 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.165266 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.173063 15965 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.165989 12014 rpcz_store.cc:276] 0709 12:11:11.684427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.684632 (+   205us) service_pool.cc:224] Handling call
0709 12:11:11.685255 (+   623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:11.747596 (+ 62341us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:11.774396 (+ 26800us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.909981 (+135585us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.911937 (+  1956us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:11.937577 (+ 25640us) log.cc:844] Serialized 532 byte log entry
0709 12:11:11.937771 (+   194us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.937808 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.937880 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.214597 (+276717us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180043f600. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f
0709 12:11:12.215163 (+   566us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b48000615d8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:11:12.475705 (+260542us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180043f600. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f1f90758f 00007f1f18946571 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd
0709 12:11:12.571400 (+ 95695us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180043f600. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:13.158591 (+587191us) raft_consensus.cc:1685] finished
0709 12:11:13.158625 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.158784 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276842,"prepare.queue_time_us":24471,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":100,"raft.queue_time_us":18585,"raft.run_cpu_time_us":2508,"raft.run_wall_time_us":318303,"spinlock_wait_cycles":106414592,"thread_start_us":99581,"threads_started":1,"wal-append.queue_time_us":137450}
I20260709 12:11:13.180372 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.174121 15905 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.194042 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:13.177433 15898 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.201390 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.181526 15935 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:13.203104 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.210886 15934 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:13.211671 15621 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.212710 12020 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.214399 12014 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:13.257436 12014 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:13.217008 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.219848 11941 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:13.225703 15845 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.211732 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:13.226308 15939 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:13.231918 15977 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:11:13.233960 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.260051 12015 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:13.260504 11865 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.235903 11867 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.262842 15939 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.179880 15922 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.197368 15906 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.239815 15926 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.239694 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.241962 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.243036 11866 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:13.247437 15979 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:11:13.250948 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.272189 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.272766 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.273463 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.274112 11866 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:13.271402 11864 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:13.276129 11873 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.256198 15964 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.236436 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.259387 12014 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.266422 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:13.268038 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92098.2us
I20260709 12:11:13.272184 11946 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.287407 11867 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.287786 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.288189 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.278342 11873 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.290192 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.290695 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.290838 11947 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.291334 11873 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:13.285919 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.292023 12611 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.287412 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.255389 15903 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.296222 12020 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:13.296411 12014 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.296626 11871 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:13.301645 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.304191 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.309967 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.312979 11867 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:13.316260 11946 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:13.318907 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.320067 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.288947 15906 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:13.261087 15621 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:13.331887 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44192.8us
I20260709 12:11:13.337324 11947 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:13.298290 15898 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.265734 15934 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.267009 15845 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.347906 11865 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
W20260709 12:11:13.376271 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54375.1us
I20260709 12:11:13.339931 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.363862 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.344467 11867 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:13.407716 15650 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:11:13.407732 15642 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:13.413076 15906 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.402642 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:13.386775 11940 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:13.403512 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:13.386818 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.416514 11866 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:13.402953 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.311314 15891 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:11:13.329378 15935 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.298002 15964 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.411324 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:13.392711 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.415696 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:13.424324 11873 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:13.428586 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 110063us
I20260709 12:11:13.430323 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:13.432106 15735 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.432685 15735 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.433156 15735 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.440062 15965 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.440821 15965 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.424008 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.441273 15965 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.445083 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.451433 15924 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:13.339882 15905 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:13.469559 12021 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:13.414952 15650 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.368304 15911 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:11:13.322588 15903 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.427969 15642 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.462643 15646 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.462222 15896 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.408274 15940 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 12:11:13.483419 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59504.7us
I20260709 12:11:13.494343 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.408349 15898 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.496608 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.466046 15941 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 12:11:13.503290 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.511507 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.476514 15650 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.486080 15642 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:13.514487 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50841.3us
I20260709 12:11:13.484126 15521 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.486341 15907 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:13.489220 15939 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.471545 15905 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.500823 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:13.487257 15997 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:13.495473 15896 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:13.533826 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:13.507798 15646 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:13.547454 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 114346us
I20260709 12:11:13.500547 15980 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.543200 12013 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.517620 15935 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.535797 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.525301 15642 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.527798 15870 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:13.512912 15949 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:13.546644 15970 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.567955 15621 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.547880 15896 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.578166 15934 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.579757 11945 raft_consensus.cc:2410] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:13.581383 12014 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:13.562845 15870 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:13.582654 15870 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.583956 15870 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.586071 15845 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.586598 15646 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.588367 15964 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:13.590385 15993 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:11:13.592612 15905 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.593901 15949 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:13.594451 15949 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.570286 15650 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.570752 15939 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:13.572773 15995 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:11:13.542285 15907 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.610805 15970 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.612589 15907 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:13.574906 15903 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.527082 15978 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:13.571943 15994 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:13.557509 15950 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.612061 15970 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.576574 15965 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:13.614554 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 91002.4us
I20260709 12:11:13.620838 12013 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:13.595538 15949 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.598956 15650 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.598027 15996 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.637964 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.646411 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.651890 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:13.653421 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103776us
I20260709 12:11:13.622061 15978 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:13.656787 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:13.635309 15950 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:13.667336 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.662662 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 112924us
I20260709 12:11:13.625669 15735 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.673853 11946 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:13.643493 15996 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:13.653925 15923 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:13.680802 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56978.6us
I20260709 12:11:13.692554 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.699292 11946 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:13.695600 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.700771 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.657199 15978 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.680140 16009 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.708107 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.709013 11873 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.712083 11939 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:11:13.627733 15980 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:11:13.716361 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:13.717058 11869 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.717696 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.717990 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.718071 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.720902 15949 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.680274 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:13.723781 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:13.665705 15615 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:13.705485 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.726287 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.722746 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.687934 15996 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.738476 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:13.723088 15925 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.009s
I20260709 12:11:13.746446 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.758373 16012 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.758670 16000 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:11:13.759233 16012 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.715595 15971 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:13.720844 16009 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:13.759681 16010 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.815781 11941 raft_consensus.cc:2410] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:13.772397 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:13.705947 15923 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.771458 15906 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.794020 16003 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.211s	user 0.000s	sys 0.003s
I20260709 12:11:13.781760 16017 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.843348 16017 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.844295 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2437) took 1301 ms. Trace:
I20260709 12:11:13.844734 12017 rpcz_store.cc:276] 0709 12:11:12.543080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.653292 (+110212us) service_pool.cc:224] Handling call
0709 12:11:12.676158 (+ 22866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.301778 (+625620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.301821 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.306443 (+  4622us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.443048 (+136605us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.443145 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.443298 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.793172 (+349874us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:13.843961 (+ 50789us) raft_consensus.cc:1685] finished
0709 12:11:13.843988 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.844222 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":471858,"raft.queue_time_us":482011,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"spinlock_wait_cycles":40323456,"thread_start_us":187412,"threads_started":2,"wal-append.queue_time_us":164328}
I20260709 12:11:13.845885 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.846333 15735 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.846859 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.847232 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.848173 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.848428 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.849331 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.850499 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.851608 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.852361 12017 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:13.853083 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.783285 16019 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.835099 15923 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:13.835876 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.838340 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.866657 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:13.854933 11873 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:13.855209 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.832669 16009 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:13.830727 15925 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:13.867236 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:13.843904 15986 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.545s	user 0.004s	sys 0.000s
I20260709 12:11:13.785745 16004 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.903334 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.885303 15965 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.890044 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.761194 15950 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.896677 11942 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:13.897137 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 223881us
W20260709 12:11:13.897722 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 233614us
W20260709 12:11:13.898360 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 221522us
I20260709 12:11:13.890743 15896 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.899675 12013 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:13.838268 15615 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:13.901093 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:13.907938 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.913012 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:13.914312 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:13.902519 16012 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:13.928310 12017 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:13.928974 15970 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:11:13.929440 15970 raft_consensus.cc:1068] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Unable to promote non-voter 189a165e6619406382914fe3075dd436: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:13.929998 11988 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:13.893328 15925 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:13.938009 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.906865 16004 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:13.943955 15922 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:13.939237 15926 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.656s	user 0.015s	sys 0.000s
W20260709 12:11:13.949733 16013 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:13.951227 11864 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.941458 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:13.954581 11873 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:13.958716 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.953481 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:13.911648 15615 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.956643 15923 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:13.955821 15964 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:13.968083 15642 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.955569 15907 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:11:13.984133 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52536.8us
I20260709 12:11:13.973361 11948 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.972184 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.979775 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:13.980050 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:13.891623 16019 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:13.988385 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.952425 16017 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.957010 16004 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.987360 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:13.985459 11864 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:13.990836 11943 raft_consensus.cc:606] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:13.993773 12017 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:14.005271 11943 raft_consensus.cc:614] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:13.994081 16012 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.996009 15896 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.998332 15926 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.001334 15735 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:11:14.009835 15926 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.998567 15965 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:13.984635 15521 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:14.011267 16023 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:14.011408 15521 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.011854 16023 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.010699 15965 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:13.999286 15650 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.999945 15971 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:14.000475 12014 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:14.014628 15926 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.015650 16024 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.016396 15926 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.980801 15962 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.993883 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2434) took 1457 ms. Trace:
I20260709 12:11:14.000248 15925 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.017396 12019 rpcz_store.cc:276] 0709 12:11:12.536933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.539587 (+  2654us) service_pool.cc:224] Handling call
0709 12:11:12.540064 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.677869 (+137805us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:12.877367 (+199498us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.160734 (+283367us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.161319 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.161471 (+   152us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.161505 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.212509 (+ 51004us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54000aa354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:13.212558 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.843057 (+630499us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:13.993633 (+150576us) raft_consensus.cc:1685] finished
0709 12:11:13.993658 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.993818 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":596988,"raft.queue_time_us":178880,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":19907,"spinlock_wait_cycles":51767552,"thread_start_us":161833,"threads_started":1,"wal-append.queue_time_us":248626}
I20260709 12:11:14.020138 15642 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:14.006649 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:14.021768 11947 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:14.007346 15992 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.023558 15992 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.024036 15992 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.022846 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:14.030534 11947 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:14.007575 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:14.007572 15923 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:14.008446 15970 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:14.009183 15905 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.013233 15965 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.054929 15965 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.056571 11940 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:14.016435 16024 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:14.057683 15905 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:14.022893 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:14.030051 15615 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.059103 15615 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.058676 15905 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.060071 15905 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.031100 16017 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:14.031343 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 44080.3us
I20260709 12:11:14.032133 15996 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:14.063674 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.972110 15891 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:14.064492 15996 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:13.986796 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.065708 16012 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:14.065889 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79176.5us
I20260709 12:11:14.067004 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.067946 11946 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.068233 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.069043 15962 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.038173 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:14.014539 16019 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:14.045753 11869 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:14.120868 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:14.048733 16031 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 12:11:14.049382 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:14.123517 11865 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.050366 16023 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:14.067847 16012 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.038877 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:14.131142 11873 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:14.071918 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:14.069509 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.046732 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:14.121959 11869 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.136276 15926 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.138760 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:14.139578 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 70156.9us
I20260709 12:11:14.141139 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.142800 11865 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:14.142889 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:14.144974 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:14.153162 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.153757 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.136951 15926 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.169935 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.143682 15715 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.196411 12020 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:14.212883 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74065.3us
I20260709 12:11:14.223340 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:14.224296 12015 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:14.151028 16010 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.151810 15845 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:14.245800 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48415us
I20260709 12:11:14.258082 11869 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:14.274197 16005 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.274927 16005 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:14.279143 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:14.280114 12013 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:14.284137 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.283208 16005 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:14.307721 15991 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.715s	user 0.003s	sys 0.000s
I20260709 12:11:14.311467 15898 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:14.322314 15949 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.335101 15949 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:14.328919 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1750) took 1072 ms. Trace:
I20260709 12:11:14.336125 11941 rpcz_store.cc:276] 0709 12:11:13.261826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.262151 (+   325us) service_pool.cc:224] Handling call
0709 12:11:14.328571 (+1066420us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002e59d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:14.328784 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174675328}
I20260709 12:11:14.333094 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1752) took 1061 ms. Trace:
I20260709 12:11:14.337402 11945 rpcz_store.cc:276] 0709 12:11:13.271982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.272469 (+   487us) service_pool.cc:224] Handling call
0709 12:11:14.332768 (+1060299us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400311354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:14.332993 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703922048}
I20260709 12:11:14.166252 15962 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:14.341385 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.342377 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 88481.5us
W20260709 12:11:14.356564 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.367592 12013 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:14.377594 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:14.378481 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:14.246362 16019 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.195171 16012 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 12:11:14.255973 16007 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.222261 15735 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 12:11:14.189926 15978 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:14.444248 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 274419us
I20260709 12:11:14.491173 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:14.443531 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2347) took 1189 ms. Trace:
I20260709 12:11:14.493036 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.494982 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.424475 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:14.497092 12013 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.256253 15642 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.179s
I20260709 12:11:14.493404 11866 rpcz_store.cc:276] 0709 12:11:13.239542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.274659 (+ 35117us) service_pool.cc:224] Handling call
0709 12:11:13.274965 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.417020 (+142055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.428259 (+1011239us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000951d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:14.428538 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324563712}
W20260709 12:11:14.537649 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.411217 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:14.605903 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 110983us
W20260709 12:11:14.612790 16034 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:14.613375 16022 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.472s
I20260709 12:11:14.436774 16023 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:14.430112 15898 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:14.613289 16014 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:14.551815 15621 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.552762 16010 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.644872 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:14.655575 12018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2455) took 1421 ms (client timeout 1619 ms). Trace:
I20260709 12:11:14.620530 15970 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:14.656616 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 393474us
I20260709 12:11:14.621570 15939 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:14.731822 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.623708 16006 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:14.432049 16019 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.649757 15962 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:14.650115 15845 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:14.752651 15980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.023s	sys 0.081s
I20260709 12:11:14.725474 15621 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:14.774530 16034 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:14.723351 15900 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 12:11:14.661638 15898 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:14.634435 16007 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.153s
W20260709 12:11:14.794559 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.798445 15735 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.666909 16023 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:14.621361 15911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.012s	sys 0.023s
I20260709 12:11:14.725714 16014 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.813700 12602 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:11:14.875811 11868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.013s
W20260709 12:11:14.830809 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 186023us
W20260709 12:11:14.814745 12018 rpcz_store.cc:269] 0709 12:11:13.216537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.216660 (+   123us) service_pool.cc:224] Handling call
0709 12:11:14.637718 (+1421058us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54004619d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:14.638008 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923056384}
W20260709 12:11:14.856779 12017 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.008s
I20260709 12:11:14.844650 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:14.839427 15980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.024s	sys 0.081s
I20260709 12:11:14.902518 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:14.845917 11760 maintenance_manager.cc:419] P 5830ee4e61e44665868e20af26f32046: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033364
I20260709 12:11:14.843906 15621 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:14.901916 11868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.009s	sys 0.017s
W20260709 12:11:14.902442 12017 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.011s	sys 0.008s
I20260709 12:11:14.806478 15926 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:14.905925 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:14.906387 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.000s	sys 0.028s
W20260709 12:11:14.916970 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.000s	sys 0.028s
W20260709 12:11:14.891324 16008 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.042s	user 0.002s	sys 0.009s
W20260709 12:11:14.932077 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.011s	sys 0.015s
W20260709 12:11:14.934973 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.012s	sys 0.015s
W20260709 12:11:14.937501 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 949116us
W20260709 12:11:14.904352 15911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.028s	sys 0.029s
W20260709 12:11:14.947510 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103067us
I20260709 12:11:14.940750 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:14.894095 16007 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:14.953501 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:14.833876 16001 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:14.915787 16042 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:11:14.916016 16038 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:11:14.992378 12013 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:14.987949 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:14.914981 16016 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:14.867391 15845 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.834836 15970 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.845022 15962 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:14.903746 15642 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:11:14.956043 15926 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.988066 16036 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 12:11:14.938767 15735 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:15.001323 16040 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.379s	user 0.002s	sys 0.002s
I20260709 12:11:15.047945 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2362) took 1533 ms. Trace:
I20260709 12:11:14.950372 15978 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:14.998013 15906 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:11:15.101719 16044 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 12:11:15.114604 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 126759us
I20260709 12:11:15.102527 15989 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.103629 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:15.107663 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.120754 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.096452 11867 rpcz_store.cc:276] 0709 12:11:13.514578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.514692 (+   114us) service_pool.cc:224] Handling call
0709 12:11:13.515060 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.602055 (+ 86995us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:13.899099 (+297044us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.959904 (+ 60805us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.979722 (+ 19818us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.979950 (+   228us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:13.980006 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.980114 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.047606 (+1067492us) raft_consensus.cc:1685] finished
0709 12:11:15.047634 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.047845 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9052,"prepare.queue_time_us":295432,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":71168,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":229,"thread_start_us":405978,"threads_started":3,"wal-append.queue_time_us":105128}
W20260709 12:11:15.115983 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.038138 16008 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:15.115518 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:15.064489 15715 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.061642 15992 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.037s	user 0.014s	sys 0.000s
I20260709 12:11:15.050006 16010 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.054040 15646 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:15.060297 16049 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:11:15.021138 16068 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:15.134346 15930 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:15.137252 16007 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.120101 15989 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.094532 15926 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:11:15.174126 16054 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:15.050006 16016 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.163985 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2372) took 1122 ms. Trace:
I20260709 12:11:15.151001 16010 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:15.192945 16063 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.193039 16058 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.193470 16075 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.193787 16063 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.194101 16075 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.195231 16050 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.196148 16063 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.196276 16075 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.195921 16050 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.191627 15930 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:15.198280 16046 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.198794 16046 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.198864 15930 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.190402 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2460) took 1154 ms. Trace:
I20260709 12:11:15.159837 15992 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.173559 15911 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.197654 16047 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.193925 16058 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.187223 15989 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.182719 15923 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.191017 11864 rpcz_store.cc:276] 0709 12:11:14.041928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.134231 (+ 92303us) service_pool.cc:224] Handling call
0709 12:11:14.134593 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.134858 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:14.560150 (+425292us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.163517 (+603367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.163639 (+   122us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:15.163701 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.163778 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.163922 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149619,"prepare.queue_time_us":208983,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":27650,"raft.queue_time_us":186209,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12002,"thread_start_us":879723,"threads_started":3}
I20260709 12:11:15.200846 12022 rpcz_store.cc:276] 0709 12:11:14.035651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.036107 (+   456us) service_pool.cc:224] Handling call
0709 12:11:14.046203 (+ 10096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.046564 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.046589 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.047100 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.398271 (+351171us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:14.398340 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.398451 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.190142 (+791691us) raft_consensus.cc:1685] finished
0709 12:11:15.190166 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.190323 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":245081,"threads_started":1,"wal-append.queue_time_us":596998}
W20260709 12:11:15.162949 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 247932us
I20260709 12:11:15.232782 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2367) took 1192 ms. Trace:
I20260709 12:11:15.201156 16046 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.166888 15646 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.241176 16014 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.183156 15971 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:11:15.242568 15923 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.243081 15926 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.244801 15923 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:15.230796 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 67193.1us
W20260709 12:11:15.204283 16037 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:11:15.202791 16052 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:11:15.202239 16055 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:11:15.164867 16068 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:15.256136 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 88506.3us
I20260709 12:11:15.201617 16070 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.187109 16007 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:15.253583 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.655s	user 0.012s	sys 0.024s
I20260709 12:11:15.260349 16070 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.262918 16007 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.202332 15970 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.226413 16019 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.158855 15715 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:15.260730 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.662s	user 0.013s	sys 0.024s
I20260709 12:11:15.240093 11870 rpcz_store.cc:276] 0709 12:11:14.040166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.040297 (+   131us) service_pool.cc:224] Handling call
0709 12:11:14.040596 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.040832 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:14.071055 (+ 30223us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.230339 (+1159284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.230389 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:15.232409 (+  2020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.232521 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.232700 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149758,"prepare.queue_time_us":76301,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":52,"raft.queue_time_us":188713,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":17348,"thread_start_us":1038092,"threads_started":2,"wal-append.queue_time_us":1023210}
I20260709 12:11:15.202571 16069 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:15.265247 16023 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.285037 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.246264 15898 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.238883 15911 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:15.262852 16070 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.258890 16068 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:15.294528 11947 raft_consensus.cc:2410] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:15.296769 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.297734 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.408356 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.408988 11870 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:15.410146 11864 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:15.294360 15935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.701s	user 0.010s	sys 0.011s
I20260709 12:11:15.285989 15926 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.287185 15997 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:15.406056 16075 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.319916 16007 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.431473 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:15.438577 15905 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.378s	user 0.016s	sys 0.002s
W20260709 12:11:15.463469 11948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1756) took 2178 ms (client timeout 2135 ms). Trace:
I20260709 12:11:15.434298 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2374) took 1391 ms. Trace:
I20260709 12:11:15.461658 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2368) took 1421 ms. Trace:
I20260709 12:11:15.411355 16063 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:11:15.429503 16077 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:11:15.466948 11948 rpcz_store.cc:269] 0709 12:11:13.284963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.319830 (+ 34867us) service_pool.cc:224] Handling call
0709 12:11:15.457020 (+2137190us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400240754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:15.463362 (+  6342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495653632}
W20260709 12:11:15.430469 15935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.823s	user 0.011s	sys 0.011s
I20260709 12:11:15.417052 16057 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.424868 15962 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.467084 11865 rpcz_store.cc:276] 0709 12:11:14.042969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.151733 (+108764us) service_pool.cc:224] Handling call
0709 12:11:14.189518 (+ 37785us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:14.190107 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.190153 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:14.230081 (+ 39928us) log.cc:844] Serialized 52 byte log entry
0709 12:11:14.809749 (+579668us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:14.809797 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.809869 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.433928 (+624059us) raft_consensus.cc:1685] finished
0709 12:11:15.433960 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.434213 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54751,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":13353,"thread_start_us":432610,"threads_started":1,"wal-append.queue_time_us":666538}
I20260709 12:11:15.491940 16046 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.492594 16046 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.495194 16046 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.461889 15735 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:15.426318 16061 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:11:15.466589 16007 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.473351 15924 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.301889 16069 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:15.481133 15615 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.421s	user 0.011s	sys 0.004s
I20260709 12:11:15.293422 16010 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.484725 16074 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.485201 16057 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.485067 15997 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.428280 16058 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.486773 15964 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.488746 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2373) took 1446 ms. Trace:
I20260709 12:11:15.467700 11868 rpcz_store.cc:276] 0709 12:11:14.040545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.040691 (+   146us) service_pool.cc:224] Handling call
0709 12:11:14.053905 (+ 13214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.054168 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:14.250246 (+196078us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.411599 (+1161353us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.461217 (+ 49618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.461282 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.461338 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.461413 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.461574 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215802,"prepare.queue_time_us":346721,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":21368,"raft.queue_time_us":230259,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":17385,"spinlock_wait_cycles":14271872,"thread_start_us":1140360,"threads_started":4,"wal-append.queue_time_us":903381}
I20260709 12:11:15.426126 15949 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:15.429520 15939 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.003s
I20260709 12:11:15.501158 15992 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:15.502108 15965 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.447s	user 0.009s	sys 0.006s
I20260709 12:11:15.497968 15911 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:15.503935 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.506961 11940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1937) took 1812 ms (client timeout 2106 ms). Trace:
I20260709 12:11:15.507988 15715 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.508270 16050 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:15.490769 16004 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.468s	user 0.009s	sys 0.006s
I20260709 12:11:15.527769 16004 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.529495 11872 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:15.530206 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.465577 16075 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.532651 16069 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.533553 16075 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.534932 16057 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.538065 16004 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.524149 16007 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.555115 16007 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.556555 16007 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:15.562429 15621 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 12:11:15.575821 15965 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.576201 15621 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.576539 15925 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.576462 15965 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.560753 16007 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.578843 15621 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.579419 15965 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.474433 15935 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:15.462915 15926 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.515841 11873 rpcz_store.cc:276] 0709 12:11:14.042747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.150630 (+107883us) service_pool.cc:224] Handling call
0709 12:11:14.151024 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.151380 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.151409 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.156287 (+  4878us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.610322 (+454035us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:14.610374 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.611482 (+  1108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.487237 (+875755us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b2400116ca8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f18984fb0 00007f1f1b5fb488 00007f1f1b5fbbe8 00007f1f1b5d3398 00007f1f1b5ce76a 00007f1f1b5cdbb6
0709 12:11:15.488410 (+  1173us) raft_consensus.cc:1685] finished
0709 12:11:15.488431 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.488682 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20090,"raft.queue_time_us":1496,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5131,"spinlock_wait_cycles":14296960,"thread_start_us":354531,"threads_started":1,"wal-append.queue_time_us":599697}
W20260709 12:11:15.518922 11940 rpcz_store.cc:269] 0709 12:11:13.694209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.696675 (+  2466us) service_pool.cc:224] Handling call
0709 12:11:15.506723 (+1810048us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400425c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:15.506847 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628960512}
I20260709 12:11:15.518553 15964 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.519639 16074 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.520578 16010 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.587302 16074 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.524094 16014 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.526104 15521 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.588421 16014 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:15.589432 16014 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.590047 15964 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.590349 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:15.590679 16014 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.591224 16057 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.591711 16057 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.591073 15935 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.592037 16057 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.582307 15949 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.595506 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.596333 11940 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:15.596398 16011 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:15.595129 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.600802 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.602226 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.603065 11940 raft_consensus.cc:2410] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:15.605296 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.606547 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.606685 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:15.607692 11939 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:15.520357 15939 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.609473 11945 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:15.616215 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:15.617080 11942 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.618439 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.619403 11941 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:15.603809 15989 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.628525 15989 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.637637 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 794) took 1372 ms. Trace:
I20260709 12:11:15.638082 12014 rpcz_store.cc:276] 0709 12:11:14.264909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.389867 (+124958us) service_pool.cc:224] Handling call
0709 12:11:14.449427 (+ 59560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.946578 (+497151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.946629 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:14.946691 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:14.946740 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.637361 (+690621us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400178254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:15.637406 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.637575 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142568192}
I20260709 12:11:15.641284 16007 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.641916 16007 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.643028 16012 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.643558 16012 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.644372 16007 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.622605 15965 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.649228 15965 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.650352 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44140 (request call id 54) took 2446 ms. Trace:
I20260709 12:11:15.650897 11943 rpcz_store.cc:276] 0709 12:11:13.203618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.203782 (+   164us) service_pool.cc:224] Handling call
0709 12:11:13.655967 (+452185us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0fc40 00007f1f209fbbb9 00007f1f209fb47c 00007f1f19f817d4
0709 12:11:15.649874 (+1993907us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400240754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2d853 00007f1f209fb60a 00007f1f19f817d4 00007f1f19f81762 00007f1f19f81691 00007f1f19f8160c 00007f1f19f808c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:15.650037 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788524800}
I20260709 12:11:15.652060 15965 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.574858 16068 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.612316 15621 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.679944 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71935.6us
I20260709 12:11:15.684134 11942 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:15.692418 11942 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:15.696403 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.697166 11873 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:11:15.705410 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:15.713091 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:15.718128 16009 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:15.719980 16009 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.720431 16009 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.702148 16012 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:15.725816 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99424.2us
I20260709 12:11:15.726641 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:15.728938 11944 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:15.687369 15621 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.734587 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2468) took 1564 ms. Trace:
W20260709 12:11:15.734820 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.744894 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.746616 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:15.747665 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.759634 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.761669 11941 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:15.760515 11944 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
W20260709 12:11:15.761524 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 820780us
I20260709 12:11:15.762533 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:15.730752 16014 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.774349 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2463) took 1651 ms. Trace:
W20260709 12:11:15.772156 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.774770 12017 rpcz_store.cc:276] 0709 12:11:14.123329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.123484 (+   155us) service_pool.cc:224] Handling call
0709 12:11:14.125812 (+  2328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.137825 (+ 12013us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:14.915580 (+777755us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.765316 (+849736us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.765815 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.765980 (+   165us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:15.766017 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.766096 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.774162 (+  8066us) raft_consensus.cc:1685] finished
0709 12:11:15.774180 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.774298 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557218,"prepare.queue_time_us":59290,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":492086,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":8787,"thread_start_us":1015303,"threads_started":2,"wal-append.queue_time_us":410431}
I20260709 12:11:15.719028 16057 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.786440 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:15.793763 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:15.760013 15922 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.800779 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:15.763782 16012 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.802786 11871 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.808656 11869 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.767585 16051 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:15.763695 15965 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.763993 15980 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.809975 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.810606 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:15.789139 16019 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.804873 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:15.829108 11873 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.829151 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:15.807883 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:15.830593 11871 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.830691 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.803834 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:15.831598 11865 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:15.788596 15997 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.773711 16067 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.786650 15989 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.818030 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:15.820778 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:15.792356 16068 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.823387 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.773283 15898 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.808768 16024 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.811708 15922 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:15.832864 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.826467 12017 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:15.809187 16084 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.834561 12018 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:15.798415 15905 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.874867 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.874997 15905 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.875897 11865 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:15.798432 15978 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:15.877689 15978 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.806778 15907 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:15.843357 12019 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:15.782167 16014 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.853422 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:15.808919 16088 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.859335 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:15.892494 12017 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:15.877414 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.901012 11865 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:15.885497 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.820549 15521 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:15.890647 11869 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:15.891804 16058 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.908782 15650 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.848934 15926 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.866690 16004 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.867029 16084 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.911767 15922 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.828409 15965 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.912146 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:15.874951 16101 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:15.849720 15997 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.912875 15621 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.916257 15646 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:15.917210 16068 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.964361 16068 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.920894 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.885486 15898 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.966215 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.967152 15898 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.967265 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:15.967729 15898 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.967877 11869 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:15.968222 15898 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.968906 11869 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.908746 15875 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:15.909972 16057 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.929898 15521 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.934495 15650 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.827559 16007 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:15.813679 16012 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.909680 16024 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.944092 15715 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:15.892266 16067 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.866626 15992 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:15.908813 16094 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:15.944897 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:15.945953 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:15.946861 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.929025 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:15.893875 15989 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:15.911814 15845 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:15.962430 11871 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:15.970250 16089 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.941437 15930 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.941781 16004 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.837580 15980 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.969520 11941 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:15.983131 15621 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.943776 15962 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.938429 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.010778 15621 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.994993 16075 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.021754 16075 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.022296 16075 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.026499 15989 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.018342 16005 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.946861 16084 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.886336 16019 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.948444 16046 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:15.989969 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61051.5us
I20260709 12:11:15.992094 11871 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:16.038276 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:15.994104 15898 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:15.994253 15650 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.039784 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.041870 15845 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:16.042573 15845 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:15.903658 16078 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 12:11:15.936815 16058 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:16.052497 16102 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:11:16.052572 15521 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.001641 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.000669 16004 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.003645 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:16.012239 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.002996 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.001039 15930 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:16.063000 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.903755 16088 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.981774 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.044795 12017 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:16.047202 15845 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.048216 15939 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.076731 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.051548 16046 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:15.975363 11873 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:16.055054 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:16.085850 11869 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.990445 15715 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.062428 16007 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.058220 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 282452us
I20260709 12:11:15.991096 15992 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:15.998978 16089 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:15.972258 15922 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.089985 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.092067 15715 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.093562 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.100658 12013 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:16.101897 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.105221 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.106256 15903 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:16.106695 15903 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.107106 15903 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.094286 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.037853 15962 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.097013 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.067809 16058 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.098198 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.108397 11865 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:16.103595 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.111240 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.116017 11941 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.118824 11946 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:16.095958 15939 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.135079 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:16.136104 11943 raft_consensus.cc:606] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:16.136584 11943 raft_consensus.cc:614] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.141362 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.121798 16088 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.142452 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.142674 15621 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.143342 15997 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.143692 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.139566 15939 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.151223 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.150882 11941 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:16.152900 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.156183 11943 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.157836 11941 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:16.099143 16007 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.109511 15922 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.167284 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:16.168113 11865 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.163319 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.174299 12019 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:16.153926 15965 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:16.189323 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.172706 16012 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.195604 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.204453 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:16.211606 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.212317 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.195152 16067 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.198908 15980 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.226351 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.210084 16019 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.210443 16051 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.215698 15621 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.216584 16012 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.265445 16103 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.221228 16089 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.229315 16067 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:16.267987 16103 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:16.268399 16067 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.270342 16103 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.271595 15922 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.272537 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.273797 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:16.274089 16104 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:11:16.274811 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.275153 15962 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.275836 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:16.264523 15980 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:16.277359 15980 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.278218 16103 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.278734 16103 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.276441 12019 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:15.736107 12020 rpcz_store.cc:276] 0709 12:11:14.170054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.213429 (+ 43375us) service_pool.cc:224] Handling call
0709 12:11:14.342021 (+128592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.342261 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:14.405225 (+ 62964us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.814061 (+408836us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.525323 (+711262us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b1800407b00. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:15.734022 (+208699us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b1800407b00. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:15.734212 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.734260 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.734311 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.734375 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.734516 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":895893,"prepare.queue_time_us":72733,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":102,"raft.queue_time_us":101,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4467,"spinlock_wait_cycles":36995200,"thread_start_us":408039,"threads_started":1,"wal-append.queue_time_us":461946}
I20260709 12:11:16.281855 11865 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:16.285575 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.222530 15930 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.291534 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.292599 11939 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:16.295194 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.298501 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.301611 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.304433 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.304888 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.262084 16113 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.305611 11865 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:16.304997 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.303228 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.308291 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.270406 16067 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.282197 15922 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.313907 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.314951 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.315593 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:16.316958 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.311836 16113 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.296361 15997 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.321967 11865 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.280951 15621 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.321379 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.299135 16046 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.371429 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.377372 16114 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.378732 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.380381 12019 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:16.305373 16019 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.321923 12603 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:16.286965 16012 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.407559 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:16.319048 16009 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.000s
W20260709 12:11:16.395265 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.408231 12019 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:16.402456 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.318220 15939 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.312342 15980 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.306849 16111 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.405213 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.318893 15992 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.321918 16039 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:16.410739 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.412067 12610 raft_consensus.cc:2368] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:16.320271 16105 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:16.424876 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.430359 12016 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.319962 16088 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:11:16.443361 12016 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.458480 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:16.457595 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 132194us
I20260709 12:11:16.384227 16112 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.372210 15922 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.461416 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.465749 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.466974 12019 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:16.391799 15997 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.429495 15939 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:16.471756 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.468776 12016 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.475270 11837 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:16.477574 16107 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.277s	user 0.001s	sys 0.001s
I20260709 12:11:16.478363 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.478308 12016 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.409838 16075 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.319617 16051 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.481637 11837 leader_election.cc:400] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:16.482146 11837 leader_election.cc:403] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:16.483498 15621 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.481168 15962 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:16.465063 16007 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.485903 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.481340 16046 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.488600 16075 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.490407 16004 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.491709 15997 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.492448 16004 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.492610 12020 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:16.493235 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.493971 12019 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:16.497174 16012 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.479915 15939 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.500012 15939 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.500411 12019 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:16.410012 16114 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.468075 16088 consensus_queue.cc:1243] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:16.521677 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.474468 16105 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.546118 11868 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:11:16.546478 11872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1879) took 2850 ms (client timeout 2115 ms). Trace:
I20260709 12:11:16.547273 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.546950 16105 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.548488 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:16.548863 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.424821 16009 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.549430 12013 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:16.550731 16009 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.551436 12606 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:16.551950 16024 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.524408 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.531244 12016 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:16.553812 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2461) took 2508 ms. Trace:
I20260709 12:11:16.554144 12016 rpcz_store.cc:276] 0709 12:11:14.045471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.045814 (+   343us) service_pool.cc:224] Handling call
0709 12:11:14.070051 (+ 24237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.430257 (+2360206us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001ba920. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b9aadc0 00007f1f1ba351c0 00007f1f1ba36231 00007f1f1ba32d8f 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c
0709 12:11:16.553569 (+123312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.553745 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034202368}
W20260709 12:11:16.546861 11872 rpcz_store.cc:269] 0709 12:11:13.695727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.695881 (+   154us) service_pool.cc:224] Handling call
0709 12:11:16.546261 (+2850380us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000947d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:16.546392 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4167424384}
I20260709 12:11:16.556362 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.556923 11872 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:16.557526 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:16.557811 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.558110 11869 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.558342 11872 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:16.528216 15903 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.549005 11868 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:16.572600 11865 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:16.559904 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:16.540102 15922 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.573961 11872 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:16.460182 16039 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.586961 11872 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:16.595742 11872 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:16.595281 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 73080.9us
I20260709 12:11:16.597368 11837 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.598694 16046 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.600575 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:16.604939 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:16.576683 16115 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:11:16.577121 16021 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:16.609356 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:16.610170 15922 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:16.476169 16112 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.623874 16112 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.625304 16113 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.608420 16103 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:16.634450 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:16.635293 16084 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.005s
I20260709 12:11:16.636184 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:16.638535 11869 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:16.641021 11868 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:16.644966 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:16.635759 16084 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.625614 15903 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.641930 16004 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:16.666299 16112 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.672322 16112 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.673797 11940 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.674465 16112 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.667795 16106 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:16.678200 16106 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.679323 16106 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.679893 16039 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.667688 15980 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:16.680694 15980 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.651417 16046 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.681489 15980 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.682708 15980 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.684463 16084 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:16.689647 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.691298 16005 consensus_meta.cc:287] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
I20260709 12:11:16.691885 16080 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.692482 16080 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.693113 16114 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:16.693979 11864 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:16.694093 12019 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.694381 11864 pending_rounds.cc:85] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 7
I20260709 12:11:16.694693 11864 pending_rounds.cc:107] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:16.658270 16088 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:16.694972 11864 raft_consensus.cc:2889] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:16.702716 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57820us
I20260709 12:11:16.704988 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 480) took 1454 ms. Trace:
I20260709 12:11:16.705571 11870 rpcz_store.cc:276] 0709 12:11:15.250237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.419011 (+168774us) service_pool.cc:224] Handling call
0709 12:11:15.464784 (+ 45773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.483498 (+ 18714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.483549 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.497416 (+ 13867us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.576385 (+1078969us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b1800448120. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:11:16.644386 (+ 68001us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:16.644426 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.644503 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.695319 (+ 50816us) raft_consensus.cc:1685] finished
0709 12:11:16.695344 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.704910 (+  9566us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18185,"raft.queue_time_us":25491,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2847,"spinlock_wait_cycles":13378944,"thread_start_us":67458,"threads_started":1,"wal-append.queue_time_us":1168131}
I20260709 12:11:16.728024 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.728978 12016 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:16.743347 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:16.744747 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.745421 12016 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:16.748550 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.749306 12022 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:16.764640 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 479) took 1516 ms. Trace:
I20260709 12:11:16.777457 11864 rpcz_store.cc:276] 0709 12:11:15.248517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.412779 (+164262us) service_pool.cc:224] Handling call
0709 12:11:15.461314 (+ 48535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.702377 (+1241063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.764305 (+ 61928us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000942d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:16.764561 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833842944}
I20260709 12:11:16.746588 15906 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:16.778558 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.780328 12016 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:16.785389 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.785686 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.786603 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.786988 11947 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.788918 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:16.792547 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.787789 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.793018 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.793633 11943 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:16.793915 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.794507 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.795100 11943 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:16.795132 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.796325 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.798753 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.799319 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.799753 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.801016 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.799319 11943 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:16.802229 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.779811 15906 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.803750 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.804335 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.805884 11944 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:16.804382 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:16.792604 15642 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:16.796885 16069 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:16.805934 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.805881 16067 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.814060 16069 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.814613 16069 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.815243 15642 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:16.817288 15642 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.803351 15911 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:16.819422 15911 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.819854 15911 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.825402 15978 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.807113 15925 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.826399 15925 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.826728 15925 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.827761 11947 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:16.827633 16069 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.829883 16069 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:16.825450 12021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2465) took 2687 ms (client timeout 2228 ms). Trace:
W20260709 12:11:16.830718 12021 rpcz_store.cc:269] 0709 12:11:14.138097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.138425 (+   328us) service_pool.cc:224] Handling call
0709 12:11:16.825182 (+2686757us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400179154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:16.825337 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4796652416}
I20260709 12:11:16.831629 11942 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:16.831995 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:16.833051 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.830763 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.833366 16019 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.833904 16019 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:16.834208 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.834901 16019 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.835901 12017 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:16.836308 16026 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:16.837867 16080 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.801713 15992 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:16.813090 15989 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:16.845862 12022 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:16.847363 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.832747 15906 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.839519 16068 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:16.851449 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.854184 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.855208 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.853353 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.850696 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:16.855854 12022 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:16.856794 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:16.852329 16135 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.003s
I20260709 12:11:16.857383 12022 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
W20260709 12:11:16.853514 16131 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.004s
I20260709 12:11:16.864058 16067 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:16.861033 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.868436 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 475) took 1959 ms. Trace:
W20260709 12:11:16.870289 12015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2472) took 2607 ms (client timeout 1540 ms). Trace:
W20260709 12:11:16.870810 12015 rpcz_store.cc:269] 0709 12:11:14.262738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.266475 (+  3737us) service_pool.cc:224] Handling call
0709 12:11:16.870021 (+2603546us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000b6654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:16.870198 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184339840}
I20260709 12:11:16.875119 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.875479 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.876763 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.877489 11945 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:16.855263 16019 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.868937 11867 rpcz_store.cc:276] 0709 12:11:14.909086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.136031 (+226945us) service_pool.cc:224] Handling call
0709 12:11:15.147014 (+ 10983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.321555 (+174541us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:15.515666 (+194111us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.696663 (+180997us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.703789 (+  7126us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.703926 (+   137us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:15.704215 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.704393 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.117289 (+412896us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b18002367a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419
0709 12:11:16.830862 (+713573us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18002367a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:16.868141 (+ 37279us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002f6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:16.868182 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.868241 (+    59us) raft_consensus.cc:1685] finished
0709 12:11:16.868251 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.868364 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67485,"prepare.queue_time_us":289821,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":20895,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":10320,"spinlock_wait_cycles":367831552,"thread_start_us":183445,"threads_started":2,"wal-append.queue_time_us":138537,"wal-append.run_cpu_time_us":2267,"wal-append.run_wall_time_us":1002267}
I20260709 12:11:16.880038 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.884853 12022 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:16.880100 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.880713 16016 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:16.880888 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.881666 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.887943 11946 raft_consensus.cc:2368] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:16.882221 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2377) took 2219 ms. Trace:
I20260709 12:11:16.882817 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 1955) took 1063 ms. Trace:
I20260709 12:11:16.854247 15989 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.880044 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.891677 11941 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:16.856618 15992 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:16.892606 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.889904 11939 rpcz_store.cc:276] 0709 12:11:15.810721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.938122 (+127401us) service_pool.cc:224] Handling call
0709 12:11:16.873231 (+935109us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b54002e54d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:16.874041 (+   810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229054336}
I20260709 12:11:16.894454 11947 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:16.888490 11866 rpcz_store.cc:276] 0709 12:11:14.654416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.654582 (+   166us) service_pool.cc:224] Handling call
0709 12:11:14.655000 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.891401 (+236401us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:14.894670 (+  3269us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.175934 (+281264us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.186560 (+ 10626us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.186737 (+   177us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:15.186777 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.547750 (+1360973us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18002e5ee0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:16.873716 (+325966us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002d9954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:16.873760 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.873799 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:16.873809 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.873931 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162126,"prepare.queue_time_us":3214,"prepare.run_cpu_time_us":703,"prepare.run_wall_time_us":2707,"raft.queue_time_us":34960,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":28152,"spinlock_wait_cycles":535618688,"thread_start_us":161106,"threads_started":1,"wal-append.queue_time_us":300657,"wal-append.run_cpu_time_us":7775,"wal-append.run_wall_time_us":1373661}
I20260709 12:11:16.876725 16067 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.901808 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:16.905706 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.906673 11947 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:16.909986 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:16.893473 15989 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.917788 11947 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.934304 12015 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:16.935775 12015 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:16.937029 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 100236us
I20260709 12:11:16.938000 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:16.938603 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.938341 12015 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.937585 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.941747 12022 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.942392 12015 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.946822 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.947224 16026 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:11:16.946707 15992 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:16.957300 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.958688 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.960062 11941 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:16.961012 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:16.965399 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.966252 11945 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:16.967047 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:16.967478 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.970793 11943 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:16.970239 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:16.974619 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.975394 11946 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:16.977427 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:16.978274 11940 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:16.941434 15964 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.985309 15935 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.997229 12021 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:16.999590 12015 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:11:17.000312 12015 pending_rounds.cc:85] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:11:17.000685 12015 pending_rounds.cc:107] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:11:17.001096 12015 raft_consensus.cc:2889] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.002674 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2500) took 1033 ms. Trace:
I20260709 12:11:17.003073 12015 rpcz_store.cc:276] 0709 12:11:15.968804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.918959 (+950155us) service_pool.cc:224] Handling call
0709 12:11:16.934132 (+ 15173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.001624 (+ 67492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.002610 (+   986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:17.006649 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2504) took 1036 ms. Trace:
I20260709 12:11:16.983085 16138 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.985424 15964 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.022151 15925 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.023447 16014 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.023200 15911 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:17.024312 15925 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.025395 15905 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:17.025496 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:17.026185 11947 raft_consensus.cc:2368] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:17.027201 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:17.021575 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2477) took 1060 ms. Trace:
I20260709 12:11:17.030381 11942 raft_consensus.cc:2368] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10.
I20260709 12:11:17.030375 12019 rpcz_store.cc:276] 0709 12:11:15.960985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.501202 (+540217us) service_pool.cc:224] Handling call
0709 12:11:16.501474 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.694663 (+193189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.021305 (+326642us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400179654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:17.021491 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442437376}
I20260709 12:11:17.034543 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:17.038189 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58594.1us
W20260709 12:11:17.041805 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 71655.1us
I20260709 12:11:17.039635 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2479) took 1078 ms. Trace:
I20260709 12:11:17.042637 12018 rpcz_store.cc:276] 0709 12:11:15.961640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.552861 (+591221us) service_pool.cc:224] Handling call
0709 12:11:16.553170 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.582800 (+ 29630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.582847 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.583438 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.737213 (+153775us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b1800407860. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:11:16.802069 (+ 64856us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.802107 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.802173 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.039300 (+237127us) raft_consensus.cc:1685] finished
0709 12:11:17.039318 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.039553 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32390,"raft.queue_time_us":36564,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":17015,"spinlock_wait_cycles":15679360,"thread_start_us":64666,"threads_started":1,"wal-append.queue_time_us":350707}
I20260709 12:11:17.046401 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.050062 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:17.053808 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.046923 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:17.025427 15911 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.037886 16021 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.041307 15905 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.038821 16138 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:17.059195 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.060410 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.045882 16019 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.062597 16138 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.047457 15964 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.059866 15978 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:17.065994 15964 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.065397 16106 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.056777 15980 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:11:17.066936 16106 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.061843 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:17.068264 16014 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:17.073673 16026 raft_consensus.cc:1064] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:11:17.070628 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.071969 16106 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.076397 11912 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:17.066797 15978 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:17.077977 15978 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:17.079205 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2487) took 1113 ms. Trace:
I20260709 12:11:17.079708 12017 rpcz_store.cc:276] 0709 12:11:15.965447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.682291 (+716844us) service_pool.cc:224] Handling call
0709 12:11:16.682638 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.849639 (+167001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.078914 (+229275us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400028354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:17.079130 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351721856}
I20260709 12:11:17.081911 15905 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.084475 11988 leader_election.cc:400] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:17.084995 11988 leader_election.cc:403] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.075377 15925 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.085852 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.086381 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:17.066720 15964 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.071813 16144 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.088742 15980 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:17.089267 15980 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:17.089486 16051 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.090170 15980 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.092211 15925 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.092623 15925 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.093703 16014 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.078876 15978 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.098650 11912 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.099119 16144 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:17.099360 16151 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.099917 11912 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.101392 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:17.098686 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.104223 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:17.100116 16151 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.087755 15903 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.111596 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.070649 16067 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.110618 16129 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.114344 15906 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:17.134557 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46598.7us
I20260709 12:11:17.100890 16069 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:11:17.101056 15911 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:17.122622 15950 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.116331 16084 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.116611 15978 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.148676 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.134897 15903 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.134938 16129 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.139191 15906 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.114892 16088 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:17.171620 15903 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:17.172586 15906 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.146229 16084 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.172609 16129 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.100317 16144 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:17.172289 15845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.010s	sys 0.029s
I20260709 12:11:17.138031 16151 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:17.007252 12022 rpcz_store.cc:276] 0709 12:11:15.970182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.942567 (+972385us) service_pool.cc:224] Handling call
0709 12:11:16.951405 (+  8838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.951647 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:16.959800 (+  8153us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.006200 (+ 46400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.006269 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.006331 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.006415 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.006577 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10249,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":102,"thread_start_us":45969,"threads_started":1}
W20260709 12:11:17.242305 16148 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:17.246445 16067 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:17.261977 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 88637.1us
I20260709 12:11:17.280498 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.170785 16078 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:17.176608 15845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.010s	sys 0.029s
I20260709 12:11:17.176826 16084 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.175346 15903 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.281189 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 130055us
I20260709 12:11:17.291162 15925 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.297005 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:17.297744 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.298871 16067 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.298884 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.299569 16067 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:17.301841 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.297685 11942 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:17.306689 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:17.280504 16088 consensus_queue.cc:1243] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:17.314920 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:17.315687 12021 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.310711 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.322492 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.326189 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.303387 16078 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:17.328439 16078 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.302780 16085 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:17.339890 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.341643 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:17.343073 16153 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:11:17.336184 16085 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:17.345566 16085 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.346400 16051 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:17.343946 15911 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.353402 15911 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.355785 15911 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.357910 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.358487 15964 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.361176 15964 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.332595 16150 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:17.366739 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2506) took 1308 ms. Trace:
I20260709 12:11:17.369525 12013 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
W20260709 12:11:17.372928 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.373883 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:17.379359 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.373271 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:17.380486 11947 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:17.403878 11940 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.404160 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 489) took 1185 ms. Trace:
I20260709 12:11:17.364964 16150 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:17.407980 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.456s (SENT) [suppressed 4 similar messages]
I20260709 12:11:17.404440 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2403) took 1205 ms. Trace:
I20260709 12:11:17.405355 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2401) took 1215 ms. Trace:
I20260709 12:11:17.364504 15911 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:17.409593 11865 rpcz_store.cc:276] 0709 12:11:16.190056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.614083 (+424027us) service_pool.cc:224] Handling call
0709 12:11:16.614461 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.614708 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:16.651802 (+ 37094us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.720369 (+ 68567us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.814904 (+ 94535us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180046c720. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:17.404986 (+590082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.405046 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:17.405090 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.405158 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.405290 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1373964,"prepare.queue_time_us":57919,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":772,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4152,"spinlock_wait_cycles":3847936,"thread_start_us":61342,"threads_started":1,"wal-append.queue_time_us":59780}
I20260709 12:11:17.404501 11872 rpcz_store.cc:276] 0709 12:11:16.218740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.668326 (+449586us) service_pool.cc:224] Handling call
0709 12:11:16.669001 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.669205 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:16.713506 (+ 44301us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.403680 (+690174us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b1800374860. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:17.403825 (+   145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.403872 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:17.403915 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.403979 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.404096 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3315,"prepare.queue_time_us":44780,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1046,"spinlock_wait_cycles":2238208}
I20260709 12:11:17.361328 16084 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.420058 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.409476 11869 rpcz_store.cc:276] 0709 12:11:16.199234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.639298 (+440064us) service_pool.cc:224] Handling call
0709 12:11:16.639607 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.639801 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:16.663511 (+ 23710us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.403954 (+740443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.404028 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.404107 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.404198 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.404362 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739222,"prepare.queue_time_us":26390,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":56316,"threads_started":1,"wal-append.queue_time_us":67792}
I20260709 12:11:17.422204 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.422837 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:17.381424 16088 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.423337 11988 leader_election.cc:400] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:17.429363 11988 leader_election.cc:403] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.401283 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.370993 16155 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:17.428442 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.436668 12018 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:17.433701 11988 leader_election.cc:400] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10.
I20260709 12:11:17.437821 11988 leader_election.cc:403] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.427695 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:17.434885 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.438588 12021 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:17.439848 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:17.440508 12021 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.440639 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.441305 11865 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:17.442380 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.443017 11866 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:17.382527 16106 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.407920 15964 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:11:17.449294 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.454289 11865 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.401917 15989 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.447484 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.426029 16051 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.427222 15935 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:17.448647 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 345450us
I20260709 12:11:17.450358 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.446393 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.451386 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.457795 11873 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.428207 16050 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.455677 11872 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:17.463967 11867 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:17.467275 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.467883 11870 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.469563 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:17.467470 11871 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:17.471239 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.512849 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.513811 11864 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:17.514101 12017 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:17.546960 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 138978us
I20260709 12:11:17.550348 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.551446 11866 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.554006 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.554952 11868 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.554898 16085 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.556690 12607 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.558701 11944 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:17.559158 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:17.453250 15845 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.457639 15925 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.576521 11873 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:17.578742 11866 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:17.452644 16158 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:17.456825 16051 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.462484 15964 consensus_queue.cc:1243] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:17.433848 16088 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.456838 15935 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.621917 12020 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:17.622386 12020 pending_rounds.cc:85] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:17.622663 12020 pending_rounds.cc:107] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:17.622932 12020 raft_consensus.cc:2889] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.622959 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.623679 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2503) took 1654 ms. Trace:
I20260709 12:11:17.624643 11870 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:17.624044 12020 rpcz_store.cc:276] 0709 12:11:15.969850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.926100 (+956250us) service_pool.cc:224] Handling call
0709 12:11:17.621297 (+695197us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800120098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:11:17.621519 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.623417 (+  1898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.623622 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4209408}
I20260709 12:11:17.630254 11864 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.635833 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:17.595574 11868 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:17.636574 11939 raft_consensus.cc:606] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:17.470293 16114 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.447959 16138 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 12:11:17.512586 16021 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10.
I20260709 12:11:17.573066 16085 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:17.631628 16154 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:11:17.612531 16051 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.512094 16050 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:17.650444 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 200949us
W20260709 12:11:17.651391 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 280251us
I20260709 12:11:17.629882 15935 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.657164 12016 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:17.657711 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.657860 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.662261 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:17.648470 16114 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.663532 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:17.657940 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 208713us
I20260709 12:11:17.672905 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.598680 15845 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.653049 16158 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.700248 16103 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.700788 16103 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.701227 16103 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.706193 16156 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:11:17.707378 16159 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:17.712291 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:17.742877 15911 consensus_queue.cc:1243] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:17.698930 16158 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.744665 16158 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.749760 11869 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:17.688160 15925 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:17.755075 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.709810 16155 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.708988 16075 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.759646 11867 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:17.761924 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.766211 11871 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:17.769836 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.769963 16026 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.770809 11864 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:17.462132 16150 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.771437 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 810) took 1619 ms. Trace:
I20260709 12:11:17.771950 12019 rpcz_store.cc:276] 0709 12:11:16.151857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.058315 (+906458us) service_pool.cc:224] Handling call
0709 12:11:17.070103 (+ 11788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.070305 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:17.102498 (+ 32193us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.770794 (+668296us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18003d47a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d323a
0709 12:11:17.771009 (+   215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.771085 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:17.771152 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.771236 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.771372 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34306,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":4811136,"thread_start_us":6072,"threads_started":1,"wal-append.queue_time_us":35632}
I20260709 12:11:17.777679 16084 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:17.785925 16106 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.794222 16023 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:17.794741 16023 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:17.795629 16023 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.796908 16023 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.756814 16157 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.799486 16157 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:17.800460 16157 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.801645 16069 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.801574 16075 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.802281 16069 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:17.803181 15845 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.758041 16155 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.803931 16075 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.804052 16155 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.803462 16069 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.805238 16069 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.791647 16088 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.781206 16114 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.786967 16105 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:17.809142 11870 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:17.810537 15978 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.002s
I20260709 12:11:17.759764 15925 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:17.844843 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.846061 11870 raft_consensus.cc:2368] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:17.846529 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.849836 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.850724 11868 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:17.854719 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.777137 15903 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.859184 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.865528 11868 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:17.825716 16168 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:17.867036 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:17.837388 15906 consensus_meta.cc:287] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.002s
I20260709 12:11:17.867821 11868 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:11:17.868464 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 204968us
I20260709 12:11:17.827884 16105 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:17.873973 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:17.877727 16140 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:11:17.878432 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.879278 11864 raft_consensus.cc:2368] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:17.879688 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 801) took 2109 ms. Trace:
I20260709 12:11:17.880498 16067 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.881245 16050 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.882405 15903 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.884598 11939 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:17.885015 11939 raft_consensus.cc:614] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:17.880085 12014 rpcz_store.cc:276] 0709 12:11:15.770513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.776535 (+  6022us) service_pool.cc:224] Handling call
0709 12:11:15.795126 (+ 18591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.118331 (+323205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.118367 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.873523 (+755156us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:11:16.873933 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.976492 (+102559us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:16.984917 (+  8425us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.985159 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.985409 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.083366 (+ 97957us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b180034d800. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:17.793117 (+709751us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b180034d800. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:17.879493 (+ 86376us) raft_consensus.cc:1685] finished
0709 12:11:17.879519 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.879630 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11131,"prepare.queue_time_us":9303,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":148494,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":9190,"spinlock_wait_cycles":68907904,"thread_start_us":387086,"threads_started":2,"wal-append.queue_time_us":101605}
I20260709 12:11:17.889271 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:17.893486 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 246302us
I20260709 12:11:17.870626 15989 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:17.898502 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:17.900002 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:17.896370 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.903564 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:17.904234 11945 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12.
I20260709 12:11:17.907265 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.908051 11943 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.908054 11945 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:17.911234 11988 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12.
I20260709 12:11:17.911636 11988 leader_election.cc:403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.912106 15978 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:17.913115 15978 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.913772 16021 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.914227 16021 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:17.915221 16021 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.916733 16021 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.919502 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:17.925050 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.918334 16171 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:17.927301 16171 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.928067 16150 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.873900 16168 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.929874 15925 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:17.932821 16168 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:17.934039 11864 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.935689 16051 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.936808 12021 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:17.940197 11870 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:17.941191 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.890703 15903 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.942209 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:17.946803 11947 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:17.956918 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.956899 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:17.961833 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.962549 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.962831 11871 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.963358 11866 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.966382 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.967209 11872 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.874131 15906 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:17.975869 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:17.977236 12018 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:17.970561 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:17.981714 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:17.984252 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:17.895287 16162 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:11:17.921473 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:17.991783 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.005784 11870 raft_consensus.cc:2368] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:17.895550 16158 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.000468 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.001794 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.008826 11864 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:17.996632 11872 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:17.976903 16149 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:18.040304 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:18.044116 11939 raft_consensus.cc:606] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:18.044705 11939 raft_consensus.cc:614] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:18.003755 16129 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 12:11:18.010704 11872 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:18.009294 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.052306 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.052898 11872 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:18.053697 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.054338 11872 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:18.054983 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.058645 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.060513 12018 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.055859 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.048115 11871 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:18.010499 11866 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
W20260709 12:11:18.062784 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53562.7us
I20260709 12:11:18.063082 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.035553 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.065819 16016 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.980949 16168 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:11:18.062685 15978 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12.
I20260709 12:11:17.976439 15903 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.065230 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.012845 12605 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.970266 16177 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:11:18.069949 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:18.070143 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.074399 16166 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:18.075696 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.075631 16166 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.074988 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.076341 16166 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.041293 15950 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.068497 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:18.073870 11948 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:18.078044 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.033743 16138 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.098714 16138 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.099166 16138 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.099768 16155 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:18.102169 16172 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:18.077397 15992 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.102758 11864 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:18.103114 15992 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.103619 15992 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.983697 16105 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.105195 11946 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.105032 16019 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:18.105556 11946 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.106405 11946 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.107350 11946 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.098742 16051 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.068498 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.111039 11872 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:18.112509 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.011534 16025 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:18.089704 12019 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:18.092006 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.058627 16149 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.089373 16162 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:11:18.096097 16175 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:18.058815 16129 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.097568 16069 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:18.067622 16103 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.087178 16169 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.123615 11870 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.115306 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.088201 15950 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.109889 15911 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.137482 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.123819 16050 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.115823 15978 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.142266 16050 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.142339 15978 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:18.142915 16158 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.143503 15978 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.144780 15978 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.141741 16187 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.142927 11864 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.145674 16187 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.146083 16187 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.150098 16155 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.150430 16129 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.151180 12022 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:18.152616 16149 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.153724 16187 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.155823 16187 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.130151 12018 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:18.115809 15935 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.157143 12013 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.158396 15935 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.158823 16103 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.159318 16075 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.139003 16171 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.129792 16162 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:18.163419 11946 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:18.164047 16145 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:18.164628 12013 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:18.140115 15911 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.165616 15911 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.165743 16114 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.168865 15906 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.120568 15962 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.172502 15903 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.177686 16171 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.178758 12021 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.178378 16171 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:11:18.172549 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.185251 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.185977 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:18.186529 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45200.6us
I20260709 12:11:18.189482 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:18.190778 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.189915 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:18.189859 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.190124 11947 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
W20260709 12:11:18.191424 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.196450 11988 leader_election.cc:400] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:18.196942 11988 leader_election.cc:403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.187647 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.188953 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.198632 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.205034 11939 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:18.142859 16050 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.215063 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.208290 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.216914 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.215590 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.220736 12021 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:18.220875 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.221781 11944 raft_consensus.cc:2368] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
W20260709 12:11:18.219966 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 87099.3us
I20260709 12:11:18.197418 15935 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.221876 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.223067 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:18.225371 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.227319 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.214182 15962 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.228655 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.233290 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.232345 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:18.233032 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.233657 11988 leader_election.cc:400] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.173002 15950 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.214411 16103 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.237644 11988 leader_election.cc:403] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.215664 12605 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:18.239516 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.240518 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.197379 16129 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:18.242544 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.226438 16010 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.223248 15906 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.234432 16075 raft_consensus.cc:2764] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:18.244037 16046 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.261871 16046 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:18.244657 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.222767 16171 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.226886 16114 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.244477 12611 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.238392 15962 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.250370 16080 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.243747 16051 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.253451 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:18.267867 11942 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:18.253866 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:18.243526 16026 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.257750 15906 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:18.245285 16010 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.237689 16150 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.261237 16105 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.248098 15950 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.237151 16158 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:18.279958 16161 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:11:18.267747 15962 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.264628 16114 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.280875 16114 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.239197 15845 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.267364 12609 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:18.269670 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:18.270303 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:18.283591 15845 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.284096 15845 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.273874 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:18.284607 16166 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:17.367372 12015 rpcz_store.cc:276] 0709 12:11:16.058416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.003932 (+945516us) service_pool.cc:224] Handling call
0709 12:11:17.004461 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.004673 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:17.005164 (+   491us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.366287 (+361123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.366362 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:17.366432 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.366538 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.366665 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":83,"thread_start_us":360741,"threads_started":1}
I20260709 12:11:18.286815 16166 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.278236 16026 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.288142 16026 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.281562 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:18.263068 16169 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:18.292883 16169 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.293284 16169 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.234661 15935 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.262363 16046 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.278578 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:18.247151 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.275153 16010 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.277305 16023 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:18.286816 12015 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:18.303763 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56658.9us
I20260709 12:11:18.309456 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 811) took 2083 ms. Trace:
I20260709 12:11:18.310065 12017 rpcz_store.cc:276] 0709 12:11:16.226812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.080799 (+853987us) service_pool.cc:224] Handling call
0709 12:11:17.081158 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.550704 (+469546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.309166 (+758462us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54001d24d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:18.309382 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995051264}
I20260709 12:11:18.272500 16080 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.315618 11872 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:18.319528 11867 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:18.315703 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.271451 15992 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.323009 12017 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:18.328467 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:18.323850 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.326162 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.330042 12017 raft_consensus.cc:2393] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:18.330060 11867 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.331591 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.334108 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:18.342285 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.307531 16149 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.343104 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.345448 11870 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:18.352083 11870 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.310175 16011 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.349987 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.364341 11864 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:18.365301 16189 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:18.348371 16187 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.366887 16187 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.367254 16187 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.333618 15900 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:18.333966 16022 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:11:18.350471 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.375501 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.377420 11945 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.369459 16169 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.384006 16169 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.383652 15845 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.340154 16068 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.307865 16138 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.397943 16068 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.398990 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.372913 16022 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.400476 16022 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:18.401559 16022 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.380064 16149 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.404565 16149 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.310636 15911 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.403110 16022 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.406976 12021 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.410550 11871 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:18.398993 12018 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:18.412613 12018 pending_rounds.cc:85] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:18.412922 12018 pending_rounds.cc:107] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:18.413213 12018 raft_consensus.cc:2889] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:18.379853 16182 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.393s	user 0.002s	sys 0.000s
I20260709 12:11:18.372022 15900 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:18.310091 16023 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.425104 16166 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.375465 16011 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:18.409633 15903 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.371018 15935 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.406878 16080 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.433115 15900 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:18.427974 11867 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:18.397413 16050 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.444080 16011 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.445676 15903 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:18.453482 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 72056us
W20260709 12:11:18.452571 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 212129us
I20260709 12:11:18.459751 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.373623 15906 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.442260 16166 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.466593 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.474053 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:18.487634 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.465732 15903 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.474872 16169 raft_consensus.cc:2764] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:18.496291 16202 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.498275 16078 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:18.500675 16163 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:18.481470 16155 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:18.506309 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.489018 16080 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.513370 11988 leader_election.cc:400] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 7. Current term is 8.
I20260709 12:11:18.517334 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:18.520210 12014 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:18.521297 11988 leader_election.cc:400] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:18.522488 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:18.522490 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.492287 15992 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.526501 16105 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.480352 16150 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:18.537811 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.531390 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.543740 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:18.544696 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 43936.6us
I20260709 12:11:18.545344 16207 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.589795 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.528321 15935 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.480183 15900 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.524546 16137 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.518081 16080 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.625089 16080 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.592083 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.539927 16103 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:18.515507 15980 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:18.593792 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.535358 16155 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.595181 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:18.595831 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.596487 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.541658 15845 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.537406 16129 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.618342 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.546872 16169 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.617589 11946 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:18.596529 16207 raft_consensus.cc:2764] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:18.624329 16050 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.631815 11871 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.638018 11870 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:18.658844 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.646241 11943 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:18.547421 16114 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.675401 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.685768 12018 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:18.677627 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.687052 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.657292 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.666442 16103 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.676651 15900 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:18.677202 16206 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:11:18.674240 16080 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:18.677603 16197 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:11:18.654469 15962 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.666676 16129 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.678886 11866 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.679687 16114 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:18.679883 16208 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:11:18.680497 16155 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.639884 16137 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.650130 16167 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.690029 12017 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:18.690207 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.730399 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.689707 16023 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:18.712972 16199 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:18.672549 16169 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.708691 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.655833 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:18.726709 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 183038us
W20260709 12:11:18.740196 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70347.9us
I20260709 12:11:18.743785 11868 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:18.744649 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.716190 16080 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.720373 16166 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.749233 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.747545 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.753158 12013 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.754949 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.696231 16103 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.691725 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.713004 16046 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:18.749820 16200 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:18.744170 16169 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.716784 16187 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.759495 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.762728 12018 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:18.743829 16209 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.763837 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.751183 16114 raft_consensus.cc:2764] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:18.765343 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:18.756326 16166 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.767191 11872 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 12:11:18.787356 16103 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.767572 12013 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:18.768056 16209 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:18.756860 16080 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.762586 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:18.783809 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:18.785869 15962 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.754248 16010 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.791740 12018 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.768375 16212 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.794390 16209 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.797621 16046 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.806409 16129 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:18.810720 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.816887 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.818818 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.823254 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.812878 16080 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.826818 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.828420 11867 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:18.830524 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.832252 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.833046 11867 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:18.834487 16187 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.835253 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.836063 11867 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.836953 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.837760 11867 raft_consensus.cc:2368] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.840240 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.841601 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.841780 16010 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.821727 16046 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.842996 11867 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:18.844583 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.846467 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.848127 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.850417 11868 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.849707 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.851729 11868 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.852703 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.857368 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.859735 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.862924 16137 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.821604 15962 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.863761 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.863821 15962 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.864691 11944 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:18.866403 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:18.866561 16180 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.760s	user 0.004s	sys 0.000s
I20260709 12:11:18.869005 12607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 478) took 1529 ms. Trace:
I20260709 12:11:18.869743 11865 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:18.870080 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:18.863632 16205 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 12:11:18.868479 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:18.866421 15962 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.812500 15903 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.869901 12607 rpcz_store.cc:276] 0709 12:11:17.339567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.339750 (+   183us) service_pool.cc:224] Handling call
0709 12:11:17.353882 (+ 14132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.557131 (+203249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.868753 (+1311622us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54005c80d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:18.868942 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465698176}
I20260709 12:11:18.870848 12018 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.877717 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.879055 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:18.871311 16214 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:11:18.875341 16212 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:18.885190 16212 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.885979 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2515) took 1576 ms. Trace:
I20260709 12:11:18.875352 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:18.887420 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.886682 11988 leader_election.cc:400] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:18.819592 16014 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:11:18.888972 11944 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:18.886425 12020 rpcz_store.cc:276] 0709 12:11:17.309170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.628076 (+318906us) service_pool.cc:224] Handling call
0709 12:11:17.640446 (+ 12370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.843173 (+202727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.843224 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.843721 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.983258 (+139537us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:17.983293 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.983359 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.865802 (+882443us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:18.885620 (+ 19818us) raft_consensus.cc:1685] finished
0709 12:11:18.885647 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.885910 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59106,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":97,"spinlock_wait_cycles":10835328,"thread_start_us":341294,"threads_started":2,"wal-append.queue_time_us":224266}
I20260709 12:11:18.889418 11988 leader_election.cc:400] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
W20260709 12:11:18.872964 15950 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.007s
I20260709 12:11:18.892576 11988 leader_election.cc:403] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.898309 11988 leader_election.cc:400] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:18.898873 12018 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:18.899049 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.900254 11939 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:18.893177 15875 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:18.901682 16103 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.901170 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.901700 16105 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:18.893383 16056 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.903992 15941 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.904492 15941 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:18.904569 12022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2509) took 1598 ms (client timeout 1684 ms). Trace:
W20260709 12:11:18.905051 12022 rpcz_store.cc:269] 0709 12:11:17.305795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.310002 (+  4207us) service_pool.cc:224] Handling call
0709 12:11:18.904375 (+1594373us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54000776d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:18.904508 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903688576}
I20260709 12:11:18.905416 15941 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.876039 16080 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:18.870767 16011 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:18.891124 16129 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.924762 11944 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.902359 15980 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.931159 16212 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:18.934082 15941 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.893240 16023 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:18.939304 11864 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.946870 15903 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:18.948558 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.950023 12018 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.953593 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.913601 15935 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.955675 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.958715 11871 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:18.958586 11864 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:18.967264 11986 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:18.960449 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.967559 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:18.967278 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.962019 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.969900 11946 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.970274 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:18.971791 12013 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:18.972203 12013 pending_rounds.cc:85] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:11:18.968508 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.973109 16023 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.974750 12016 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 12:11:18.974797 16023 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.976240 16023 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.977726 15962 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.978191 15962 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.978557 15962 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.983580 16080 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:18.984565 11869 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:18.986112 11868 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.907111 16103 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.987419 16103 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.988122 11869 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:18.968978 16016 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:18.989439 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 782) took 1531 ms. Trace:
I20260709 12:11:18.969110 16212 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:18.973407 16145 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:18.973806 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:18.972474 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:18.972471 12013 pending_rounds.cc:107] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:18.999047 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:18.999502 12013 raft_consensus.cc:2889] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.999758 11867 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:18.989877 11940 rpcz_store.cc:276] 0709 12:11:17.458367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.458958 (+   591us) service_pool.cc:224] Handling call
0709 12:11:17.558370 (+ 99412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.886151 (+327781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.886184 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.891377 (+  5193us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.077899 (+186522us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:18.077958 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.989018 (+911060us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540010e0d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:18.989065 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.989113 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:18.989127 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.989351 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11903,"raft.queue_time_us":5001,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5921,"spinlock_wait_cycles":752825600,"thread_start_us":148212,"threads_started":1,"wal-append.queue_time_us":248356}
I20260709 12:11:18.994428 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:18.998942 11871 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.007732 11945 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.012744 12013 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.005731 16212 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.014436 16210 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:19.048831 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 147703us
I20260709 12:11:19.049779 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:19.053759 11871 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:19.055287 11945 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:19.063409 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 55759.8us
I20260709 12:11:19.064687 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:19.076589 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:19.015499 16210 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.082237 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:19.011663 16105 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.005932 16016 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.005615 16222 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.056075 16193 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.062667 15980 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:19.098868 15950 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:19.093880 15989 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:19.096275 16016 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.047920 16046 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:19.057216 15869 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:19.114336 15980 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.077744 16023 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.074687 16011 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.103879 16193 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.087235 16210 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.137668 11988 leader_election.cc:400] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:19.093983 16145 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:11:19.062938 16078 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:19.086998 16215 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:19.100385 16010 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.125370 15941 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.126169 16212 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.099478 16217 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.126958 16150 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.016352 15935 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:11:19.095074 16137 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:19.138049 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:19.118876 16016 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.142423 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:19.129335 16105 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.125419 16103 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:19.167258 16105 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.167511 16193 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.169001 16103 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.131563 15980 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.126803 16221 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:19.148308 16023 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.153491 16217 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:19.221899 16220 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.317s	user 0.005s	sys 0.000s
I20260709 12:11:19.169415 16193 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.169373 16105 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:19.215106 16198 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.863s	user 0.004s	sys 0.006s
I20260709 12:11:19.153496 16010 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.222568 16016 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.224900 16217 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.191429 16210 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.244179 16222 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:19.244653 16222 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:19.245419 16222 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.247675 16222 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.250413 16169 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:19.251346 16219 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.327s	user 0.003s	sys 0.000s
I20260709 12:11:19.242610 16210 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.255957 16213 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.253798 16167 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:19.256408 16213 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:19.256615 16167 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.257344 16213 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.258754 16213 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.265919 16217 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.305253 11870 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.132314 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:19.331799 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2534) took 1023 ms. Trace:
W20260709 12:11:19.338363 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.339625 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 207269us
I20260709 12:11:19.332563 12019 rpcz_store.cc:276] 0709 12:11:18.307721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.317234 (+  9513us) service_pool.cc:224] Handling call
0709 12:11:18.317505 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.317866 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.317902 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.318337 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.351699 (+ 33362us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.351739 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.351807 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.208844 (+857037us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:19.330755 (+121911us) raft_consensus.cc:1685] finished
0709 12:11:19.330808 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.331447 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6988,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11626,"spinlock_wait_cycles":26443648,"thread_start_us":33049,"threads_started":1,"wal-append.queue_time_us":33478}
W20260709 12:11:19.347522 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 270820us
I20260709 12:11:19.348238 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:19.317186 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2436) took 1003 ms. Trace:
I20260709 12:11:19.349912 11866 rpcz_store.cc:276] 0709 12:11:18.313834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.314378 (+   544us) service_pool.cc:224] Handling call
0709 12:11:18.314696 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.725842 (+411146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.316293 (+590451us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002d9454. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:19.316854 (+   561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837038976}
W20260709 12:11:19.354681 11942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43956 (request call id 788) took 1795 ms (client timeout 1822 ms). Trace:
W20260709 12:11:19.355358 11942 rpcz_store.cc:269] 0709 12:11:17.558748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.558905 (+   157us) service_pool.cc:224] Handling call
0709 12:11:19.354196 (+1795291us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540038fed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:19.354422 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524955904}
I20260709 12:11:19.357282 15845 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.358821 15845 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.179121 15962 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.382131 16157 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.386163 16175 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.387848 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2540) took 1065 ms. Trace:
I20260709 12:11:19.388262 16014 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.388355 12017 rpcz_store.cc:276] 0709 12:11:18.322513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.341556 (+ 19043us) service_pool.cc:224] Handling call
0709 12:11:19.387244 (+1045688us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400046fd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:19.387533 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626401664}
I20260709 12:11:19.390897 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 1987) took 1482 ms. Trace:
I20260709 12:11:19.390182 16014 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.394533 16010 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.215731 16023 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.362385 15980 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.403901 15845 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.412228 15962 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.413331 16221 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.422765 11948 rpcz_store.cc:276] 0709 12:11:17.908636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.908862 (+   226us) service_pool.cc:224] Handling call
0709 12:11:17.909098 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.088393 (+179295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.390193 (+1301800us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003d4854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:19.390643 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377754368}
I20260709 12:11:19.380642 16151 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:19.438473 16103 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:19.446210 15925 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:19.454442 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:19.455391 11866 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:19.455767 16129 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.456275 16129 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:19.454270 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:19.457170 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:19.458603 12021 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:19.461249 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 113345us
I20260709 12:11:19.464015 16023 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.472327 15925 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.440737 16217 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.479453 16221 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.480602 16014 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.488620 16138 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.493191 16169 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.476717 15925 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.499825 16016 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.502957 15941 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:19.526317 16011 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.507696 16068 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.526989 16011 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:19.510726 16056 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:19.514328 16022 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:19.517340 15900 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:19.518879 16023 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.508948 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:19.533839 16011 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.540354 16011 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.552058 16023 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:19.524521 16222 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.553874 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:19.563328 15911 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.563807 16157 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.566413 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:19.568426 16169 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:19.569592 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:19.569928 16016 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.571442 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:19.571363 16222 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.574002 16016 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:19.574795 16129 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.576598 16129 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.578663 16221 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:19.582553 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 74033.8us
I20260709 12:11:19.581493 11769 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 12 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.585445 16023 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.607645 16210 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:19.608379 11939 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.609835 16209 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.610345 16209 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.611105 16222 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.612011 16209 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.615376 16138 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.560807 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:19.619660 16163 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.620249 16163 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.622995 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:19.624025 16163 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.626039 16163 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.630504 16239 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.631115 16239 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:19.632332 11769 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:19.590469 16151 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:19.592234 16068 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:19.593112 15989 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.595418 16217 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.596452 16026 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.634613 16209 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.635612 15925 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.632385 16239 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.579995 16157 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.587680 16167 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.644501 16210 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.677785 16210 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.646405 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:19.678320 16241 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:19.678999 16241 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:19.678547 16157 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.680183 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:19.651566 16242 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:19.681767 16016 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.682356 16016 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.682793 16016 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.683056 15950 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.683884 15950 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.673704 16151 consensus_queue.cc:1243] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:19.678386 16210 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.670249 16222 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:19.670815 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 127493us
I20260709 12:11:19.701730 16222 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.703544 16239 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.703018 16026 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:19.705653 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.704625 16222 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.707396 16080 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:19.709076 11768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 225) took 13119 ms (client timeout 15000 ms). Trace:
I20260709 12:11:19.712395 15950 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.683920 16167 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.694172 16217 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.725608 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:19.721827 16222 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.716324 16026 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.718745 16138 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:19.727711 16138 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.728272 16217 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.727963 16222 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.730178 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:19.718739 16228 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.729199 16138 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.731068 11943 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:19.732172 16138 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.698959 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:19.739969 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 89986.5us
I20260709 12:11:19.741973 16151 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:19.742594 16151 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.710073 11769 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 4 to -1, term changed from 5 to 7, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) evicted, now has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 7 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:11:19.753636 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56646.7us
I20260709 12:11:19.753688 16217 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:19.760430 16217 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.761103 16217 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:19.730960 16228 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:19.741982 16222 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:19.680500 16241 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.777985 16217 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.778374 11769 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:19.779825 16217 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.779887 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:19.784802 15869 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:19.785416 15869 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:19.801420 16252 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:19.802380 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:19.813153 15869 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.817790 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 1899) took 1938 ms. Trace:
I20260709 12:11:19.823154 12605 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.824254 12014 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.814828 16241 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.833626 16222 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:19.833890 16228 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.836023 11769 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:11:19.709683 11768 rpcz_store.cc:269] 0709 12:11:06.574006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.574622 (+   616us) service_pool.cc:224] Handling call
0709 12:11:19.691498 (+13116876us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:11.918654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:11.919596 (+   942us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:11.919668 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:11:11.919698 (+    30us) tablet.cc:662] Decoding operations
0709 12:11:12.067223 (+147525us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:12.067357 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:12.067391 (+    34us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:11:12.073021 (+  5630us) tablet.cc:701] Row locks acquired
0709 12:11:12.073073 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:11:12.073365 (+   292us) write_op.cc:270] Start()
0709 12:11:12.073561 (+   196us) write_op.cc:276] Timestamp: P: 1783599072073280 usec, L: 0
0709 12:11:12.073582 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:12.086019 (+ 12437us) log.cc:844] Serialized 9510 byte log entry
0709 12:11:12.509777 (+423758us) op_driver.cc:464] REPLICATION: finished
0709 12:11:13.139714 (+629937us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18003ed700. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:13.139945 (+   231us) write_op.cc:301] APPLY: starting
0709 12:11:13.140067 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:13.140790 (+   723us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:13.140825 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:13.242350 (+101525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:13.242711 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:11:13.242760 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:13.243239 (+   479us) log.cc:844] Serialized 164 byte log entry
0709 12:11:13.243426 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:13.243636 (+   210us) write_op.cc:454] Released schema lock
0709 12:11:13.243702 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:13.244129 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:13.244158 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":274468,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":90256,"apply.run_cpu_time_us":6293,"apply.run_wall_time_us":104169,"num_ops":24,"prepare.queue_time_us":89885,"prepare.run_cpu_time_us":143219,"prepare.run_wall_time_us":342321,"raft.queue_time_us":153053,"raft.run_cpu_time_us":8637,"raft.run_wall_time_us":87427,"replication_time_us":436006,"spinlock_wait_cycles":7664896,"thread_start_us":371521,"threads_started":4,"wal-append.queue_time_us":240822,"wal-append.run_cpu_time_us":12329,"wal-append.run_wall_time_us":1928474}]]}
I20260709 12:11:19.845500 12607 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:19.791304 16151 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:19.851630 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.854174 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.854848 16222 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.845116 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:19.860303 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92498.3us
I20260709 12:11:19.822429 11873 rpcz_store.cc:276] 0709 12:11:17.758117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.758250 (+   133us) service_pool.cc:224] Handling call
0709 12:11:17.798002 (+ 39752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.825056 (+ 27054us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:19.306556 (+1481500us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b1800447d60. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf
0709 12:11:19.307019 (+   463us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.470312 (+163293us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.483472 (+ 13160us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.485440 (+  1968us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:19.657874 (+172434us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.661405 (+  3531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.661602 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.686544 (+ 24942us) raft_consensus.cc:1685] finished
0709 12:11:19.686581 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.696292 (+  9711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33986,"prepare.queue_time_us":400366,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":4634,"raft.queue_time_us":44513,"raft.run_cpu_time_us":603,"raft.run_wall_time_us":6296,"spinlock_wait_cycles":12234624,"thread_start_us":254019,"threads_started":3,"wal-append.queue_time_us":169863}
I20260709 12:11:19.866701 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.868450 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.870383 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.862984 15869 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:19.872208 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.871078 15906 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.872411 16222 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:19.876255 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:19.887410 12015 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:19.833395 16016 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:19.895259 12606 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:19.908517 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:19.904385 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:19.901806 16228 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.919261 16167 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.925113 12021 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:19.944660 12015 raft_consensus.cc:1240] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.904043 15906 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:19.955519 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.956327 12021 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:19.956482 16157 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.955701 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.957217 16157 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:19.959765 16157 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:19.962093 16157 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.973129 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77240.4us
I20260709 12:11:19.974222 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.985616 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:19.986717 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.965186 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:19.992635 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:19.993706 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.994489 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:19.995841 11837 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:19.996491 16167 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:19.998142 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:19.998327 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:20.002041 16016 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:20.013871 11943 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:20.013764 12610 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:20.015523 11837 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:20.018533 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:20.014793 16016 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.025292 12602 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:19.962719 16157 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.033183 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:20.033825 16080 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.034466 12017 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:20.042078 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:20.051477 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.052026 15906 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:20.051501 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:20.062808 16255 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:20.062602 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.066738 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:20.070550 12611 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 11 LEARNER]: Advancing to term 13
I20260709 12:11:20.047724 16080 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:20.082916 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:20.076098 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:20.080140 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.089210 12606 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:20.096297 12014 raft_consensus.cc:2410] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:20.094962 16056 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.103631 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:20.102427 16056 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.094235 16151 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.095067 16210 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:20.118654 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.124104 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.108817 16056 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:20.134531 12015 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:20.137995 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:20.147397 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.138801 12014 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:20.154727 12611 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.119514 16151 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:20.175994 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 166310us
I20260709 12:11:20.176846 11912 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:20.183149 11868 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.186525 11867 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.186431 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:20.188974 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:20.189730 11869 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.190886 16056 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.191536 16056 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.193930 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.195705 11942 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:20.187908 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:20.196908 11867 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:20.198359 16167 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.198992 16167 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:20.198802 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:20.200225 16167 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.200625 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:20.205444 12014 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:20.206066 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:20.187763 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:20.205504 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:20.207031 12017 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:20.206336 16169 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:20.207615 16169 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:20.209178 16169 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.211390 16169 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.214323 16157 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:20.215276 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:20.219769 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.227669 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58179.7us
I20260709 12:11:20.229148 12015 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:20.235059 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 58322.6us
I20260709 12:11:20.236109 11867 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:20.238821 15911 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:20.170634 16151 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.292270 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:20.284484 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:20.308408 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56353.6us
I20260709 12:11:20.161623 16016 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:20.162715 16080 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.334365 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:20.316797 16249 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.445s	user 0.003s	sys 0.003s
I20260709 12:11:20.316339 15911 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:20.372553 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:20.404531 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 189442us
I20260709 12:11:20.323851 16138 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:11:20.364888 16263 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.379283 15906 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.424125 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:20.371342 16056 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:20.372233 16222 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:20.423863 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.436600 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:20.444417 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 81746.9us
I20260709 12:11:20.448738 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.448868 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.442873 15906 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.454759 15906 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:20.455432 15906 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:20.456009 16157 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:20.458331 16157 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:20.459316 16080 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:20.459880 16157 consensus_queue.cc:1059] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:20.461841 16217 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.008s
I20260709 12:11:20.462200 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.463202 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.464020 11946 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:20.465565 16016 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:20.466481 16241 consensus_meta.cc:287] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.007s
I20260709 12:11:20.467271 12019 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
W20260709 12:11:20.462520 16265 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:11:20.470359 15911 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.450402 16222 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.433305 16263 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.477671 16210 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:20.462556 16217 raft_consensus.cc:3055] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.478845 16217 raft_consensus.cc:740] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:20.478992 16263 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:20.480594 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.480000 16217 consensus_queue.cc:260] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:20.482729 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.486331 11943 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:20.486999 16246 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.488747 12607 raft_consensus.cc:2410] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:20.492784 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.473281 16222 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:20.505792 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:20.487680 16246 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:20.507238 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 215014us
I20260709 12:11:20.505121 12605 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:20.508935 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:20.531482 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:20.536392 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:20.515007 16257 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 12:11:20.536226 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:20.515889 16259 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.318s	user 0.004s	sys 0.000s
W20260709 12:11:20.553880 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.546278 16217 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.564054 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:20.564921 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:20.567572 16263 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.568249 16263 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:20.531250 16210 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.456037 15906 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.572930 12602 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:20.496277 16209 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:20.515525 16138 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:20.508252 16157 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:20.596829 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:20.604238 11869 pending_rounds.cc:85] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 4
I20260709 12:11:20.569375 16263 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.574585 16267 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.603937 16157 consensus_queue.cc:1243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:20.617230 11869 pending_rounds.cc:107] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:20.630872 11869 raft_consensus.cc:2889] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.618791 16239 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.619808 16080 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.599340 16138 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.588348 16210 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.640669 16239 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.684128 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:20.637126 16222 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:20.690846 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 131516us
I20260709 12:11:20.694939 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:20.655153 16284 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.682734 16269 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:20.708541 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:20.687289 16239 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:20.731542 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.719846 16281 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 12:11:20.727838 11866 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:20.709873 16284 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:20.745042 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:20.721845 16282 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.707589 16268 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.739292 16246 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:20.792433 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 97695.5us
W20260709 12:11:20.754395 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.770685 16209 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:20.735415 15989 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:20.738653 16276 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.759130 16284 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.723510 16222 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.771376 16167 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:20.726933 16269 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.792277 16280 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:20.752729 16151 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.800153 15989 consensus_queue.cc:1243] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:11:20.812398 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 67467.3us
I20260709 12:11:20.804908 15906 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:20.812727 16270 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:11:20.807541 16291 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:20.886108 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71664.3us
I20260709 12:11:20.917973 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:20.819221 16138 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:20.802147 15911 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:11:20.813405 16209 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.930816 16294 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:20.931221 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.931782 16285 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:11:20.931730 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:20.929103 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:20.933205 16264 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.693s	user 0.005s	sys 0.020s
I20260709 12:11:20.810218 16276 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.883550 15906 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.809705 16167 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:20.939358 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:20.940186 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.015513 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.922539 16210 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:20.925362 16262 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.818993 16280 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.819940 16282 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:20.925518 16290 raft_consensus.cc:2764] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:21.039654 11866 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:21.041507 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:20.988333 16295 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:11:20.988481 16293 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:11:21.043421 12014 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:20.989338 16299 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.987533 16301 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.884704 16289 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.263s
W20260709 12:11:21.098767 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57360.4us
I20260709 12:11:21.100960 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:20.930531 16138 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.034242 16222 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:21.076799 16287 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
I20260709 12:11:21.092590 12017 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:11:20.936723 16291 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.077689 15989 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:21.112010 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 923) took 1115 ms. Trace:
I20260709 12:11:21.114710 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.118701 16304 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:21.118808 16305 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:11:21.119451 16309 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:11:21.119582 16304 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:21.120606 16286 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260709 12:11:21.121111 16284 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.121742 16296 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:11:21.122450 16279 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.123483 16279 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.123723 16284 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.124663 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.130611 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.131294 11871 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:21.097527 16302 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.114054 12603 rpcz_store.cc:276] 0709 12:11:19.992810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.994072 (+  1262us) service_pool.cc:224] Handling call
0709 12:11:19.994690 (+   618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.995353 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.995382 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.996768 (+  1386us) log.cc:844] Serialized 564 byte log entry
0709 12:11:20.115955 (+119187us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.116022 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.116198 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.883112 (+766914us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:21.097123 (+214011us) raft_consensus.cc:1685] finished
0709 12:11:21.097152 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.108041 (+ 10889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154260224,"thread_start_us":118633,"threads_started":1,"wal-append.queue_time_us":225977}
I20260709 12:11:21.126127 16246 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.120054 16305 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.128178 16245 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.110227 16299 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.129074 16291 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.112574 16301 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.137632 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.127434 16269 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.124217 16279 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.121832 16275 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:11:21.202968 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2475) took 1021 ms. Trace:
W20260709 12:11:21.182610 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.107666 16138 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.197017 12020 pending_rounds.cc:85] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 7
I20260709 12:11:21.214018 12020 pending_rounds.cc:107] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 12:11:21.199532 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 281583us
I20260709 12:11:21.214797 12020 raft_consensus.cc:2889] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.144235 16308 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 12:11:21.209978 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 98886.8us
I20260709 12:11:21.118729 16292 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.212240 11871 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:21.139379 16305 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:21.150100 16217 consensus_meta.cc:287] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.004s
W20260709 12:11:21.194278 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 204661us
I20260709 12:11:21.192291 16267 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.226336 16307 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:21.203560 11868 rpcz_store.cc:276] 0709 12:11:20.181470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.204712 (+ 23242us) service_pool.cc:224] Handling call
0709 12:11:20.205692 (+   980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.206016 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:20.236708 (+ 30692us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.195568 (+958860us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.202539 (+  6971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.202605 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.202670 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.202741 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.202883 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198153,"prepare.queue_time_us":138659,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":79,"raft.queue_time_us":166092,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":14661,"thread_start_us":778688,"threads_started":3,"wal-append.queue_time_us":259607}
I20260709 12:11:21.232159 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.227813 12018 raft_consensus.cc:2393] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:21.231186 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:21.110211 16262 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.246443 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.247124 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.249719 12610 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:21.245007 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:21.246340 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:21.252326 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.250613 11866 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 5.
I20260709 12:11:21.191599 16246 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.233479 16269 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.235509 16302 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.257728 11945 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.257511 16269 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.257913 16302 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.259434 16294 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.259876 16294 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:21.260046 16269 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.260332 16302 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.261279 11868 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:21.263198 11868 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:21.268244 16298 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 12:11:21.268649 15906 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.269716 16290 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.269572 15906 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.270406 16290 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.272882 16290 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.274297 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2459) took 1398 ms. Trace:
I20260709 12:11:21.275090 16301 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.275528 16209 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.276160 16252 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.276474 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.276716 16252 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:21.277712 16311 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:11:21.279201 16273 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.809s	user 0.002s	sys 0.004s
I20260709 12:11:21.281002 16313 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.281734 16313 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.284142 16151 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.260361 16294 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.285553 16314 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:21.286427 16314 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.290735 16304 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.227232 16267 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.301498 15906 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.303085 16138 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.303303 16267 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.295975 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:21.274724 11873 rpcz_store.cc:276] 0709 12:11:19.875502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.018034 (+142532us) service_pool.cc:224] Handling call
0709 12:11:20.018525 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.035668 (+ 17143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.035710 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.039333 (+  3623us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.310325 (+270992us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:20.310435 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.310556 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.274039 (+963483us) raft_consensus.cc:1685] finished
0709 12:11:21.274067 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.274226 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16615,"raft.queue_time_us":179110,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":270351,"threads_started":1,"wal-append.queue_time_us":579447}
I20260709 12:11:21.284224 16313 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.281335 12605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41000 (request call id 919) took 1353 ms. Trace:
I20260709 12:11:21.307082 11871 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:21.192085 16245 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.305871 12605 rpcz_store.cc:276] 0709 12:11:19.927897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.929011 (+  1114us) service_pool.cc:224] Handling call
0709 12:11:21.281143 (+1352132us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540040b354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:21.281253 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436939008}
I20260709 12:11:21.307071 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:21.322570 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1820) took 1351 ms. Trace:
I20260709 12:11:21.253577 16292 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:21.276535 16276 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.301079 16217 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.308027 16316 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.242563 16307 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.310140 16026 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.323374 11939 rpcz_store.cc:276] 0709 12:11:19.970955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.971455 (+   500us) service_pool.cc:224] Handling call
0709 12:11:20.014515 (+ 43060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.015113 (+   598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.015151 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.015810 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.125940 (+110130us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:20.125990 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.126066 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.289175 (+1163109us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b24002ad4d8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f18984fb0 00007f1f1b5fb488 00007f1f1b5fbbe8 00007f1f1b5d3398 00007f1f1b5ce76a 00007f1f1b5cdbb6
0709 12:11:21.311546 (+ 22371us) raft_consensus.cc:1685] finished
0709 12:11:21.311572 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.322432 (+ 10860us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":48641792,"thread_start_us":109565,"threads_started":1,"wal-append.queue_time_us":270279}
I20260709 12:11:21.306281 16252 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.333915 16292 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.348793 11839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.033s	sys 0.022s
I20260709 12:11:21.348621 16245 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.350562 16318 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.354183 16299 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.354543 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2467) took 1028 ms. Trace:
I20260709 12:11:21.382553 11865 rpcz_store.cc:276] 0709 12:11:20.178484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.179301 (+   817us) service_pool.cc:224] Handling call
0709 12:11:20.180180 (+   879us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:20.318148 (+137968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.318201 (+    53us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:20.394470 (+ 76269us) log.cc:844] Serialized 558 byte log entry
0709 12:11:20.587825 (+193355us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.587873 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.587952 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.206623 (+618671us) raft_consensus.cc:1685] finished
0709 12:11:21.206653 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.206880 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83360,"raft.queue_time_us":314457,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4975,"thread_start_us":257100,"threads_started":2,"wal-append.queue_time_us":276490}
I20260709 12:11:21.385461 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.386273 12603 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:21.332952 16151 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.355782 16246 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.356557 16279 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.342414 16217 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:21.337489 16319 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.392962 16217 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.393927 16319 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.370203 16026 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.396489 16319 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.357156 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2476) took 1048 ms. Trace:
I20260709 12:11:21.357687 16300 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.398905 16262 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.399338 16300 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.358395 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.402954 16026 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.403514 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.403906 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.404194 16300 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.398594 11867 rpcz_store.cc:276] 0709 12:11:20.308437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.319110 (+ 10673us) service_pool.cc:224] Handling call
0709 12:11:20.371844 (+ 52734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.566090 (+194246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.566132 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.566834 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.693607 (+126773us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.693656 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.264083 (+570427us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4800080058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:11:21.356787 (+ 92704us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000947d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:21.356846 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.356898 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:21.356914 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.357088 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81232,"raft.queue_time_us":135575,"raft.run_cpu_time_us":4705,"raft.run_wall_time_us":645429,"spinlock_wait_cycles":248119808,"thread_start_us":126228,"threads_started":1,"wal-append.queue_time_us":204899}
I20260709 12:11:21.364419 16294 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.407714 12022 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:21.377132 11839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.036s	sys 0.025s
I20260709 12:11:21.409730 16294 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.390108 12609 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.412575 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:21.415773 16292 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:21.386031 11988 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.538s (SENT)
I20260709 12:11:21.417644 16167 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:21.418427 16271 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.912s	user 0.007s	sys 0.003s
I20260709 12:11:21.327850 16314 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.390969 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.406311 16151 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.419698 12608 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:21.410247 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 989424us
I20260709 12:11:21.378921 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:21.409922 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:21.420552 12017 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:21.420570 12013 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.390100 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.422262 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.422613 12606 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 6.
I20260709 12:11:21.422298 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.424062 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.424957 11873 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:21.425763 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.427179 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.427590 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.427920 11869 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:21.428092 16263 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.429174 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:21.430248 16263 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:21.430840 11865 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.431618 16274 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.430904 16263 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:21.434623 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.419624 16151 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.435168 16299 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:21.435770 16299 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.437146 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.437880 12017 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:21.437709 16263 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.438865 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.438035 16314 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:21.448918 12607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 719) took 1596 ms (client timeout 1996 ms). Trace:
I20260709 12:11:21.437884 12021 pending_rounds.cc:85] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:21.452052 12021 pending_rounds.cc:107] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 12:11:21.450762 12607 rpcz_store.cc:269] 0709 12:11:19.852116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.853634 (+  1518us) service_pool.cc:224] Handling call
0709 12:11:21.448633 (+1594999us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54005c8d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:21.448830 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452649344}
I20260709 12:11:21.452498 12021 raft_consensus.cc:2889] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.456508 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:21.457957 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 84236.3us
I20260709 12:11:21.460776 12609 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:21.387898 16138 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.447973 16163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.013s	sys 0.064s
W20260709 12:11:21.459388 16239 consensus_meta.cc:287] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.006s
I20260709 12:11:21.480260 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:21.464427 16163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.014s	sys 0.064s
I20260709 12:11:21.478287 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.482230 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:21.470274 16068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.000s	sys 0.027s
I20260709 12:11:21.494565 12610 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:21.499441 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.500128 12606 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:21.498179 12022 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:21.499392 12013 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:21.455722 16314 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.513612 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:21.500398 16068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.000s	sys 0.027s
I20260709 12:11:21.478868 16239 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.480726 16138 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.527936 16303 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.541s	user 0.002s	sys 0.000s
I20260709 12:11:21.530725 16314 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.518731 16299 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.535538 12605 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:21.522122 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:21.537305 16328 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:11:21.562084 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2461) took 1386 ms. Trace:
I20260709 12:11:21.562749 11870 rpcz_store.cc:276] 0709 12:11:20.175943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.216010 (+ 40067us) service_pool.cc:224] Handling call
0709 12:11:20.238614 (+ 22604us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:20.402775 (+164161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.402944 (+   169us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:11:20.487842 (+ 84898us) log.cc:844] Serialized 104 byte log entry
0709 12:11:20.810342 (+322500us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.885368 (+ 75026us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.885613 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.885685 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.363688 (+478003us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b18002d8c20. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:21.527663 (+163975us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b2400116ca8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f1898509d 00007f1f1b5b710e 00007f1f1b5ce88c 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221
0709 12:11:21.561660 (+ 33997us) raft_consensus.cc:1685] finished
0709 12:11:21.561698 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.561988 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65706,"prepare.queue_time_us":105383,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":351257,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":264,"spinlock_wait_cycles":110345216,"thread_start_us":473602,"threads_started":2,"wal-append.queue_time_us":439708}
W20260709 12:11:21.566529 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44507.1us
W20260709 12:11:21.567026 16326 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:21.569932 16332 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.577744 15911 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:21.581790 12602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 726) took 1071 ms. Trace:
W20260709 12:11:21.553995 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 95244.7us
I20260709 12:11:21.582345 12602 rpcz_store.cc:276] 0709 12:11:20.510159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.510360 (+   201us) service_pool.cc:224] Handling call
0709 12:11:21.578575 (+1068215us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54005c80d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:21.581701 (+  3126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73235840}
I20260709 12:11:21.600533 11865 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:21.602835 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:21.603358 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.674s (SENT)
I20260709 12:11:21.603585 12019 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:21.603874 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.609226 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:21.613106 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.614640 12020 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.615134 12020 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:21.614181 11867 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:21.573179 16151 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.632104 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.633270 12013 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:21.634516 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.635669 11869 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:21.637108 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2463) took 1460 ms. Trace:
I20260709 12:11:21.637676 11872 rpcz_store.cc:276] 0709 12:11:20.176715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.176934 (+   219us) service_pool.cc:224] Handling call
0709 12:11:20.177436 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.365567 (+188131us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:20.365614 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.443384 (+ 77770us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.544843 (+1101459us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b18002c0620. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:11:21.603354 (+ 58511us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:21.603482 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.603725 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.636563 (+ 32838us) raft_consensus.cc:1685] finished
0709 12:11:21.636590 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.636899 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101067,"raft.queue_time_us":267478,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":72836864,"thread_start_us":245194,"threads_started":2,"wal-append.queue_time_us":1176765}
I20260709 12:11:21.639761 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:21.640733 11870 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.642071 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.648509 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.649519 11865 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:21.649672 16299 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:21.651937 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65448.7us
W20260709 12:11:21.652729 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.692s (SENT)
I20260709 12:11:21.654048 16080 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.654819 16239 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.616277 16332 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.655066 16080 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.656111 16332 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.656956 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.657877 16167 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.658481 16332 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.653167 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.659932 12019 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:21.627175 11839 connection.cc:256] RPC call timeout handler was delayed by -1.5633844209999097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:11:21.665167 11873 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.658677 16167 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.664687 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 166677us
I20260709 12:11:21.663694 12020 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:21.676597 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.706274 16305 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.707615 16305 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.708366 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.709103 12602 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:21.671730 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.703454 12020 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.667883 16299 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:21.685768 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:21.671227 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.671566 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.673322 16289 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.670109 16016 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.669966 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:21.677088 11839 connection.cc:256] RPC call timeout handler was delayed by -1.3597359259999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:21.702445 11941 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.710796 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:21.699193 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46522.4us
I20260709 12:11:21.685863 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:21.711779 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 190825us
I20260709 12:11:21.680940 16268 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:21.718550 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:21.672396 16278 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.214s	user 0.005s	sys 0.002s
I20260709 12:11:21.723024 16239 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.723645 16282 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.673187 16080 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.724304 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.724786 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:21.729585 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:21.673663 16266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.007s	sys 0.007s
I20260709 12:11:21.686357 16262 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 12:11:21.753084 16266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.013s	sys 0.007s
I20260709 12:11:21.750387 11868 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:21.754945 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.755262 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:21.719944 16289 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:21.756141 16217 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.756727 16289 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.756906 16217 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.758162 16289 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.759728 16217 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.760937 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.761657 11944 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:21.730160 11866 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.762149 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.733639 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.738549 11871 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.739859 12604 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:21.740038 11870 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:21.741148 16167 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.723145 16268 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:21.763062 11948 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:21.743046 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:21.743605 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.714s (SENT)
I20260709 12:11:21.771373 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.771458 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.771389 11873 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:21.772115 11946 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:21.673151 16151 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.755648 11868 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:21.730629 16016 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:21.766475 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:21.796590 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.796706 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.797500 11939 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:21.795219 11867 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.799849 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.800369 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.797678 11946 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:21.742805 16239 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.734037 16263 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.763857 11912 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:21.806270 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72750.1us
I20260709 12:11:21.806413 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:21.808115 12017 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.808540 11866 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:21.770929 16268 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:21.811555 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.813181 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:21.813212 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.815779 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.815984 11939 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:21.818308 11945 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:21.774372 16282 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.795897 16080 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.799695 16340 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.803565 16299 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:21.830653 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 109406us
W20260709 12:11:21.832930 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.845832 11988 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.762s (SENT)
I20260709 12:11:21.801041 16167 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:11:21.809363 16314 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.850217 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.807551 16239 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.840020 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.840853 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2462) took 1664 ms. Trace:
I20260709 12:11:21.833803 16340 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:21.854296 11759 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 1.420s	user 0.000s	sys 0.000s
I20260709 12:11:21.844358 16309 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.848580 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:21.813928 16263 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:21.841831 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 78120.9us
I20260709 12:11:21.822495 16282 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.848308 16299 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.852437 11864 rpcz_store.cc:276] 0709 12:11:20.176373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.183136 (+  6763us) service_pool.cc:224] Handling call
0709 12:11:20.183834 (+   698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.184388 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.184415 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.220855 (+ 36440us) log.cc:844] Serialized 564 byte log entry
0709 12:11:20.369929 (+149074us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.369975 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.370059 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.671582 (+1301523us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:21.824709 (+153127us) raft_consensus.cc:1685] finished
0709 12:11:21.824743 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.840640 (+ 15897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88932096,"thread_start_us":129674,"threads_started":1,"wal-append.queue_time_us":217749}
I20260709 12:11:21.865583 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:21.867362 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.871095 16291 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.853746 16276 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.858551 16340 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.876546 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.862848 16263 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.863183 16282 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.875080 16292 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:11:21.893512 16297 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:21.877972 16068 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:21.867769 16299 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.902441 16268 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.910399 16307 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:21.911525 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:21.913939 16288 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.115s	user 0.004s	sys 0.001s
I20260709 12:11:21.915863 11942 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:21.864638 16080 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.860076 16309 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:21.895275 16016 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:21.898319 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52511.9us
I20260709 12:11:21.899910 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.900667 16068 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:21.901132 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.893636 12020 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:21.923638 16332 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:21.944042 11988 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.763s (SENT)
I20260709 12:11:21.929782 12020 pending_rounds.cc:85] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 5
I20260709 12:11:21.948530 12020 pending_rounds.cc:107] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:21.927855 12017 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:21.928956 16167 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:21.938349 16068 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.939800 16297 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:21.948969 12020 raft_consensus.cc:2889] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:21.957798 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57976.4us
I20260709 12:11:21.971124 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:21.951537 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:21.910446 16138 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:21.973246 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:21.929097 16309 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.977929 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:21.984184 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:21.985432 11939 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.927456 16157 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:21.991305 11942 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.990687 16157 consensus_queue.cc:1243] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:21.995067 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67675.1us
W20260709 12:11:21.995805 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.796s (SENT)
I20260709 12:11:21.996342 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:21.997970 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:21.998790 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:21.999390 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:22.000655 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.001461 11870 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:22.002061 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.002584 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.001332 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.003342 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.004118 11873 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9.
I20260709 12:11:22.003979 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.005190 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.006011 11864 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:22.006122 11868 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:22.007098 16305 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.978852 16276 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.989691 16262 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.005900 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:22.013397 12607 raft_consensus.cc:2376] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8. Re-sending same reply.
I20260709 12:11:21.962754 16283 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:22.010797 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:21.960352 16228 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.987196 16246 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:22.012107 11988 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.812s (SENT)
I20260709 12:11:22.016232 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.020061 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:22.024366 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.026893 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:22.027374 11868 raft_consensus.cc:2393] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:22.030417 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.006735 16297 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.038533 11871 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:21.989436 16167 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.015689 16157 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.046427 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:22.051210 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.025065 16289 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:22.056347 11868 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:22.031896 16332 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.023319 16262 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:22.061477 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.064662 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:22.064903 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52843.8us
I20260709 12:11:22.036690 16246 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:22.071099 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.078773 11869 raft_consensus.cc:2410] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:22.071926 11873 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:22.072798 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:22.081040 11988 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.929s (SENT)
I20260709 12:11:22.081179 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.082631 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.083274 11868 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:22.084003 12015 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:22.084156 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.085707 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:22.085898 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.086354 12020 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.087059 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.025517 16228 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.085441 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.022507 16283 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.091279 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.057641 16289 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.087153 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.095759 11868 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:22.118136 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.097213 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.063241 16332 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.122630 11912 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:22.055277 16310 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:22.060209 16292 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:22.119408 11871 raft_consensus.cc:2410] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:22.119864 12018 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.121762 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.124539 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:22.134828 12015 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.115828 12020 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:22.125171 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.128229 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.131870 11864 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:22.132246 12605 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:22.132237 11869 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.139103 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.136507 12014 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:22.139748 11871 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:22.132925 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:22.134820 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 146498us
I20260709 12:11:22.122896 16289 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:22.146664 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59612.4us
I20260709 12:11:22.124501 16332 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.149864 11868 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:22.086369 16210 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:11:22.156817 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.157240 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.161962 12017 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:22.159040 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.133822 16305 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:22.164949 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.132368 16307 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:22.165716 11869 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:22.166723 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.168089 12018 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:22.167392 11946 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:22.171085 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.171820 11941 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:22.171950 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.151185 15911 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.172617 11943 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:22.173854 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:22.174616 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.177433 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.177300 16307 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.178136 11948 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:11:22.180053 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 57518.1us
I20260709 12:11:22.180341 12014 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:22.181180 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.164007 16157 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:22.184263 16167 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.149063 16292 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.187074 16292 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.175376 15911 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.188267 15911 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.188345 11939 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:22.174393 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.169935 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.177320 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.202001 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:22.219872 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.220906 11868 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:22.212565 16292 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.223078 16292 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.223492 16292 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:22.228790 16342 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.557s	user 0.006s	sys 0.000s
I20260709 12:11:22.201964 16355 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:22.230286 16355 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.230746 16355 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.163543 16263 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.235821 16282 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.175606 16262 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:22.239782 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.265249 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.263916 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:22.271188 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:22.273391 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.274748 11872 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:22.274842 11988 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.026s (SENT)
I20260709 12:11:22.275406 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:22.264125 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.171840 16305 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.260330 16080 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:22.296267 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.302057 16283 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.288841 16308 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.321233 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.321753 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:22.324714 11872 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:22.237356 16263 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.330732 16282 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.312026 16016 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:22.342715 16309 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.344216 11945 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:22.348132 16340 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.349676 12609 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:11:22.349676 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.334115 16228 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:22.358889 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.359274 16252 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.359863 11868 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:22.360818 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.360491 16239 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.359885 16252 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.363323 16239 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.363934 16252 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.333967 16209 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:22.312218 16157 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:22.257841 16246 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.316995 16308 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:22.380203 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:22.364814 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.437197 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.379658 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.371809 12015 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:22.287858 11759 maintenance_manager.cc:643] P 5830ee4e61e44665868e20af26f32046: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.215s	user 0.181s	sys 0.074s Metrics: {"bytes_written":29403,"cfile_init":1,"dirs.queue_time_us":25334,"dirs.run_cpu_time_us":686,"dirs.run_wall_time_us":2327,"drs_written":1,"lbm_read_time_us":538,"lbm_reads_lt_1ms":4,"lbm_write_time_us":142476,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":63,"thread_start_us":24492,"threads_started":1}
I20260709 12:11:22.441188 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.380636 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.506287 11871 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:22.510259 11872 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:22.548358 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.546674 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 208458us
I20260709 12:11:22.381295 16309 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.478044 16308 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.395330 16280 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.567564 16163 raft_consensus.cc:1027] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: attempt to promote peer 189a165e6619406382914fe3075dd436: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:11:22.584017 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:22.550756 16016 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.384186 16276 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:22.380206 16340 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.371129 16305 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.481433 16282 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.373001 16299 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.563864 16263 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:22.566752 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:22.326654 16362 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.232s
W20260709 12:11:22.572256 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 306219us
I20260709 12:11:22.377736 16289 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.594802 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.597360 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:22.598647 12577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.516s (SENT) [suppressed 22 similar messages]
I20260709 12:11:22.589421 16280 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:22.620877 11988 leader_election.cc:336] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.031s (SENT)
I20260709 12:11:22.615061 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.621767 11868 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:22.621960 12021 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:22.619563 12020 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.608834 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:22.625967 12015 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.629607 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:22.614346 16068 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.000s
W20260709 12:11:22.632364 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 76212.7us
W20260709 12:11:22.635540 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 84714.5us
I20260709 12:11:22.637822 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.653218 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:22.654182 12021 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.655954 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:22.656831 11873 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.620771 16283 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:22.674294 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:22.674535 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.624037 16080 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.675071 12022 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:22.680598 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.686348 12020 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:22.663722 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:22.675034 12017 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.675653 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.660979 11872 pending_rounds.cc:85] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 4
I20260709 12:11:22.681568 11864 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:22.687489 11872 pending_rounds.cc:107] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:22.688499 11872 raft_consensus.cc:2889] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.687848 12016 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:22.698348 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:22.699290 12020 raft_consensus.cc:2368] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10.
I20260709 12:11:22.621091 16276 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:22.709443 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45775us
I20260709 12:11:22.712723 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:22.704432 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:22.675472 16305 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.611366 16157 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.678897 16080 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:22.688838 16361 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.719684 11760 maintenance_manager.cc:419] P 5830ee4e61e44665868e20af26f32046: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10267 bytes on disk
I20260709 12:11:22.723913 16308 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.633988 16280 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:11:22.651050 16068 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.741834 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:22.746237 12013 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:22.714521 16262 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.726814 16167 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:22.749418 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.773228 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 156857us
W20260709 12:11:22.773643 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 175045us
W20260709 12:11:22.776017 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 71845us
I20260709 12:11:22.776459 11759 maintenance_manager.cc:643] P 5830ee4e61e44665868e20af26f32046: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.031s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":474,"lbm_reads_lt_1ms":4}
I20260709 12:11:22.782867 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:22.763388 16167 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:22.802964 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:22.803855 12607 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.805073 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:22.810213 16228 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.811587 16307 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.812201 16228 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:22.815600 16246 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.816021 16246 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:22.816354 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:22.817040 16246 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:22.824100 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49981.8us
I20260709 12:11:22.777956 16333 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:22.827781 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:22.826663 12013 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:22.845927 12013 pending_rounds.cc:85] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 7
I20260709 12:11:22.846338 12013 pending_rounds.cc:107] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 11.8
W20260709 12:11:22.839449 11988 leader_election.cc:336] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.178s (SENT)
I20260709 12:11:22.793059 16263 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:22.845306 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:22.843221 12607 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:22.743947 16361 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:22.846647 12013 raft_consensus.cc:2889] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.818845 16167 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.790783 16362 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:22.829259 16351 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:22.825135 16246 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.847291 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:22.821116 16262 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:22.853271 12017 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:22.898249 12021 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:22.900822 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:22.890574 11869 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:11:22.859154 16356 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:22.839151 16209 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:22.849135 16016 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.790876 16080 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.883850 16361 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.889430 16283 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.862509 16299 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:22.862926 16333 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:22.904207 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:22.930624 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 147898us
I20260709 12:11:22.898339 16325 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:22.916366 15911 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.728s	user 0.015s	sys 0.000s
I20260709 12:11:22.948551 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:22.909180 16289 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.916077 16305 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.943873 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:22.909969 16307 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.908565 16356 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.947129 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39778 (request call id 515) took 1212 ms. Trace:
I20260709 12:11:22.868113 16263 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:22.948503 12604 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:22.909301 16362 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:22.940863 16380 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:22.954342 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:22.954519 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59767.3us
I20260709 12:11:22.962927 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:22.963692 11866 rpcz_store.cc:276] 0709 12:11:21.729373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.762682 (+ 33309us) service_pool.cc:224] Handling call
0709 12:11:22.937351 (+1174669us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b54003af554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:22.942041 (+  4690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17434496}
I20260709 12:11:22.899290 16382 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:11:22.965435 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 140056us
W20260709 12:11:22.967067 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.958995 16325 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:22.938690 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:22.950642 16080 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.971318 12606 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.957424 16276 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.974488 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.967974 16356 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.994347 12607 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:22.994938 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:22.995352 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.996111 11912 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.969300 16283 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.967856 16305 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:23.030544 11873 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:23.032403 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:23.033666 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:23.034157 12604 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.971766 16308 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.956683 15911 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.031436 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:23.000427 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:23.040961 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:22.998673 16368 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.050539 12604 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:23.052232 11912 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:23.029749 16307 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.029526 16280 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:22.829617 16374 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:11:23.034065 16016 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.000859 16068 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:23.040130 16299 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.035563 16157 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.049149 16366 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.060101 16389 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:23.055110 16289 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:23.068296 16376 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:11:23.060767 16307 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.063969 16372 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:23.093434 12606 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:23.071116 16299 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:23.098964 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.000990 16262 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:23.105085 16386 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:11:23.062078 16333 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.044787 16209 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.082592 16366 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:23.109685 16366 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.113873 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:23.087342 16389 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.090319 16289 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.127605 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.114889 16389 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:23.096915 16276 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.097627 16307 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.098637 16157 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:23.116879 16299 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.117184 16372 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:23.135973 16289 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:23.147503 16381 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:11:23.157950 16332 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.990s	user 0.014s	sys 0.002s
W20260709 12:11:23.168733 16292 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.004s
W20260709 12:11:23.187987 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 187656us
W20260709 12:11:23.232993 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.183244 12604 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 LEARNER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:11:23.244577 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 203664us
I20260709 12:11:23.124979 16305 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.098951 16325 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.161445 16304 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:23.253715 11941 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:11:23.254046 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 151239us
I20260709 12:11:23.255576 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:23.179976 16368 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:23.162875 16167 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.257812 16263 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.275985 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.284353 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:23.204566 16292 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.203059 16332 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.288470 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:23.291841 11872 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.388461 16372 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.394027 16362 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.395927 16368 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.274694 16411 raft_consensus.cc:2764] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:23.398413 16411 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.399035 16411 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:23.400072 16411 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.400702 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.402205 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.403342 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:23.406042 16404 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:11:23.407354 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:23.408051 12018 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:23.404361 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.274768 15911 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.408080 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.440524 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.468649 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.473970 11865 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:23.485462 11867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1952) took 1459 ms (client timeout 1674 ms). Trace:
W20260709 12:11:23.486198 11867 rpcz_store.cc:269] 0709 12:11:22.026429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.026583 (+   154us) service_pool.cc:224] Handling call
0709 12:11:23.485147 (+1458564us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002f5b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:23.485375 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524217088}
I20260709 12:11:23.487746 16412 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.488341 16412 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.488731 16412 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.271775 16157 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.500684 16332 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.265762 16304 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.436139 16408 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.506300 16408 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.518687 11871 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:23.519969 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.405586 12022 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:11:23.538260 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:23.538911 12018 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:11:23.543131 16246 consensus_meta.cc:287] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.004s
I20260709 12:11:23.543969 16292 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.546592 12018 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:23.549320 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.549963 16167 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:23.550668 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:23.551492 16355 consensus_meta.cc:287] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 1.320s	user 0.018s	sys 0.001s
I20260709 12:11:23.551925 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.553467 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.607036 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.487663 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:23.556434 16304 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.556726 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:23.609089 11867 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:23.609989 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:23.578298 16356 consensus_meta.cc:287] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.003s
I20260709 12:11:23.584105 16408 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.551947 16355 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.696575 16355 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:23.610042 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:23.708374 11867 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:23.710141 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 453138us
W20260709 12:11:23.711503 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.689339 11872 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:23.714155 11865 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
W20260709 12:11:23.763055 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50904.3us
I20260709 12:11:23.766155 16361 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.599967 16366 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.817955 16361 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.775406 16080 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:23.819694 16366 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:23.820180 16361 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.820493 16366 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.821496 16307 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.006s
I20260709 12:11:23.821988 16307 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.812314 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 1908) took 1665 ms. Trace:
I20260709 12:11:23.822888 12014 rpcz_store.cc:276] 0709 12:11:22.146470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.146707 (+   237us) service_pool.cc:224] Handling call
0709 12:11:23.812030 (+1665323us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400346054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:23.812201 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41124736}
I20260709 12:11:23.824240 16307 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:23.826375 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 853) took 1610 ms. Trace:
I20260709 12:11:23.826839 12019 rpcz_store.cc:276] 0709 12:11:22.215920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.216394 (+   474us) service_pool.cc:224] Handling call
0709 12:11:22.222360 (+  5966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.307368 (+ 85008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.307422 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.307501 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:22.307549 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.825902 (+1518353us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b54000532d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:23.825976 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.826262 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194757888}
I20260709 12:11:23.834221 12605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 935) took 1852 ms. Trace:
I20260709 12:11:23.834717 12605 rpcz_store.cc:276] 0709 12:11:21.981380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.981764 (+   384us) service_pool.cc:224] Handling call
0709 12:11:21.990993 (+  9229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.137242 (+146249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.833900 (+1696658us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003c8cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:23.834142 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323765120}
W20260709 12:11:23.837338 16371 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.124s	user 0.002s	sys 0.009s
I20260709 12:11:23.838974 12017 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.699308 16356 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.844264 16356 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.762705 16408 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:23.821045 16366 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.866958 12017 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
W20260709 12:11:23.800721 16402 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.630s	user 0.005s	sys 0.008s
W20260709 12:11:23.848635 16389 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.007s
I20260709 12:11:23.873155 11867 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
W20260709 12:11:23.877816 11869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.003s
I20260709 12:11:23.898684 11870 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12.
W20260709 12:11:23.901305 11870 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1949) took 1900 ms (client timeout 1538 ms). Trace:
I20260709 12:11:23.901659 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:23.901829 11870 rpcz_store.cc:269] 0709 12:11:22.000705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.002156 (+  1451us) service_pool.cc:224] Handling call
0709 12:11:23.898341 (+1896185us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54001a87a8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f218105f4 00007f1f209f9227 00007f1f209f8ab8 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:23.901216 (+  2875us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23527680}
I20260709 12:11:23.902663 11867 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:23.857985 12575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.044s	sys 0.084s
W20260709 12:11:23.903239 12575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.044s	sys 0.084s
W20260709 12:11:23.904152 11869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.003s
W20260709 12:11:23.856832 16299 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.005s
W20260709 12:11:23.859270 16289 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.006s
W20260709 12:11:23.857784 16374 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
I20260709 12:11:23.908946 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:23.911376 11939 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:23.921020 11867 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
W20260709 12:11:23.898739 12604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.009s	sys 0.006s
W20260709 12:11:23.925357 12604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.009s	sys 0.006s
I20260709 12:11:23.923964 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2522) took 1197 ms. Trace:
I20260709 12:11:23.928755 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:23.877753 16262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.000s	sys 0.010s
W20260709 12:11:23.877581 16410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.000s	sys 0.011s
I20260709 12:11:23.816584 16412 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.931943 16289 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.950554 11944 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:23.951577 16289 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.860526 16408 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.955945 16408 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.929636 16299 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:23.956763 16340 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:23.931747 11867 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:23.936057 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:23.958448 11870 raft_consensus.cc:2376] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14. Re-sending same reply.
I20260709 12:11:23.959379 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:23.936954 11939 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.003846 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.004483 11943 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.898046 16356 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:23.956967 16362 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:24.018215 16356 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.019063 16362 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.020681 16356 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:24.021456 16395 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.979s	user 0.000s	sys 0.016s
I20260709 12:11:24.023146 16299 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:23.948695 16366 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:24.006865 16372 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:23.908912 16389 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.025388 11871 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:24.026580 16389 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:23.930330 16394 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.027658 16394 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:23.938324 16262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.001s	sys 0.010s
W20260709 12:11:23.937999 16410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.001s	sys 0.011s
W20260709 12:11:24.039672 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.013s	sys 0.008s
I20260709 12:11:24.031711 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:24.051431 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.013s	sys 0.009s
W20260709 12:11:24.051878 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 796316us
I20260709 12:11:24.002764 16340 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:24.038914 16359 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.066859 11943 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:24.045892 16362 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.052757 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:24.108655 11939 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.118119 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.139181 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:24.147253 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.151247 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:24.155309 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.156411 11943 raft_consensus.cc:2368] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:24.105018 16366 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.169643 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:24.170212 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.115094 16372 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:24.166816 12013 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.003s	sys 0.023s
I20260709 12:11:24.070676 16359 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.176486 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:24.177090 11945 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.185039 11945 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:24.185935 12013 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.003s	sys 0.023s
I20260709 12:11:24.166437 16410 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.187368 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:24.178511 11943 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.180843 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:24.166945 16366 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.144727 16262 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:24.176859 16389 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.208079 11939 raft_consensus.cc:2410] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:24.183531 16372 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.204049 11945 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.211627 11945 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.212039 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1837) took 1012 ms. Trace:
I20260709 12:11:24.212435 11944 rpcz_store.cc:276] 0709 12:11:23.194680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.194888 (+   208us) service_pool.cc:224] Handling call
0709 12:11:23.195372 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.951005 (+755633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.206945 (+255940us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400241b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:24.207140 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736176384}
I20260709 12:11:24.192266 16410 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.193796 16276 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.204411 16366 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:24.225967 12021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.009s	sys 0.026s
I20260709 12:11:24.231423 11943 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:24.208288 16167 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:24.241851 11986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.048s	sys 0.055s
I20260709 12:11:24.167145 16340 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.214272 16372 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:24.242996 12021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.010s	sys 0.026s
I20260709 12:11:24.213428 16283 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:24.241626 16368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.025s
I20260709 12:11:24.222086 16410 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.211440 16389 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:24.295423 16368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.006s	sys 0.026s
W20260709 12:11:24.308934 16388 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.366s	user 0.059s	sys 0.091s
I20260709 12:11:24.285930 16314 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.290717 16412 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:24.326507 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.298256 16307 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.302987 16340 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.377763 16307 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.379519 12019 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.380774 16307 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:24.382166 11868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 1983) took 2021 ms (client timeout 1972 ms). Trace:
W20260709 12:11:24.397521 11868 rpcz_store.cc:269] 0709 12:11:22.360221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.364523 (+  4302us) service_pool.cc:224] Handling call
0709 12:11:24.381841 (+2017318us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000956d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.382063 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419598592}
I20260709 12:11:24.398870 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:24.399578 11868 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.287835 16167 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.385555 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39778 (request call id 517) took 1308 ms. Trace:
I20260709 12:11:24.401757 11872 rpcz_store.cc:276] 0709 12:11:23.077571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.127256 (+ 49685us) service_pool.cc:224] Handling call
0709 12:11:24.385300 (+1258044us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001a8e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.385457 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358103936}
W20260709 12:11:24.403070 11873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.017s
I20260709 12:11:24.286394 16276 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:24.395608 12020 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.001s	sys 0.016s
I20260709 12:11:24.302462 16283 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:24.404870 12020 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.001s	sys 0.016s
W20260709 12:11:24.387799 16157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.002s	sys 0.015s
W20260709 12:11:24.344376 11987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.046s
W20260709 12:11:24.408167 11987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.003s	sys 0.047s
W20260709 12:11:24.408747 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.403517 11873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.017s
W20260709 12:11:24.405920 12022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.004s	sys 0.013s
I20260709 12:11:24.334106 16314 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:24.406212 12014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.002s	sys 0.014s
I20260709 12:11:24.407007 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:24.413501 12014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.003s	sys 0.015s
W20260709 12:11:24.412387 12022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.004s	sys 0.013s
I20260709 12:11:24.420832 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:24.421607 11866 raft_consensus.cc:2368] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:24.422446 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:24.423378 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:24.424284 16417 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.425014 16417 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.427976 16417 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.424322 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:24.450352 11866 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:24.409415 16157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.003s	sys 0.015s
W20260709 12:11:24.432550 16310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.025s
I20260709 12:11:24.411311 16228 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.464062 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2627) took 1064 ms. Trace:
W20260709 12:11:24.448320 16411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.008s	sys 0.011s
I20260709 12:11:24.465965 11941 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:24.466895 12577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.017s
W20260709 12:11:24.471190 12577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.004s	sys 0.017s
I20260709 12:11:24.451553 16299 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.467918 12013 rpcz_store.cc:276] 0709 12:11:23.399578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.408952 (+  9374us) service_pool.cc:224] Handling call
0709 12:11:23.409386 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.411908 (+  2522us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:24.186470 (+774562us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.463600 (+277130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.463676 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.463736 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.463827 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.463985 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10317,"prepare.queue_time_us":916445,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":13664,"spinlock_wait_cycles":5494016,"thread_start_us":985046,"threads_started":2}
I20260709 12:11:24.458024 16307 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.452167 16359 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:24.467406 16310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.012s	sys 0.025s
W20260709 12:11:24.470748 16411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.008s	sys 0.011s
W20260709 12:11:24.472922 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 597863us
W20260709 12:11:24.484916 12604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.011s
W20260709 12:11:24.486825 12604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.011s	sys 0.012s
I20260709 12:11:24.486497 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:24.484125 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 452680us
I20260709 12:11:24.472128 16228 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:24.493281 12609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 743) took 2248 ms (client timeout 2158 ms). Trace:
W20260709 12:11:24.467980 16374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.007s
I20260709 12:11:24.494777 12013 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:24.493781 12609 rpcz_store.cc:269] 0709 12:11:22.241389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.241578 (+   189us) service_pool.cc:224] Handling call
0709 12:11:24.489219 (+2247641us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b5400650254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.489358 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189942656}
I20260709 12:11:24.493469 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:24.479226 16307 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.477586 16299 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.485487 16283 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.501758 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:24.506793 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 332511us
I20260709 12:11:24.493821 16389 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.511018 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:24.516439 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2628) took 1116 ms. Trace:
I20260709 12:11:24.503954 16157 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:24.500185 16374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.008s
W20260709 12:11:24.518431 11988 connection.cc:256] RPC call timeout handler was delayed by -1.2633857069999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:11:24.520190 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1364857070000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 12:11:24.520797 11988 connection.cc:256] RPC call timeout handler was delayed by -1.1121857069999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 12:11:24.509851 16411 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.518375 12021 rpcz_store.cc:276] 0709 12:11:23.399949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.409654 (+  9705us) service_pool.cc:224] Handling call
0709 12:11:23.409975 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.410211 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:24.289362 (+879151us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.514990 (+225628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.515760 (+   770us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:24.516018 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.516264 (+   246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.516385 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":917862,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":241,"thread_start_us":1103460,"threads_started":2}
I20260709 12:11:24.508462 16364 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.510056 16431 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:24.519263 16418 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
W20260709 12:11:24.541078 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0453323449999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:11:24.544281 11988 connection.cc:256] RPC call timeout handler was delayed by -1.0399382389998664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 12:11:24.560634 11868 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:24.537585 16167 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.600981 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2526) took 1836 ms. Trace:
I20260709 12:11:24.601675 11868 rpcz_store.cc:276] 0709 12:11:22.764392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.572784 (+1808392us) service_pool.cc:224] Handling call
0709 12:11:24.599501 (+ 26717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.600437 (+   936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.600478 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.600539 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.600590 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.600664 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.600896 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.563903 16305 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.615932 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48331.5us
I20260709 12:11:24.617748 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:24.565299 16364 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:24.564018 16432 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.542873 16411 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.626906 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 943) took 1454 ms. Trace:
I20260709 12:11:24.625669 16305 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.562557 16431 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:23.926414 11869 rpcz_store.cc:276] 0709 12:11:22.726589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.074712 (+348123us) service_pool.cc:224] Handling call
0709 12:11:23.075216 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.075522 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:23.187956 (+112434us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.922122 (+734166us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.922520 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.922707 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.922765 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:23.922827 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.923364 (+   537us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.923884 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16853,"prepare.queue_time_us":22373,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":66,"raft.queue_time_us":104,"thread_start_us":828282,"threads_started":2}
I20260709 12:11:24.696902 11866 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
W20260709 12:11:24.682976 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.674482 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 861) took 1778 ms. Trace:
I20260709 12:11:24.611560 16423 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.665194 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:24.694478 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:24.666610 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:24.661244 16437 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:11:24.664419 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2635) took 1105 ms. Trace:
I20260709 12:11:24.843714 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:24.869686 12017 rpcz_store.cc:276] 0709 12:11:23.558812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.609444 (+ 50632us) service_pool.cc:224] Handling call
0709 12:11:24.664269 (+1054825us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002675d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.664369 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524943232}
I20260709 12:11:24.685057 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:24.663892 11947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43956 (request call id 845) took 1604 ms (client timeout 1516 ms). Trace:
I20260709 12:11:24.856799 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:24.663206 16433 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:24.861346 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:24.684909 16409 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.913800 12017 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:24.659226 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2523) took 1922 ms. Trace:
W20260709 12:11:24.627779 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 114268us
I20260709 12:11:24.856930 12015 rpcz_store.cc:276] 0709 12:11:22.896021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.896230 (+   209us) service_pool.cc:224] Handling call
0709 12:11:23.813655 (+917425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.813876 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.813904 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.813950 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:23.813985 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.814047 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.674299 (+860252us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400346050. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.674424 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065351936}
W20260709 12:11:24.650250 16430 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:11:24.868677 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:24.868857 11942 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:24.619591 16314 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:24.689145 16426 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:11:24.688926 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:24.642866 12604 rpcz_store.cc:276] 0709 12:11:23.172630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.172822 (+   192us) service_pool.cc:224] Handling call
0709 12:11:23.182724 (+  9902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.183061 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:23.280535 (+ 97474us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.619622 (+1339087us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.624741 (+  5119us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.626518 (+  1777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.626574 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:24.626628 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.626699 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.626843 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37046,"prepare.queue_time_us":169437,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":189612,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":27664,"thread_start_us":1335271,"threads_started":3,"wal-append.queue_time_us":1029226}
I20260709 12:11:24.691392 16431 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:24.869939 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:24.926271 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56427us
I20260709 12:11:24.927055 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:24.885390 12013 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 4.
I20260709 12:11:24.872498 12021 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:24.886061 12607 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:24.662220 16440 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:24.887398 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2525) took 2138 ms. Trace:
I20260709 12:11:24.888015 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:24.872381 11947 rpcz_store.cc:269] 0709 12:11:23.059690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.663578 (+1603888us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:24.663686 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:11:24.861912 16289 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:24.940670 11870 rpcz_store.cc:276] 0709 12:11:22.748887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.010206 (+1261319us) service_pool.cc:224] Handling call
0709 12:11:24.010645 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.010928 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:24.011370 (+   442us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.488470 (+477100us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.489657 (+  1187us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.491514 (+  1857us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.886184 (+394670us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.886441 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.886488 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:24.887103 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.887237 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.887345 (+   108us) inbound_call.cc:177] Queueing success response
0709 12:11:24.935067 (+ 47722us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18003b72e0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
Metrics: {"prepare.queue_time_us":43288,"prepare.run_cpu_time_us":198,"prepare.run_wall_time_us":2657,"raft.queue_time_us":11107,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":7965,"spinlock_wait_cycles":70385408,"thread_start_us":868293,"threads_started":2,"wal-append.queue_time_us":681894}
W20260709 12:11:24.890339 16439 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:11:24.890702 16415 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:24.893286 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2517) took 2210 ms. Trace:
W20260709 12:11:24.893734 16452 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 12:11:24.895890 16340 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 12:11:24.652307 16276 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:24.870299 16423 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:24.898180 16372 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
I20260709 12:11:24.898025 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2531) took 1522 ms. Trace:
I20260709 12:11:24.689666 16228 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.630730 16307 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:24.903259 16366 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
W20260709 12:11:24.904291 16410 consensus_meta.cc:287] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:11:24.642524 16299 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:24.644316 16411 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:24.681401 16355 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:24.969691 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2634) took 1411 ms. Trace:
I20260709 12:11:24.864007 12016 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.971153 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.636019 16446 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:24.644445 16305 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:24.914983 11873 rpcz_store.cc:276] 0709 12:11:22.737373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.762860 (+1025487us) service_pool.cc:224] Handling call
0709 12:11:23.763354 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.763924 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.763972 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.775133 (+ 11161us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.411830 (+636697us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:24.411868 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.411962 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.658925 (+246963us) raft_consensus.cc:1685] finished
0709 12:11:24.658957 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.659146 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11524,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10626,"thread_start_us":551504,"threads_started":1,"wal-append.queue_time_us":803453}
I20260709 12:11:24.915611 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:24.934249 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2524) took 2194 ms. Trace:
I20260709 12:11:24.978981 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2527) took 1705 ms. Trace:
I20260709 12:11:24.978195 11865 rpcz_store.cc:276] 0709 12:11:22.740032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.766658 (+1026626us) service_pool.cc:224] Handling call
0709 12:11:23.767167 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.788673 (+ 21506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.788726 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.789423 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.396742 (+607319us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:24.396787 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.396863 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.934023 (+537160us) raft_consensus.cc:1685] finished
0709 12:11:24.934045 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.934188 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20917,"raft.queue_time_us":22095,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":62599,"thread_start_us":496065,"threads_started":1,"wal-append.queue_time_us":644868}
I20260709 12:11:24.979343 11873 rpcz_store.cc:276] 0709 12:11:23.273295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.978166 (+1704871us) service_pool.cc:224] Handling call
0709 12:11:24.978478 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.978649 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.978690 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.978731 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.978769 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.978818 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.978928 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.934458 16314 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.692351 16364 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:24.661441 16432 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:24.940200 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 322550us
I20260709 12:11:24.967172 16307 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.940882 11869 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:24.886564 16399 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:24.950208 12577 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:24.950627 11864 rpcz_store.cc:276] 0709 12:11:22.682596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.688205 (+  5609us) service_pool.cc:224] Handling call
0709 12:11:24.382651 (+1694446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.382931 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:24.383337 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.564328 (+180991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.564381 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:24.564435 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.564516 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.891932 (+327416us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b180036fe80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4
0709 12:11:24.893028 (+  1096us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000956d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.893173 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":727,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":76,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":27458,"spinlock_wait_cycles":3845614720,"thread_start_us":180552,"threads_started":1,"wal-append.queue_time_us":259219}
I20260709 12:11:24.922884 16361 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.960558 11871 rpcz_store.cc:276] 0709 12:11:23.375909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.519652 (+143743us) service_pool.cc:224] Handling call
0709 12:11:24.897803 (+1378151us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54002da354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:24.897944 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160274816}
I20260709 12:11:24.962347 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:24.941295 16405 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:24.959456 16325 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.980919 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2529) took 1705 ms. Trace:
I20260709 12:11:24.970232 12014 rpcz_store.cc:276] 0709 12:11:23.558544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.824194 (+265650us) service_pool.cc:224] Handling call
0709 12:11:23.824688 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.825171 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:23.825208 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.859673 (+ 34465us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.414184 (+554511us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:24.414248 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.414338 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.969379 (+555041us) raft_consensus.cc:1685] finished
0709 12:11:24.969408 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.969625 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18367,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":554205,"threads_started":1,"wal-append.queue_time_us":652474}
I20260709 12:11:25.029039 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2535) took 1652 ms. Trace:
I20260709 12:11:25.021885 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:24.977193 16411 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.026113 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75967us
I20260709 12:11:25.020051 16299 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:25.028005 16361 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.032475 16299 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.958081 16289 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:24.937525 16409 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.034258 16361 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.034741 16289 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.028546 11873 rpcz_store.cc:276] 0709 12:11:23.275976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.980200 (+1704224us) service_pool.cc:224] Handling call
0709 12:11:24.980448 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.980603 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.980626 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.980683 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:24.980719 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.980772 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.980870 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:25.018785 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103230us
I20260709 12:11:25.036751 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 523) took 1209 ms. Trace:
I20260709 12:11:25.036947 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:25.028488 16325 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.037161 11873 rpcz_store.cc:276] 0709 12:11:23.827044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.035938 (+1208894us) service_pool.cc:224] Handling call
0709 12:11:25.036254 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.036423 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.036450 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.036492 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:25.036527 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.036594 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.036694 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:25.038064 16325 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.038878 11873 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.041121 11873 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.041432 16375 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.977598 16431 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.042443 16405 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:25.042505 16431 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.043447 16405 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.044799 16431 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.014452 16374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43950 (request call id 13) took 24954 ms. Trace:
W20260709 12:11:25.046233 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.046150 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.045694 16374 rpcz_store.cc:276] 0709 12:11:00.060466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.063681 (+  3215us) service_pool.cc:224] Handling call
0709 12:11:00.130869 (+ 67188us) log.cc:844] Serialized 506 byte log entry
0709 12:11:00.415343 (+284474us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18002e6180. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1b98cb0b 00007f1f1ba11b63 00007f1f1ba39752 00007f1f209f9d29
0709 12:11:25.013756 (+24598413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251456,"raft.queue_time_us":251955,"raft.run_cpu_time_us":3441,"raft.run_wall_time_us":175067,"spinlock_wait_cycles":47061760,"thread_start_us":98579,"threads_started":1,"wal-append.queue_time_us":166537,"wal-append.run_cpu_time_us":3025,"wal-append.run_wall_time_us":1022545}
I20260709 12:11:25.029606 11871 rpcz_store.cc:276] 0709 12:11:23.377123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.026833 (+1649710us) service_pool.cc:224] Handling call
0709 12:11:25.028536 (+  1703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.028732 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.028758 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.028800 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:25.028839 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.028889 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.028989 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:25.032791 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.048664 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.049711 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:25.050246 12607 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:25.050745 16246 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.051515 16363 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.051841 12609 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.051934 16363 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.052404 16363 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.052568 16305 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.035331 16409 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.053409 16305 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.028162 16340 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.053848 16305 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.053993 16340 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.054319 16305 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.054492 16340 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.057818 12604 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.061939 16466 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.062462 16466 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.061944 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.062915 16466 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.966413 16415 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.064878 16138 raft_consensus.cc:1064] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:11:25.065153 16415 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:24.964291 16372 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.065917 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.066392 11948 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:25.042029 16375 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:25.067970 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.072077 16398 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:25.072474 16423 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.025377 16460 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.073094 16460 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.073485 16460 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.074258 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.075014 16398 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.075379 16398 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:25.075500 16361 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:25.076578 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.068382 11864 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:24.969219 16366 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.077473 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2530) took 1702 ms. Trace:
I20260709 12:11:24.974195 16410 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.076915 16289 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:25.078560 16228 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:25.078765 16289 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.079010 16228 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:25.077821 11864 rpcz_store.cc:276] 0709 12:11:23.375171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.026764 (+1651593us) service_pool.cc:224] Handling call
0709 12:11:25.068087 (+ 41323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.077246 (+  9159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.077423 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:25.079417 16289 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:25.079936 16410 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.080771 11872 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:25.080375 16289 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.081746 16289 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.081907 11868 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.083058 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 519) took 1957 ms. Trace:
I20260709 12:11:25.083458 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2537) took 1648 ms. Trace:
I20260709 12:11:25.083341 11868 rpcz_store.cc:276] 0709 12:11:23.125523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.621204 (+1495681us) service_pool.cc:224] Handling call
0709 12:11:25.081746 (+460542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.082321 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.082901 (+   580us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002f6050. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:25.083009 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058259712}
I20260709 12:11:25.083920 11869 rpcz_store.cc:276] 0709 12:11:23.547540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.031547 (+1484007us) service_pool.cc:224] Handling call
0709 12:11:25.082921 (+ 51374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.083089 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.083112 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.083225 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:25.083265 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.083317 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.083409 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:25.079479 16228 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:25.026846 16307 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.072292 16138 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.067958 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.088009 16394 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.090090 12606 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:25.091406 16466 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.092006 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:25.098459 16372 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.098898 16468 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.098945 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.101269 16466 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.101572 16372 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:25.092648 16228 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.102888 16375 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.104421 16228 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.069023 16411 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.106700 16411 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:24.977828 16355 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:25.107753 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.094352 16399 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.095158 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.106799 12606 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:25.114655 16355 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.086844 16366 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:24.987169 16446 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:25.117764 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet d6df9d20345c49f0a6f00d9f5f660140: Illegal state: Replica 46f08e8ff3774f25acad18252e5cd57d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:25.097446 16307 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.075788 16398 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.124990 12016 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:25.126965 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.127251 16432 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.130048 16468 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.130517 16468 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.130888 16468 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.133360 16394 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.133715 16361 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:25.133926 16394 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.136299 16394 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.137208 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.137897 12607 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:25.140607 16468 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.143328 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:25.144462 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:25.146793 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:25.161002 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2528) took 1886 ms. Trace:
I20260709 12:11:25.161736 11865 rpcz_store.cc:276] 0709 12:11:23.275066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.979803 (+1704737us) service_pool.cc:224] Handling call
0709 12:11:24.980086 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.980292 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:25.024891 (+ 44599us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.160551 (+135660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.160623 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.160686 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.160776 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.160927 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44237,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":135222,"threads_started":1}
I20260709 12:11:25.141817 16446 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.170298 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.172294 11865 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:25.148207 16394 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:25.177855 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.153156 16245 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:25.185153 11914 connection.cc:256] RPC call timeout handler was delayed by -1.006958166000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:11:25.186611 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.187846 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.188421 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.189042 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.189778 11946 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:25.190575 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.191864 11948 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:25.192997 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:25.148106 16410 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:25.193722 11948 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:25.193802 11947 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:25.194145 11947 pending_rounds.cc:85] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
I20260709 12:11:25.194351 11947 pending_rounds.cc:107] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:25.194595 11947 raft_consensus.cc:2889] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.195348 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.196051 12016 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:25.199828 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.204658 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.175132 16470 raft_consensus.cc:2764] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:25.211124 16432 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:25.210212 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.178357 16394 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.213248 16410 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:25.230340 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.249785 11939 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:25.251030 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 80873.9us
I20260709 12:11:25.252138 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.258563 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.198930 16245 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:25.259871 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:25.261135 12577 leader_election.cc:336] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.516s (SENT)
I20260709 12:11:25.261816 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.265905 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.266255 12016 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:25.224272 16394 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.267937 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.224126 16410 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:25.271600 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.274124 12015 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:25.275215 11939 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:25.277992 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.264022 16432 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.291118 12016 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 5.
I20260709 12:11:25.293917 16245 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.221427 16471 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:25.279305 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.308185 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:25.312868 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51780.4us
W20260709 12:11:25.316254 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.316113 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.317363 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.301486 16417 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.320200 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.304436 16415 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.324227 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2630) took 1768 ms. Trace:
I20260709 12:11:25.325253 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2633) took 1767 ms. Trace:
I20260709 12:11:25.326251 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.325647 12020 rpcz_store.cc:276] 0709 12:11:23.558274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.802760 (+244486us) service_pool.cc:224] Handling call
0709 12:11:23.803177 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.803463 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:24.405389 (+601926us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.043499 (+638110us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:25.321778 (+278279us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.324932 (+  3154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.324984 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.325040 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.325099 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.325193 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":300356,"prepare.queue_time_us":824916,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":259441,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3807,"spinlock_wait_cycles":3463040,"thread_start_us":1219601,"threads_started":3,"wal-append.queue_time_us":558671}
I20260709 12:11:25.332561 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:25.333297 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2625) took 2046 ms. Trace:
I20260709 12:11:25.337610 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.332553 11988 leader_election.cc:400] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:25.340715 11988 leader_election.cc:403] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.341468 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.313956 16469 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.319319 16399 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.354352 12020 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.356597 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.331420 16466 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.356833 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.360219 12020 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:25.357300 12015 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.336552 16468 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.332890 16411 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.309321 16340 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.363566 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.364161 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.367074 12016 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.321838 16325 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.366214 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:25.346095 16431 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:25.365506 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.378391 12017 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.372567 12015 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:25.374763 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.379249 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.380095 12020 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:25.381265 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.333315 16415 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.331137 16417 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.376458 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:25.387305 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.353919 16432 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.390704 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.322738 16410 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.393210 12609 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.365929 16411 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.397742 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.378777 16412 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.426317 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1842) took 2195 ms. Trace:
I20260709 12:11:25.404220 11914 leader_election.cc:400] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10.
I20260709 12:11:25.444777 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.445935 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.324623 12018 rpcz_store.cc:276] 0709 12:11:23.555874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.559001 (+  3127us) service_pool.cc:224] Handling call
0709 12:11:23.559293 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.559515 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:24.042768 (+483253us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.306557 (+1263789us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.323711 (+ 17154us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.323900 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.323946 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:25.323998 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.324065 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.324175 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":822241,"prepare.queue_time_us":1578768,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4514,"raft.queue_time_us":9140,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7770,"spinlock_wait_cycles":12513536,"thread_start_us":935218,"threads_started":2,"wal-append.queue_time_us":557568}
I20260709 12:11:25.445375 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.445816 11941 rpcz_store.cc:276] 0709 12:11:23.230644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.608188 (+377544us) service_pool.cc:224] Handling call
0709 12:11:23.608484 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.470916 (+862432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.426069 (+955153us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540037ffd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:25.426256 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971412736}
I20260709 12:11:25.405989 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.403548 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:25.382112 16409 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:25.403898 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:25.440008 16472 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:11:25.496174 16299 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:25.422847 16477 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:11:25.424172 16474 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:11:25.429759 16447 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:25.458614 12016 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:25.456665 12017 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:25.479110 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.507102 11866 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.479772 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.507171 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.507776 11867 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.508173 12016 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:25.501451 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:25.481360 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.516608 11867 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:25.482744 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.484368 11872 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:25.440660 16417 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.531062 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:25.489441 16363 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.392282 16305 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.432360 16471 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.400583 16411 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.454106 16283 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:25.432349 16415 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.439395 16460 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.399881 16466 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.540939 16466 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:25.422279 16473 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:11:25.542147 16283 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.542996 16466 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.545174 16283 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.402194 16412 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:25.555990 16412 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.502978 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.558061 12013 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:25.557701 16394 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.559165 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.559969 12013 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:25.560086 16394 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.560876 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.519384 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.563076 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.564191 12015 raft_consensus.cc:2410] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:25.456216 16016 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.565874 16016 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.568970 16016 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:25.523490 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.524914 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.571975 12017 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:25.573385 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.574591 16325 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.574844 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.576406 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.501708 16276 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.505914 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 157545us
I20260709 12:11:25.529904 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.477813 16364 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.484522 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.584977 16364 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.585376 16364 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.532371 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:25.423378 16478 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:11:25.549337 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.587361 12016 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:25.588342 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.588945 12016 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:25.435571 16340 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.577870 11864 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.578027 12013 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:25.537770 16361 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:25.584141 16374 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.584379 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54603.1us
I20260709 12:11:25.556013 16460 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.590811 12021 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.591709 12604 raft_consensus.cc:2393] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:25.577024 12017 raft_consensus.cc:2376] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9. Re-sending same reply.
I20260709 12:11:25.502749 16409 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.565192 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.623315 12015 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:25.619374 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.530892 16392 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:11:25.626502 12016 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:25.619254 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.611078 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.633065 16356 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:25.630501 16483 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:11:25.337844 12022 rpcz_store.cc:276] 0709 12:11:23.287095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.288920 (+  1825us) service_pool.cc:224] Handling call
0709 12:11:23.405054 (+116134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.405375 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:23.699731 (+294356us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.299779 (+1600048us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b1800127960. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf 00007f1f1ba4d038
0709 12:11:25.306256 (+  6477us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.315138 (+  8882us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.325416 (+ 10278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.325463 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.325515 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.325624 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.333236 (+  7612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67816,"prepare.queue_time_us":851727,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":75887,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":6901,"spinlock_wait_cycles":8028544,"thread_start_us":715208,"threads_started":1,"wal-append.queue_time_us":824540}
I20260709 12:11:25.634912 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.661612 12017 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:25.661809 12022 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:25.637945 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.638911 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.663106 11870 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.639881 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.664654 11872 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.641835 16239 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.631666 16325 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:25.651706 12018 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.652671 12013 raft_consensus.cc:2410] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:25.655388 11945 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.658079 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.714493 12015 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.592382 16276 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.622092 16361 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:25.618810 16398 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:25.714700 12017 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:25.716648 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58658.4us
I20260709 12:11:25.731244 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:25.717195 12013 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:25.671581 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.722693 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.733209 12018 raft_consensus.cc:2393] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:25.727924 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.650888 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:25.734738 12016 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:25.741276 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 98582.4us
I20260709 12:11:25.742334 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:25.757658 11872 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:25.767444 11870 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:25.764298 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:25.777395 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:25.739475 16405 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.781811 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.752758 16368 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:25.794080 11866 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:25.796639 11871 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:25.798169 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.798998 11866 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.802553 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.783090 16463 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.815022 16463 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:25.757637 16297 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.822389 16297 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:25.823105 16297 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.692802 16239 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:25.832238 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.782680 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.784323 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.836033 12017 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:25.782266 11872 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:25.836097 11870 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:25.777040 16460 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.829377 11866 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:25.789335 16138 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.786285 16405 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:25.784014 11945 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:25.853627 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.853091 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:25.856304 12017 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.830786 16392 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:25.858857 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:25.867378 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.868208 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:25.872138 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.837774 16368 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:25.905931 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.907019 11940 raft_consensus.cc:2368] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
W20260709 12:11:25.907886 16480 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.559s	user 0.008s	sys 0.001s
I20260709 12:11:25.853698 16138 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.858371 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:25.858233 16405 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.865662 16415 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.934911 11839 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.782s (SENT)
I20260709 12:11:25.935708 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.937705 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.941692 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.944057 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.945041 11867 raft_consensus.cc:2368] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:25.946663 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.931597 12018 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:25.876392 16363 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:25.955037 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.955758 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.962827 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:25.963435 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.964259 11870 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:25.965813 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.967410 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.958439 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.965338 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.957113 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.970723 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.972096 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.969446 11870 raft_consensus.cc:2368] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:25.973908 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.975394 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.920610 16305 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:25.857719 16411 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:25.993705 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:25.985217 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:25.995020 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.988015 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.928829 16138 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.995705 11871 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:25.950532 16016 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.977567 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:25.995993 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:25.848187 16361 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.010947 16276 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.011808 16239 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:26.025210 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.982528 16412 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:26.026002 16412 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.028317 16412 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:26.029597 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.000253 16487 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:11:26.030917 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:25.963418 16415 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.033424 16415 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:26.035864 16398 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.038223 16411 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:26.039108 12021 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.044421 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.046686 16299 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.048878 16305 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:26.050988 16305 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.051437 16305 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:26.014761 16409 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:26.014889 16368 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.022019 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:26.020363 16138 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.022334 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:26.060113 16138 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:25.987730 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 252524us
I20260709 12:11:26.022974 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.021725 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.062215 16436 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:26.021390 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.062640 16436 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:26.021024 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.063702 16436 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.064437 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.065217 16436 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.875836 16392 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.027788 16297 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.074390 16297 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.022639 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.075474 11947 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:26.075678 16364 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.074411 16392 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:25.998795 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:26.066737 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.077402 12018 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:26.082099 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.090843 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.079319 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:26.092001 16355 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:26.092680 16355 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:25.997201 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:26.094139 11872 raft_consensus.cc:2410] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:26.093714 16355 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.094264 16410 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.095571 16364 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.080040 11988 leader_election.cc:400] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.084142 16485 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:26.082566 16471 consensus_meta.cc:287] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.003s
W20260709 12:11:26.083616 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 106131us
I20260709 12:11:26.107262 11947 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:26.099202 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.092111 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.121747 12014 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:26.052489 16305 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.102661 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:26.089110 16405 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.117857 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:26.120738 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.128520 12602 raft_consensus.cc:3060] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.129186 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:26.130062 11947 raft_consensus.cc:2368] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:26.126125 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.132411 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.132411 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.134958 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.135761 12018 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:26.136679 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.138245 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.138743 12018 raft_consensus.cc:2410] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:26.141151 12604 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.141494 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.006336 12017 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:26.114332 16471 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.160682 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:26.163620 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 352987us
I20260709 12:11:26.166812 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.167234 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:26.169811 11839 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.076s (SENT)
I20260709 12:11:26.170581 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:26.171098 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:26.170472 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:26.130223 16412 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.134104 16016 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.127684 16460 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:26.188899 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.174543 12014 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:26.180016 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.176405 12602 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:26.135077 16415 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 12:11:26.183584 11839 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.180s (SENT)
I20260709 12:11:26.274991 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:26.201483 11947 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:26.191776 12015 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:26.270262 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.192519 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.296955 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:26.192965 16411 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.297394 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:26.269824 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.190644 12018 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:26.186555 16276 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.189288 16305 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.296087 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.200649 11945 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:26.330497 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.331393 12018 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.194993 12604 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:26.334178 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 150625us
I20260709 12:11:26.335928 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:26.233703 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.336817 12014 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.205471 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.207850 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:26.313073 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.313850 12606 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:26.294809 11947 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:26.338362 11865 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.339512 11943 raft_consensus.cc:2410] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:26.278374 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.327644 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.340925 12013 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:26.341820 12020 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:26.337507 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:26.366618 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69752.3us
I20260709 12:11:26.368391 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:26.199249 16310 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:11:26.299419 16138 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.377930 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.379513 12017 raft_consensus.cc:2410] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:26.279874 16016 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:26.276723 16501 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:11:26.339356 11947 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.387756 11947 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.389321 12013 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.393092 12013 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.323573 16405 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.417141 12018 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:26.417625 11865 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:26.407061 12013 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:26.411159 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:26.374610 16486 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.311239 16415 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:26.383396 16374 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.378031 16276 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.434092 12020 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:26.300594 16460 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:26.429221 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61082.7us
I20260709 12:11:26.429695 12017 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:11:26.430397 12019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.025s
W20260709 12:11:26.443799 12019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.015s	sys 0.025s
I20260709 12:11:26.433095 12013 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:26.482331 16493 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:26.482697 11914 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:26.484583 16409 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:26.486092 16486 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.486295 16409 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.486797 16486 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:26.488385 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.488631 16409 raft_consensus.cc:2804] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.489190 16486 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:26.433741 16276 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.431964 16501 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.490410 12607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 505) took 1172 ms. Trace:
I20260709 12:11:26.508080 12607 rpcz_store.cc:276] 0709 12:11:25.317641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.317751 (+   110us) service_pool.cc:224] Handling call
0709 12:11:25.330116 (+ 12365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.354082 (+ 23966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.354139 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.359677 (+  5538us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.604310 (+244633us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.604353 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.435290 (+830937us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54006702d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:26.435344 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.435395 (+    51us) raft_consensus.cc:1685] finished
0709 12:11:26.435414 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.490331 (+ 54917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54548352,"thread_start_us":238784,"threads_started":1,"wal-append.queue_time_us":250556}
I20260709 12:11:26.491847 16409 raft_consensus.cc:697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:26.490360 12017 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.486366 16297 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:11:26.424490 16138 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:26.525738 12014 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:26.534559 12603 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:26.522575 16276 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.545104 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 424417us
I20260709 12:11:26.546518 11988 leader_election.cc:400] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.546911 11988 leader_election.cc:403] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.549309 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2645) took 1191 ms. Trace:
I20260709 12:11:26.549896 12021 rpcz_store.cc:276] 0709 12:11:25.357707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.670769 (+313062us) service_pool.cc:224] Handling call
0709 12:11:25.671095 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.039544 (+368449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.549008 (+509464us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400027e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:26.549224 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845738880}
I20260709 12:11:26.554378 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2548) took 1054 ms. Trace:
I20260709 12:11:26.556023 11864 rpcz_store.cc:276] 0709 12:11:25.499565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.499706 (+   141us) service_pool.cc:224] Handling call
0709 12:11:25.500161 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.609374 (+109213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.553665 (+944291us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5400294fd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:26.554274 (+   609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178216192}
I20260709 12:11:26.558386 11868 raft_consensus.cc:2410] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:26.574810 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:26.574553 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 237141us
I20260709 12:11:26.576647 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.537978 16486 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:26.573165 16500 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:11:26.587538 16410 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:26.589145 16410 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:26.589599 16410 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:26.592592 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.581291 16411 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.580142 16470 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.584511 16307 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.620473 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.611397 16366 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.585273 16486 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:26.631369 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 148744us
I20260709 12:11:26.639730 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.641966 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.643272 11943 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:26.643602 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.648072 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.649394 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.649572 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.651680 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:26.652848 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.591846 16409 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:26.656260 16436 consensus_meta.cc:287] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.005s
I20260709 12:11:26.657565 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.594290 16138 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.658861 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.659449 12021 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:26.659677 11942 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:26.657747 12610 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:26.664985 11988 leader_election.cc:400] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.590828 16410 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.658257 16511 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.677193 16410 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:26.677342 16511 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.678908 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.679755 16466 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.680192 16511 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:26.681108 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.682410 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.683171 16466 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.685029 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:26.685946 16471 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.686118 11864 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:26.686404 16471 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:26.686352 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.687007 16471 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.687866 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.688140 12606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41000 (request call id 959) took 1469 ms. Trace:
I20260709 12:11:26.688567 12606 rpcz_store.cc:276] 0709 12:11:25.218554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.218776 (+   222us) service_pool.cc:224] Handling call
0709 12:11:25.219032 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.338812 (+1119780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.687889 (+349077us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540040b354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:26.688068 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517092608}
W20260709 12:11:26.687045 16498 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
W20260709 12:11:26.690229 16502 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:11:26.691020 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 878) took 1039 ms. Trace:
W20260709 12:11:26.691874 16504 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:26.691459 12022 rpcz_store.cc:276] 0709 12:11:25.651433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.715070 (+ 63637us) service_pool.cc:224] Handling call
0709 12:11:25.755135 (+ 40065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.755442 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.755478 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.756119 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.136653 (+380534us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:26.136692 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.136761 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.686406 (+549645us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:26.690647 (+  4241us) raft_consensus.cc:1685] finished
0709 12:11:26.690674 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.690955 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60281728,"thread_start_us":303068,"threads_started":1,"wal-append.queue_time_us":568871}
I20260709 12:11:26.693495 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.693874 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.694209 12022 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.694592 12020 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.695875 16486 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:26.699559 16307 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.700407 16307 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.702961 16364 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:26.703430 16364 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:26.704489 16364 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:26.709797 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62326.6us
I20260709 12:11:26.710556 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.665066 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:26.665863 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:26.628656 16304 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:11:26.666568 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:26.709404 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.715359 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.717175 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:26.718142 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.718647 12021 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.720178 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:26.720764 12014 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.720837 12021 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:11:26.712720 11870 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 8: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:26.714653 12022 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:26.721980 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:26.728271 12020 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:26.672675 16411 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.645889 16501 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:26.665064 16513 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:26.751833 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.760644 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.723980 16486 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.762712 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.774614 12014 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:26.739018 16364 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.719750 16415 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:26.757997 16304 consensus_queue.cc:1243] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:26.789162 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 101355us
I20260709 12:11:26.790192 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.780779 16513 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.797340 11988 leader_election.cc:400] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.798450 16305 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.801190 11988 leader_election.cc:403] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.782631 16466 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.790544 16361 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.806353 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:26.832897 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.834005 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:26.851365 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:26.836755 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.817044 16307 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13.
I20260709 12:11:26.856151 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:26.849267 16514 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:11:26.832370 16511 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.838691 16460 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.864360 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:26.862190 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.853392 16372 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:26.857718 16510 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:11:26.874066 16523 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:11:26.849428 16516 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.854527 16305 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.858592 16392 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:26.878274 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.880254 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:26.857471 16340 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:26.922992 16340 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:26.928463 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.929979 16503 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:11:26.825273 16361 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.933476 16361 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:26.933964 16515 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.934517 16487 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.934639 16515 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:26.934888 16519 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:11:26.935072 16487 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:26.935662 16515 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.877502 16228 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:26.937800 16228 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.938898 16466 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:26.939597 16466 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.940124 16228 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:26.890348 16522 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:26.936971 16515 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.942606 16392 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:26.943688 16392 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:26.944738 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:26.934723 16512 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:11:26.887838 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:26.893718 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.890739 12577 leader_election.cc:400] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
W20260709 12:11:26.947430 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 70097.1us
I20260709 12:11:26.848742 16471 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:26.878924 16460 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:26.904690 11868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2542) took 1422 ms (client timeout 1752 ms). Trace:
I20260709 12:11:26.857631 16501 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:11:26.909089 16521 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:11:26.950636 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 57544.9us
W20260709 12:11:26.913110 16499 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.713s	user 0.000s	sys 0.010s
I20260709 12:11:26.885213 16526 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.934041 16529 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:26.894446 16517 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:11:26.947674 12577 leader_election.cc:403] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:11:26.974535 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 83957.5us
I20260709 12:11:26.862917 16366 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.949419 11868 rpcz_store.cc:269] 0709 12:11:25.482272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.482429 (+   157us) service_pool.cc:224] Handling call
0709 12:11:26.904472 (+1422043us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540006a4d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:26.904623 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389504384}
I20260709 12:11:26.978736 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:26.950476 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70337us
I20260709 12:11:26.946533 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 874) took 1743 ms. Trace:
I20260709 12:11:26.981439 12019 rpcz_store.cc:276] 0709 12:11:25.202924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.203059 (+   135us) service_pool.cc:224] Handling call
0709 12:11:25.212803 (+  9744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.217308 (+  4505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.217340 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.253610 (+ 36270us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.852973 (+599363us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800479560. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d30d1 00007f1f1b9eea0f
0709 12:11:26.445840 (+592867us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:26.445904 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.901654 (+455750us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b54000b6154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:26.901737 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.946301 (+ 44564us) raft_consensus.cc:1685] finished
0709 12:11:26.946323 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.946470 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3506,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":30771,"spinlock_wait_cycles":15213568,"thread_start_us":592593,"threads_started":1,"wal-append.queue_time_us":1366739}
I20260709 12:11:26.952443 11948 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:26.983453 11948 pending_rounds.cc:85] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 8
I20260709 12:11:26.983750 11948 pending_rounds.cc:107] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:26.984048 11948 raft_consensus.cc:2889] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.956604 11939 pending_rounds.cc:85] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 7
I20260709 12:11:26.985013 11939 pending_rounds.cc:107] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:26.982327 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.985303 11939 raft_consensus.cc:2889] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.978173 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.988339 11940 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:26.954087 16511 raft_consensus.cc:2764] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:26.992861 16526 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.992246 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.991241 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:26.994267 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.002269 12603 raft_consensus.cc:2410] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:26.993788 11945 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:27.006068 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 879) took 1348 ms. Trace:
W20260709 12:11:27.006713 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 252163us
I20260709 12:11:27.006557 12015 rpcz_store.cc:276] 0709 12:11:25.657845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.781816 (+123971us) service_pool.cc:224] Handling call
0709 12:11:25.842688 (+ 60872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.295044 (+452356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.005792 (+710748us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400346054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:27.005992 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802202368}
I20260709 12:11:26.987742 16368 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10.
I20260709 12:11:26.970708 16138 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:26.995712 16369 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:27.012972 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:26.991459 16497 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:27.020605 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44753.2us
I20260709 12:11:27.022094 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.023741 16526 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.973480 16518 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:27.027215 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:27.026137 12015 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:27.028864 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:27.029639 11943 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:27.030373 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:26.993057 16533 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:27.010229 16366 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.008248 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.043660 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.043951 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.044437 12017 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:27.044627 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:27.047930 12018 raft_consensus.cc:2368] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8.
I20260709 12:11:27.049767 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:26.994747 16361 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:11:27.015988 16405 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.022632 16340 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:27.063333 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.028364 16369 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.996778 16530 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:27.030907 16497 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.073668 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.074656 12022 raft_consensus.cc:2410] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:27.075228 16497 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:27.075750 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.082422 16529 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:27.085011 16299 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.085675 16299 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.086547 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:27.088194 16299 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:27.088790 16299 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:27.089964 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:27.091187 16068 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.092200 16372 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.092592 16372 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.093452 16068 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.093557 16372 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.094518 16068 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.095413 16372 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.098758 16460 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:27.089323 16299 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.103444 16299 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:27.105819 16471 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:27.108253 16486 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.038270 16511 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:27.111760 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:27.077270 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.106909 16530 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.057503 16374 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:27.122273 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101845us
I20260709 12:11:27.131366 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:27.133507 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:27.126746 16299 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.114212 16369 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:27.272969 12015 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:27.128103 16374 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.274621 16374 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.130115 16530 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.276114 16374 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.276489 16530 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.272622 16470 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:27.277981 16530 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.278388 16470 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.280866 16470 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:27.274454 16369 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:27.272965 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85580.4us
I20260709 12:11:27.144073 16228 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.292320 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:27.128893 16471 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:11:27.132768 16366 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 12:11:27.294421 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 207987us
I20260709 12:11:27.301213 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:27.305020 16294 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.305603 16294 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.306483 16294 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.307060 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:27.310334 16276 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.761s	user 0.014s	sys 0.000s
I20260709 12:11:27.310866 16276 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.313129 16276 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:27.321765 16299 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.322609 16299 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.323580 16294 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.327822 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:27.339335 16356 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.341621 16356 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:27.342092 16356 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.342536 16228 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:27.343600 16228 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.329658 16466 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.347301 16299 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:27.354916 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:27.141717 16543 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 12:11:27.331835 16361 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.366129 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:27.371412 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:27.359401 16299 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:27.369104 16372 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.385728 16299 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.387749 16297 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.388302 16299 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:27.390059 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:27.393100 16372 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:27.394248 16372 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.349181 16466 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:27.399236 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.434952 11872 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:27.437165 11868 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 12:11:27.399561 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.826820 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:27.418099 12021 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:27.419474 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.446658 12014 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.457474 11870 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.462152 11868 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.466204 11873 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.467463 12020 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.472299 11871 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:27.474385 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:27.475432 11868 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
W20260709 12:11:27.485627 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 564678us
I20260709 12:11:27.487437 12015 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:27.488427 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.492590 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:27.494889 11872 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.496405 12606 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:27.340291 16446 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 12:11:27.506732 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.524111 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.456328 16297 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:27.577585 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 569481us
I20260709 12:11:27.599786 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:27.601374 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.595561 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:27.596465 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:27.608508 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 185619us
I20260709 12:11:27.609062 12605 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:27.596520 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:27.628176 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.509440 16410 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:27.638886 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 128677us
I20260709 12:11:27.647620 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:27.652810 11946 pending_rounds.cc:85] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 8
I20260709 12:11:27.653167 11946 pending_rounds.cc:107] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:27.653421 11946 raft_consensus.cc:2889] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.655725 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.657446 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:27.661990 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56183.3us
I20260709 12:11:27.635486 16486 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.639062 16513 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.508666 16016 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:11:27.667562 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.648834 16299 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.697714 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.663856 16515 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:27.669875 16550 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:11:27.689507 16516 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.687314 16486 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:27.689739 16513 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:27.665365 16538 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.699405 16518 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.651589 16410 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.668349 16497 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:27.686400 16422 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:27.682127 16297 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.733747 16518 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:27.716676 16513 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.717689 16538 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:27.717394 16486 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.707228 16299 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:27.719825 16548 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:27.711625 16516 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:27.748143 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 80655.6us
I20260709 12:11:27.790581 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:27.788050 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:27.792084 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.792273 16392 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:27.728979 16356 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.794862 16356 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:27.795661 12603 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:27.707505 16364 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.922s	user 0.014s	sys 0.000s
I20260709 12:11:27.797840 16415 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.798658 16415 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.810636 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:27.812891 16515 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.813807 16515 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:27.814288 16515 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.818338 16496 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:27.819850 16496 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:27.822613 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:27.825522 16446 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:27.828919 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:27.831894 12019 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.763511 16016 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.763634 16547 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:27.868875 16415 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.877279 16299 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:27.882654 16537 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.799s	user 0.011s	sys 0.000s
I20260709 12:11:27.779644 16538 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.835467 16516 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.852615 16276 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:27.972723 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 66227.8us
W20260709 12:11:28.082576 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.102749 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 273550us
I20260709 12:11:28.104215 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:28.118427 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:28.065902 16543 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:28.132756 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:28.090772 16299 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:28.145756 16542 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:11:28.147938 16530 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.005s
W20260709 12:11:28.171824 16554 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:11:28.195618 11771 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 13, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:28.154680 16543 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:27.901258 16547 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:28.321309 12577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.018s	sys 0.014s
W20260709 12:11:28.495378 12577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.020s	sys 0.021s
W20260709 12:11:28.495890 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 858130us
I20260709 12:11:28.104677 16415 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:28.175594 16361 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.122967 16355 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:28.129379 16446 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:28.129760 16016 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:28.161123 16289 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:28.467654 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 334982us
I20260709 12:11:28.503886 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:28.313277 16436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.003s	sys 0.023s
I20260709 12:11:28.490051 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2578) took 1692 ms. Trace:
W20260709 12:11:28.470221 16374 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.194s	user 0.018s	sys 0.021s
I20260709 12:11:28.458765 16363 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.507125 11869 rpcz_store.cc:276] 0709 12:11:26.797463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.797679 (+   216us) service_pool.cc:224] Handling call
0709 12:11:26.810614 (+ 12935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.818594 (+  7980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.818634 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.833390 (+ 14756us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.029942 (+196552us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.033017 (+  3075us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.576801 (+543784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.576915 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.780175 (+203260us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:28.484006 (+703831us) raft_consensus.cc:1685] finished
0709 12:11:28.489779 (+  5773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.489967 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559076,"prepare.queue_time_us":2471,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":586188,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":20933,"spinlock_wait_cycles":31459584,"thread_start_us":159576,"threads_started":1,"wal-append.queue_time_us":231229}
W20260709 12:11:28.500896 16558 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 12:11:28.499328 16415 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:28.496167 16372 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:28.469630 16299 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.499526 16361 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:28.503217 16289 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:28.538142 16410 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:28.551169 16415 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.543242 16016 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.578802 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2686) took 1130 ms. Trace:
I20260709 12:11:28.562445 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2065) took 1209 ms. Trace:
I20260709 12:11:28.539989 16575 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.579295 12014 rpcz_store.cc:276] 0709 12:11:27.448223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.448371 (+   148us) service_pool.cc:224] Handling call
0709 12:11:27.449071 (+   700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.449631 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.449671 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.450951 (+  1280us) log.cc:844] Serialized 564 byte log entry
0709 12:11:27.757414 (+306463us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.757479 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.757622 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.578523 (+820901us) raft_consensus.cc:1685] finished
0709 12:11:28.578545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.578725 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":305982,"threads_started":1,"wal-append.queue_time_us":398608}
I20260709 12:11:28.628841 11869 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:28.506494 16355 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:28.569430 16566 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.392s	user 0.001s	sys 0.001s
I20260709 12:11:28.568264 16583 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.584614 11945 rpcz_store.cc:276] 0709 12:11:27.352737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.353467 (+   730us) service_pool.cc:224] Handling call
0709 12:11:27.369446 (+ 15979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.369984 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.370027 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.370688 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.494554 (+123866us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.064818 (+570264us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.561975 (+497157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.562096 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.562163 (+    67us) raft_consensus.cc:1685] finished
0709 12:11:28.562181 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.562358 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64742,"prepare.queue_time_us":597745,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":48118,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":33658,"thread_start_us":1019077,"threads_started":3,"wal-append.queue_time_us":281278}
I20260709 12:11:28.545224 16363 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.582955 16410 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.554165 16372 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.695200 12014 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:28.696229 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 55027.7us
I20260709 12:11:28.699690 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:28.631899 16016 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:28.708235 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 204414us
I20260709 12:11:28.631565 16518 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:28.725948 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.667s (SENT) [suppressed 38 similar messages]
I20260709 12:11:28.690786 16575 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.701340 16578 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.768456 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2583) took 1344 ms. Trace:
W20260709 12:11:28.770905 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 71336us
I20260709 12:11:28.786142 11865 rpcz_store.cc:276] 0709 12:11:27.423738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.425649 (+  1911us) service_pool.cc:224] Handling call
0709 12:11:27.426377 (+   728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.426875 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.426911 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.440999 (+ 14088us) log.cc:844] Serialized 564 byte log entry
0709 12:11:27.789994 (+348995us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.834009 (+ 44015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.834101 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.768174 (+934073us) raft_consensus.cc:1685] finished
0709 12:11:28.768201 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.768374 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":348651,"threads_started":1,"wal-append.queue_time_us":666381}
I20260709 12:11:28.638573 16501 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:28.688827 16409 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:11:28.709440 16410 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.701459 16289 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.810103 16577 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.802587 16578 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.819437 16577 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.820996 16578 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:28.689891 16361 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.780515 16575 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.796180 16497 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:28.706360 16583 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.842983 16591 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:28.862035 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 64863.9us
I20260709 12:11:28.823240 16584 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.816429 16586 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:28.833602 16138 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.828905 16590 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.907868 16575 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:28.849390 16571 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.315s	user 0.000s	sys 0.002s
I20260709 12:11:28.895655 16299 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:28.870153 16515 consensus_meta.cc:287] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.055s	user 0.013s	sys 0.003s
W20260709 12:11:28.896085 16563 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:11:28.896577 16374 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:28.897017 16372 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:28.910274 16463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.000s	sys 0.028s
W20260709 12:11:28.898787 16564 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
I20260709 12:11:28.899037 16363 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:28.872133 16289 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.899142 16138 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.900588 16606 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:28.900684 16603 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:28.890677 16584 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.902442 16585 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:28.891580 16547 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:28.814867 16016 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:11:28.863257 16361 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.805629 16501 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.863152 16543 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:28.948411 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 83365.3us
W20260709 12:11:28.897130 16570 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:11:28.961820 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:28.982589 12610 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:28.960453 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:28.958523 16463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.000s	sys 0.029s
I20260709 12:11:28.850346 16497 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:28.949368 16595 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:28.989692 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:28.891366 16591 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:11:28.941057 16299 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:28.964804 16579 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:11:28.916611 16577 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:28.965243 16549 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:11:28.944752 16515 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:28.984022 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 879) took 1383 ms. Trace:
I20260709 12:11:28.891319 16586 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:28.968544 16538 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.002s
I20260709 12:11:28.977056 16016 consensus_queue.cc:1243] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:28.973526 16606 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.014227 11946 rpcz_store.cc:276] 0709 12:11:27.600532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.634847 (+ 34315us) service_pool.cc:224] Handling call
0709 12:11:27.652604 (+ 17757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.654526 (+  1922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.654566 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.664283 (+  9717us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.065430 (+401147us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.065470 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.065574 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.983762 (+918188us) raft_consensus.cc:1685] finished
0709 12:11:28.983786 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.983946 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":400678,"threads_started":1,"wal-append.queue_time_us":1038074}
I20260709 12:11:28.980180 16583 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.019259 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2684) took 1597 ms. Trace:
I20260709 12:11:28.986773 16543 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.021804 12016 rpcz_store.cc:276] 0709 12:11:27.421751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.421927 (+   176us) service_pool.cc:224] Handling call
0709 12:11:27.422356 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:27.441494 (+ 19138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.441527 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:27.469456 (+ 27929us) log.cc:844] Serialized 52 byte log entry
0709 12:11:27.887491 (+418035us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:27.887551 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.887651 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.018942 (+1131291us) raft_consensus.cc:1685] finished
0709 12:11:29.018975 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.019173 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18612,"raft.queue_time_us":35498,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":23439,"thread_start_us":288466,"threads_started":1,"wal-append.queue_time_us":1180181}
I20260709 12:11:29.030571 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 878) took 1430 ms. Trace:
I20260709 12:11:29.031162 11941 rpcz_store.cc:276] 0709 12:11:27.600178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.604452 (+  4274us) service_pool.cc:224] Handling call
0709 12:11:27.604785 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.653926 (+ 49141us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:27.653964 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.689112 (+ 35148us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.118665 (+429553us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.118877 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.119335 (+   458us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.030279 (+910944us) raft_consensus.cc:1685] finished
0709 12:11:29.030309 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.030492 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67482,"raft.queue_time_us":56304,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":24872,"thread_start_us":407445,"threads_started":1,"wal-append.queue_time_us":860759}
I20260709 12:11:29.032537 16583 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.033002 16589 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.033072 16583 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.033746 16589 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.035713 16583 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.036006 16589 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.036247 16583 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.036808 16583 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.015242 16580 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.037758 16577 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.038187 12016 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:29.038247 16577 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.040634 16577 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.041129 16577 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.041353 16600 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:29.055490 16580 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:29.055860 16577 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.056253 16580 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.056962 16581 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.057605 16581 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.058336 16577 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.046417 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:29.059168 16580 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.059441 11872 raft_consensus.cc:2410] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:29.059803 16581 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.060429 16581 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.060614 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.060876 16581 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.047565 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.041988 16588 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.049031 11869 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:29.046999 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.016619 16299 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.061378 11872 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:29.062467 16487 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.113137 11873 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:29.064363 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.113991 11870 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.114945 16581 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.066047 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2064) took 1738 ms. Trace:
I20260709 12:11:29.115447 11939 rpcz_store.cc:276] 0709 12:11:27.328131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.328390 (+   259us) service_pool.cc:224] Handling call
0709 12:11:27.328919 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:27.359227 (+ 30308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.359276 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:27.368054 (+  8778us) log.cc:844] Serialized 52 byte log entry
0709 12:11:27.767735 (+399681us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:27.767804 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.767929 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.065807 (+1297878us) raft_consensus.cc:1685] finished
0709 12:11:29.065829 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.065988 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32240,"raft.queue_time_us":30589,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":8400,"thread_start_us":259584,"threads_started":1,"wal-append.queue_time_us":1620957}
I20260709 12:11:29.119365 12016 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:29.122112 16588 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.124433 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.126531 16588 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.125823 16547 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 6 to 9, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:29.030884 16543 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.068099 16583 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.068436 12018 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:29.068536 12013 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:29.131664 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.132295 16543 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.063868 16610 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.076025 16515 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.073364 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:29.077293 16597 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:29.133402 11866 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.133185 16610 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.078919 16497 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:28.987968 16585 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.135594 11866 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.135671 16610 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.136066 16585 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.111764 16355 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.136067 11866 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:29.082713 16584 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.084128 16485 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.017767 16595 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.137442 16485 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:29.137625 11866 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.138723 11866 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.138440 16485 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.139087 16595 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.139817 16485 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.139087 16299 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.085925 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.087366 16586 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.087709 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:29.089028 16582 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.546s	user 0.001s	sys 0.000s
W20260709 12:11:29.092408 16513 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.311s	user 0.007s	sys 0.007s
I20260709 12:11:29.087709 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.141621 16513 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.142213 12602 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:29.095317 12603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 508) took 1635 ms. Trace:
W20260709 12:11:29.143345 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.143965 16513 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.144029 16581 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.144634 16513 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.144707 16581 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:29.096338 16486 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.307s	user 0.011s	sys 0.003s
I20260709 12:11:29.096884 16276 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.146293 16276 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.146247 16486 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.147445 11872 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:29.142987 12603 rpcz_store.cc:276] 0709 12:11:27.460463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.460639 (+   176us) service_pool.cc:224] Handling call
0709 12:11:27.461023 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.796151 (+335128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.095010 (+1298859us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54006702d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:29.095246 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769048320}
I20260709 12:11:29.148499 16486 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.148878 16016 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.149417 16016 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.100247 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.153123 12022 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.124270 16487 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.132452 12013 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:29.069133 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.080643 16138 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:28.978987 16603 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.147432 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.159406 11865 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.022663 16538 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.105850 16410 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.161614 16372 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:29.169449 16603 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.160861 16460 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:29.151957 12602 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.174863 16460 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.068265 16606 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.065330 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.177191 16460 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.151731 11869 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:29.157572 12610 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.174153 16538 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:29.156399 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56693us
W20260709 12:11:29.108042 16516 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.014s	user 0.015s	sys 0.001s
I20260709 12:11:29.156616 12019 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.185613 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.188439 12602 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:29.161051 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 411648us
I20260709 12:11:29.187124 11873 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.192272 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.145267 16513 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:29.193838 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 468082us
I20260709 12:11:29.194482 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:29.197067 12577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.008s	sys 0.007s
W20260709 12:11:29.199483 12577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.008s	sys 0.007s
W20260709 12:11:29.199664 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.189841 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:29.200085 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 703283us
I20260709 12:11:29.208474 11866 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:29.209080 11866 pending_rounds.cc:85] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:29.209427 11866 pending_rounds.cc:107] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:29.209793 11866 raft_consensus.cc:2889] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.162216 16587 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.212467 11912 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.215126 11839 leader_election.cc:400] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8.
I20260709 12:11:29.215523 11839 leader_election.cc:403] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.216780 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.218689 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.219936 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.219395 11941 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:29.111337 16501 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.223740 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.224879 11945 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:29.226389 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:29.230798 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.236529 12013 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.236796 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:29.237885 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.232228 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.234020 11872 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:29.239534 11872 pending_rounds.cc:85] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:29.234323 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.233951 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:29.239955 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.240083 11868 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:29.236538 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.240137 11866 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 8.
I20260709 12:11:29.234565 11871 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.241003 12014 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:29.241875 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.242450 11943 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:29.239799 11872 pending_rounds.cc:107] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:29.243494 11872 raft_consensus.cc:2889] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.244822 16533 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.200266 16364 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.245015 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.240049 11867 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:29.245724 11946 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:29.241343 11871 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:29.250018 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.250887 11942 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:29.253836 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:29.253815 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1831573459999163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:11:29.255055 11839 connection.cc:256] RPC call timeout handler was delayed by -2.1638728429998082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:11:29.255158 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.267040 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.267839 12019 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:29.268682 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.271687 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.271878 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.274067 12014 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 6.
I20260709 12:11:29.275187 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.203606 16529 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.276432 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:29.277134 12014 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.277740 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8814143059998969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 12:11:29.278172 11839 connection.cc:256] RPC call timeout handler was delayed by -1.8108721319997585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:11:29.278520 11839 connection.cc:256] RPC call timeout handler was delayed by -1.540175569999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:11:29.278810 11839 connection.cc:256] RPC call timeout handler was delayed by -1.5329755699999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:11:29.279093 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1601721319998433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2788s for a response
W20260709 12:11:29.279361 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0514755700000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
I20260709 12:11:29.273264 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:29.279676 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0424755700000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2283s for a response
I20260709 12:11:29.279542 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.280682 16619 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.280869 16612 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.282094 12013 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:29.222759 16515 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.161702 16415 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.223295 16496 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.200404 16497 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:11:29.240492 16603 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.249658 16486 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:29.286290 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.294356 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.249473 16533 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.238435 16538 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 7. Current term is 8.
W20260709 12:11:29.287734 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47861.8us
I20260709 12:11:29.201789 16374 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:29.288302 11942 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:11:29.289147 12577 connection.cc:256] RPC call timeout handler was delayed by -1.462316865000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:11:29.197556 16516 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.239329 16606 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.294100 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.253144 16364 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.303427 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:29.304560 12577 connection.cc:256] RPC call timeout handler was delayed by -1.4277587349999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:11:29.308830 12577 connection.cc:256] RPC call timeout handler was delayed by -1.1721587350000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:11:29.312420 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:29.281898 16580 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.311514 16496 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.320247 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.302575 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.315853 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.321976 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.291934 16016 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.295521 16497 consensus_queue.cc:1243] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:29.330448 11864 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:29.285714 16612 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.284077 16515 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:29.296597 16310 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.322276 12019 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 5.
I20260709 12:11:29.226468 16587 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.332515 11870 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:29.295790 16486 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.334017 16585 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.330189 12602 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 6 to 9, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:29.313151 16364 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.345022 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.292719 16372 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:29.347772 12014 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:29.301630 16533 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.324357 16496 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.362571 16541 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.363147 16541 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:29.363708 16541 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.325547 16594 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.366091 16594 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.320845 16581 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.369999 16594 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.343976 16310 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.375792 16310 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.338737 16515 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.281289 16619 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.311802 16549 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:11:29.392995 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 81710.5us
W20260709 12:11:29.395557 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72726.7us
I20260709 12:11:29.358942 16486 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:29.334224 16595 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.334193 16590 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.343483 16586 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.408298 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.306560 16603 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.359688 16585 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.464287 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:29.319345 16606 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.422154 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:29.342195 16016 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:11:29.289778 16529 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.407207 16595 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.324296 16580 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.340608 16593 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.466427 11943 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:29.461673 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66556us
W20260709 12:11:29.420948 11986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.009s	sys 0.026s
I20260709 12:11:29.474958 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.491356 11941 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
W20260709 12:11:29.492625 11986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.010s	sys 0.026s
I20260709 12:11:29.496661 16583 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.497761 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:29.462515 16586 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.499280 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:29.502381 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:29.500370 16583 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.505828 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.470634 16585 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:29.508199 16289 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.004s
I20260709 12:11:29.514791 11939 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:29.468330 16410 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.514467 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.516613 12019 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:29.518134 11943 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:29.519961 11945 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:29.481381 16595 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.491562 16593 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:29.516599 16586 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.546088 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.500756 16513 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.460080 16607 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:11:29.571491 12019 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: [7.5-11.7]
I20260709 12:11:29.573501 12019 raft_consensus.cc:1217] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-11.6]   Dedup: 7.4->[10.5-11.6]
I20260709 12:11:29.574462 12019 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: [7.4-11.6]
I20260709 12:11:29.471434 16590 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.514118 16589 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.501211 16487 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.585600 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:29.564235 16593 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.520840 16410 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:29.604876 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 166697us
I20260709 12:11:29.582026 16415 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.594404 16589 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.597354 16487 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:29.595171 16436 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:29.653458 11838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.015s
I20260709 12:11:29.603849 16299 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:29.653759 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68306.7us
I20260709 12:11:29.640636 16516 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.691124 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 874) took 2810 ms. Trace:
I20260709 12:11:29.691859 11947 rpcz_store.cc:276] 0709 12:11:26.872956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.873441 (+   485us) service_pool.cc:224] Handling call
0709 12:11:26.888196 (+ 14755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.797021 (+908825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.797056 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:27.797134 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:27.797174 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.682518 (+1885344us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002b3754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:29.682572 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.682712 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":116,"spinlock_wait_cycles":2089260288}
I20260709 12:11:29.647800 16618 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.661608 16612 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.647042 16589 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.712391 16606 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.713581 16618 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.664810 16529 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.669356 16364 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:29.670898 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.015s
I20260709 12:11:29.605468 16584 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:11:29.650465 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 134855us
W20260709 12:11:29.656810 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 368288us
I20260709 12:11:29.701529 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.717811 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:29.718870 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.716595 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.720988 12016 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:29.670782 16068 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.722021 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:29.722569 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.722931 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:29.727573 12016 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.672194 16366 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:29.736672 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:29.737306 12016 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:11:29.738301 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.740355 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:29.671932 16436 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.728430 16516 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.727361 16068 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:29.737746 16529 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.738431 16415 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.764582 16068 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.716728 16496 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:29.802662 16565 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.028s	user 0.008s	sys 0.000s
I20260709 12:11:29.736292 16446 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.804229 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2676) took 2399 ms. Trace:
W20260709 12:11:29.764392 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 108568us
I20260709 12:11:29.691496 16299 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.804652 12017 rpcz_store.cc:276] 0709 12:11:27.404787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.405375 (+   588us) service_pool.cc:224] Handling call
0709 12:11:27.405923 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.406367 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.406432 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.500916 (+ 94484us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.920373 (+419457us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.920438 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.920514 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.802001 (+1881487us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:29.803799 (+  1798us) raft_consensus.cc:1685] finished
0709 12:11:29.803829 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.804130 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35056,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9089,"spinlock_wait_cycles":23624960,"thread_start_us":270970,"threads_started":1,"wal-append.queue_time_us":1005839}
I20260709 12:11:29.806752 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.804245 16446 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:29.807955 16620 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:11:29.809374 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2693) took 1115 ms. Trace:
I20260709 12:11:29.809770 12015 rpcz_store.cc:276] 0709 12:11:28.693938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.694064 (+   126us) service_pool.cc:224] Handling call
0709 12:11:28.724745 (+ 30681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.862582 (+137837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.862631 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.875800 (+ 13169us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.187304 (+311504us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.187367 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.187468 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.809149 (+621681us) raft_consensus.cc:1685] finished
0709 12:11:29.809175 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.809307 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7637,"raft.queue_time_us":290668,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7928,"thread_start_us":414511,"threads_started":2,"wal-append.queue_time_us":657614}
I20260709 12:11:29.811585 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:29.807458 16299 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.729846 16549 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:11:29.806814 16583 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.751940 16460 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.751602 16485 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.751727 16538 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.746978 16603 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.812726 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:29.736503 16366 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.792629 16529 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.727695 16487 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.755551 16497 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:11:29.772665 16580 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.848570 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.831760 16549 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:29.853770 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.868943 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.831959 16460 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:29.879788 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:29.883762 16629 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:11:29.883968 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.884729 12605 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:29.773908 16516 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.884169 16590 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.837759 16619 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.849315 16529 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:29.871044 16361 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.889s	user 0.007s	sys 0.007s
I20260709 12:11:29.899763 16068 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.900602 16364 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.900477 16533 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.902206 16068 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.902669 16533 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.902616 16486 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.853941 16617 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:29.890183 16628 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:11:29.903810 16617 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:29.904945 16486 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:29.904779 16617 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:29.892030 16276 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.007s
I20260709 12:11:29.874927 16487 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.893985 16541 consensus_meta.cc:287] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 12:11:29.886492 16460 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:29.894681 16547 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.002s
I20260709 12:11:29.895965 16446 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.887663 16618 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.930099 16446 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.931872 16586 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:29.934271 16587 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:29.934657 16516 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:29.934244 16586 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:29.926497 16624 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:11:29.941418 16633 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:11:29.947137 16622 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.240s	user 0.004s	sys 0.002s
W20260709 12:11:29.947944 16613 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 12:11:29.952083 16589 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:29.997726 11771 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.003952 11771 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 5 to 11, now has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:11:30.013043 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 272505us
I20260709 12:11:30.106984 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:30.016870 11872 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.037683 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.039826 11945 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:30.111790 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.112191 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.040117 11940 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: [7.5-11.7]
I20260709 12:11:30.113526 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.114804 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.115677 11940 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:30.117966 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:30.044871 11871 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.119675 11871 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.049060 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.053357 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.051855 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.056370 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.056821 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:30.123867 11946 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:30.124852 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 68472us
I20260709 12:11:30.113305 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:30.060994 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 321824us
I20260709 12:11:30.064594 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:30.067713 12014 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.136793 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.080793 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.068511 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2599) took 1510 ms. Trace:
I20260709 12:11:30.142621 11864 rpcz_store.cc:276] 0709 12:11:28.558065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.558447 (+   382us) service_pool.cc:224] Handling call
0709 12:11:28.579802 (+ 21355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.336402 (+756600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.061359 (+724957us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54002f6554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:30.068177 (+  6818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715902208}
I20260709 12:11:30.085620 12017 raft_consensus.cc:1217] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-12.6]   Dedup: 7.4->[10.5-12.6]
I20260709 12:11:30.040730 11947 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:30.145015 12017 pending_rounds.cc:85] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 4
I20260709 12:11:30.145340 12017 pending_rounds.cc:107] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:30.145661 12017 raft_consensus.cc:2889] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.078423 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2704) took 1010 ms. Trace:
I20260709 12:11:30.140353 11771 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.146292 12020 rpcz_store.cc:276] 0709 12:11:29.067328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.070747 (+  3419us) service_pool.cc:224] Handling call
0709 12:11:29.071370 (+   623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.072036 (+   666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.072071 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:29.073279 (+  1208us) log.cc:844] Serialized 590 byte log entry
0709 12:11:29.598515 (+525236us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:29.599736 (+  1221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.599857 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.705641 (+105784us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b1800447220. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:29.946479 (+240838us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:30.077768 (+131289us) raft_consensus.cc:1685] finished
0709 12:11:30.077812 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.078157 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2012,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":203167360,"thread_start_us":494280,"threads_started":1,"wal-append.queue_time_us":633114}
I20260709 12:11:30.142625 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.150235 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.151453 11771 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 8 to 9, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 9 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.167052 11771 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 11, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.173523 12020 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:30.175046 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.191980 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.194006 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.196333 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.199498 16068 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.200585 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:29.905350 16138 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Committing config change with OpId 8.6: config changed from index 4 to 6, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.219596 16294 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:30.220203 16294 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:30.220636 16310 consensus_meta.cc:287] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.844s	user 0.016s	sys 0.002s
I20260709 12:11:30.221316 16310 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.226552 16310 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.183550 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.183671 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.232923 16294 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.183928 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:30.180755 11769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 174) took 19735 ms (client timeout 15000 ms). Trace:
I20260709 12:11:30.203838 16366 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:30.204576 16276 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.205848 12610 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 4 to 6, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.236675 16366 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.237950 11865 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:30.239144 16366 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.239583 16366 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:30.209327 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.211547 16016 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.242748 16016 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:30.243546 16016 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:30.244230 16016 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.247000 16276 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.237818 16294 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.212126 16372 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:30.179966 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.181886 12601 tablet_service.cc:1558] Processing DeleteTablet for tablet cbba5e6f295144a79461c5afc2e273ae with delete_type TABLET_DATA_TOMBSTONED (TS 189a165e6619406382914fe3075dd436 not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:36802
I20260709 12:11:30.223127 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.226934 16361 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.231812 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.182192 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.200374 16068 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.239951 16366 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.255991 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:30.216760 16289 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:30.266455 16361 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:30.311342 16361 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.313417 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.314373 12602 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.316582 16410 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.335038 11871 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:30.344158 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.335543 11871 pending_rounds.cc:85] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 5
I20260709 12:11:30.345395 11871 pending_rounds.cc:107] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:30.345731 11871 raft_consensus.cc:2889] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:30.341918 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 210160us
W20260709 12:11:30.352591 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 161006us
I20260709 12:11:29.926395 16541 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.308315 16589 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.379495 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2711) took 1227 ms. Trace:
I20260709 12:11:30.380146 12018 rpcz_store.cc:276] 0709 12:11:29.121116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.132359 (+ 11243us) service_pool.cc:224] Handling call
0709 12:11:29.132736 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.158263 (+ 25527us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:29.640286 (+482023us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.715410 (+ 75124us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b18000c8da0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:29.791780 (+ 76370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.069099 (+277319us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.069356 (+   257us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:30.069804 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.070216 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.070389 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.342206 (+271817us) raft_consensus.cc:1685] finished
0709 12:11:30.342235 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.348502 (+  6267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25123,"prepare.queue_time_us":223238,"prepare.run_cpu_time_us":176,"prepare.run_wall_time_us":13598,"raft.queue_time_us":202797,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":25892,"spinlock_wait_cycles":17025792,"thread_start_us":555998,"threads_started":2,"wal-append.queue_time_us":269276}
I20260709 12:11:30.385826 11771 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.389946 16586 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.390654 16586 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.391214 16586 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.392800 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:30.394124 16246 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.395165 16576 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:30.397655 16587 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.398214 16587 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:30.399917 16587 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.363125 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:30.401506 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2628) took 1168 ms. Trace:
I20260709 12:11:30.358422 16016 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.395614 16246 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:30.402658 11871 rpcz_store.cc:276] 0709 12:11:29.233351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.234188 (+   837us) service_pool.cc:224] Handling call
0709 12:11:29.234439 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.043472 (+809033us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4c00127a40. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f19cffa20 00007f1f19d10a29 00007f1f19cd6644 00007f1f19cfdf2d 00007f1f19cfdb93 00007f1f1ba2e18b 00007f1f1ba2ecb5 00007f1f1ba29f30 00007f1f1ba2b7de 00007f1f1ba35b49 00007f1f1ba36416
0709 12:11:30.375737 (+332265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.401425 (+ 25688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3502976}
I20260709 12:11:30.388808 11771 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 4 to 5, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 5 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:30.397300 16515 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.013s	user 0.004s	sys 0.008s
I20260709 12:11:30.420647 16246 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:30.361799 16289 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:30.447250 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.445333 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 316015us
I20260709 12:11:30.455276 16587 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.245967 11769 rpcz_store.cc:269] 0709 12:11:10.450035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.450295 (+   260us) service_pool.cc:224] Handling call
0709 12:11:30.180490 (+19730195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:20.178144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:20.178840 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:20.178898 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:11:20.178927 (+    29us) tablet.cc:662] Decoding operations
0709 12:11:20.179760 (+   833us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:20.179872 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:20.179904 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:11:20.180618 (+   714us) tablet.cc:701] Row locks acquired
0709 12:11:20.180674 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:11:20.181093 (+   419us) write_op.cc:270] Start()
0709 12:11:20.181250 (+   157us) write_op.cc:276] Timestamp: P: 1783599080180828 usec, L: 0
0709 12:11:20.181289 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:11:20.412434 (+231145us) log.cc:844] Serialized 2340 byte log entry
0709 12:11:21.571191 (+1158757us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f189290ac 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b
0709 12:11:21.915111 (+343920us) op_driver.cc:464] REPLICATION: finished
0709 12:11:22.138181 (+223070us) write_op.cc:301] APPLY: starting
0709 12:11:22.151587 (+ 13406us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:22.289455 (+137868us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:22.299506 (+ 10051us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:22.807787 (+508281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:22.808121 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=5,key_file_lookups=5,delta_file_lookups=0,mrs_lookups=10
0709 12:11:22.808181 (+    60us) write_op.cc:312] APPLY: finished
0709 12:11:22.808600 (+   419us) log.cc:844] Serialized 77 byte log entry
0709 12:11:22.808857 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.809090 (+   233us) write_op.cc:454] Released schema lock
0709 12:11:22.809164 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:22.847339 (+ 38175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.849243 (+  1904us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280409,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":201713,"apply.run_cpu_time_us":18148,"apply.run_wall_time_us":692353,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":1038,"lbm_reads_lt_1ms":8,"num_ops":5,"prepare.queue_time_us":172918,"prepare.run_cpu_time_us":26320,"prepare.run_wall_time_us":1575636,"raft.queue_time_us":124461,"raft.run_cpu_time_us":80136,"raft.run_wall_time_us":123313,"replication_time_us":1715178,"spinlock_wait_cycles":16280320,"thread_start_us":1564059,"threads_started":4,"wal-append.queue_time_us":1235232,"wal-append.run_cpu_time_us":10383,"wal-append.run_wall_time_us":2123659}]]}
I20260709 12:11:30.458429 16246 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.460330 16246 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.461622 16583 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.461861 16228 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:30.462270 16583 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:30.462852 16583 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.465636 16513 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.466272 16591 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.466621 16636 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.467195 16636 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.467634 16636 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.467041 16591 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.440479 16515 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.473933 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.474794 11771 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.491304 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:30.493681 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 314074us
W20260709 12:11:30.494621 16585 consensus_meta.cc:287] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.987s	user 0.003s	sys 0.009s
I20260709 12:11:30.495325 16585 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.497077 12021 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.498039 16543 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.498544 16543 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.498919 16543 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.500984 16436 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:30.503161 16541 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.503954 16541 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:30.504263 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 174734us
I20260709 12:11:30.505609 11771 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.507263 16289 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.510179 16068 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.508734 11771 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.526115 12602 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:30.504683 16541 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:30.572561 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.573364 16644 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 12:11:30.579164 16496 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:30.581630 16561 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 12:11:30.585855 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:30.582630 16614 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:30.585793 16619 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:30.586086 16617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.002s	sys 0.032s
W20260709 12:11:30.588477 11756 catalog_manager.cc:5002] TS 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): delete failed for tablet cbba5e6f295144a79461c5afc2e273ae because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 4 but the committed config has opid_index of 6
W20260709 12:11:30.588663 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 229752us
I20260709 12:11:30.568228 11771 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 3 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.600266 16016 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.622735 16617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.002s	sys 0.033s
I20260709 12:11:30.636937 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.640913 16618 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.641768 16618 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.642966 11868 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.644217 16618 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:30.645747 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.646631 16529 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.723s	user 0.002s	sys 0.010s
I20260709 12:11:30.647230 16529 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.649048 12606 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:30.649634 16589 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.653810 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.653667 16619 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.654507 11866 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.645473 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.664912 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:30.664423 16593 consensus_meta.cc:287] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.024s	user 0.017s	sys 0.000s
I20260709 12:11:30.670346 16516 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.671144 16516 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.672686 16541 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.673668 16585 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.666833 16513 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.675448 16513 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.677799 16487 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.678375 16487 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.678679 16246 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:30.679666 16246 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:30.680052 16246 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:30.680774 16487 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.662645 16016 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.683619 16016 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.683676 16361 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.684509 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:30.685436 16585 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.686045 16585 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.640846 16608 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.687220 16608 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.688174 16585 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:30.689946 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.691082 11868 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:30.691792 11867 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:30.692196 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.693013 11865 raft_consensus.cc:2410] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:30.692951 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.693490 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.694307 11872 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:30.694178 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.694317 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.695111 11871 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.695286 11943 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.689452 11946 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.694823 11868 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:30.695309 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:30.701447 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50711.7us
I20260709 12:11:30.721769 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.628916 11771 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 4, term changed from 7 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added, no longer has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.726696 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.685191 16586 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.723189 11864 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:11:30.733754 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.729761 11870 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:30.727576 11912 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:30.703032 16529 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.681177 16246 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.740844 16619 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.736073 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:30.741145 16487 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.741815 16513 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.744270 16591 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.745364 16608 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.704185 16593 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.726217 16516 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.739538 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.751040 11771 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.754171 11866 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:30.758023 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.755981 11946 raft_consensus.cc:606] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:30.749437 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.761771 11944 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.750277 16361 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:30.767987 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 44432.2us
I20260709 12:11:30.768618 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.770012 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.770191 16246 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.775274 16392 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:30.777493 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.777925 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.778304 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.778589 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.768288 16541 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:30.794531 11864 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:30.779125 16436 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:30.779888 11867 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:11:30.768687 16515 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.780215 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:30.780714 11870 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:30.797678 16366 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.782143 16586 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:30.782426 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 903) took 1130 ms. Trace:
W20260709 12:11:30.783295 16663 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:11:30.761324 16487 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.799998 12016 rpcz_store.cc:276] 0709 12:11:29.652021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.738502 (+ 86481us) service_pool.cc:224] Handling call
0709 12:11:29.738808 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.739158 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.739186 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.063559 (+324373us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.307666 (+244107us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:30.307709 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.335065 (+ 27356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.782088 (+447023us) raft_consensus.cc:1685] finished
0709 12:11:30.782109 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.782249 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14038,"raft.queue_time_us":7555,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":14492,"thread_start_us":242989,"threads_started":1,"wal-append.queue_time_us":701488}
I20260709 12:11:30.782150 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.801957 11873 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:30.803227 16487 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.784017 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.804700 11868 raft_consensus.cc:2410] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:30.764127 16608 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.805945 16608 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.808535 11872 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:30.810354 16593 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.810534 16541 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:30.812007 11865 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 6.
I20260709 12:11:30.812119 16541 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.790112 11869 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:30.814122 16530 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.787685 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.788066 11871 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:30.819902 11866 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:30.823895 16016 raft_consensus.cc:2764] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:30.808753 16608 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:30.835043 11939 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.835139 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.833622 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.810369 16392 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.800004 16366 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:30.834921 16595 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.262s	user 0.007s	sys 0.013s
I20260709 12:11:30.767290 16636 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.839614 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.839555 16392 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:30.838807 11948 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:30.847561 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.850577 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.851579 11871 raft_consensus.cc:2393] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:30.854789 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.858481 12610 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:30.860879 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:30.861001 16460 consensus_meta.cc:287] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.008s
I20260709 12:11:30.861923 16460 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.863998 16460 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:30.868089 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.876377 11947 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.877781 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.878903 11869 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:30.884172 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628666a2024d4a61831835e7dee5737a"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:30.859334 12016 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 6 to 9, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.885552 16586 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.891891 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:30.934158 12014 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:30.892642 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:30.893070 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.893481 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:30.895684 16636 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:30.896461 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.897149 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.898739 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.898290 11870 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 4 to 6, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:30.935170 11865 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.935329 11868 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.899926 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.900358 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:30.901486 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.851230 16595 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.902069 16617 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:30.902240 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.938601 11939 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:30.906752 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.909165 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.909281 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:30.909334 16356 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:30.909929 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:30.942262 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.911177 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.877056 16366 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:30.911060 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.898312 11866 pending_rounds.cc:85] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 4
I20260709 12:11:30.911602 16228 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:30.912777 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:30.916311 16543 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.920190 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.920883 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.921558 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.950345 12017 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.921554 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.925700 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.929797 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:30.931986 11943 raft_consensus.cc:606] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:30.899473 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.936182 11864 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:11:30.942835 12019 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.938511 11867 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.933777 16586 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:30.881155 16583 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:30.948541 11866 pending_rounds.cc:107] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:30.954900 11866 raft_consensus.cc:2889] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.953485 11869 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:30.961027 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:30.962570 11866 pending_rounds.cc:107] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:30.962927 11866 raft_consensus.cc:2889] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.966465 11873 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.955133 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:30.969101 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.976168 11940 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.976904 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:30.977797 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:30.980820 12013 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:30.989423 11864 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:30.993249 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:30.972604 16619 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.017426 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:31.017693 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.018111 11869 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:31.020143 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.020866 11871 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:11:31.022157 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.024876 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:31.025732 12013 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:31.026639 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:31.022213 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:31.031013 11942 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:30.964953 16392 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.042490 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.043531 12020 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:31.044073 12019 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:31.044950 11940 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:31.047112 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.042475 11872 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:31.051159 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:31.092226 16583 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.051471 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.093086 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:31.093856 11871 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:31.094177 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.094692 16446 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.094805 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:31.090839 16593 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.095410 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.096081 11864 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:31.096196 16593 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.094799 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.101783 11871 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 5.
I20260709 12:11:31.092953 16436 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.104529 11867 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:31.050940 12015 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.098737 11868 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:31.051440 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:31.075487 12017 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:31.105607 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.105976 11941 raft_consensus.cc:606] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:31.062888 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.106901 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.109249 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.109323 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.110522 11867 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:31.103479 11869 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:31.117112 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.118294 11868 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:31.118384 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:31.117576 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 75630.5us
I20260709 12:11:31.107443 11872 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:31.009656 16366 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.120811 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.125686 16583 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.062664 16228 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.123916 16294 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.079734 16543 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.122246 11864 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:31.016317 16585 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:11:31.139190 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.125031 16374 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:31.055613 16595 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.104799 16446 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.100766 16593 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.188007 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.141880 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:31.134421 11869 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:31.144196 11871 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:31.146535 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:31.174302 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.104249 16436 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.195559 16436 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.197012 16436 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.126055 16138 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:31.200730 16294 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.201184 16294 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.202142 16374 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.202572 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:31.048482 16496 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:11:31.188197 16446 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.193085 16593 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.194515 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.216566 11871 raft_consensus.cc:2376] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10. Re-sending same reply.
I20260709 12:11:31.217628 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.218012 16366 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:31.218192 11871 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.218766 11868 raft_consensus.cc:2393] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:31.219684 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.220232 11868 raft_consensus.cc:2376] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10. Re-sending same reply.
I20260709 12:11:31.221004 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.185097 11867 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:31.202745 16589 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.215085 16446 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:31.185875 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.204948 16529 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:31.223289 11868 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:31.224217 11865 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:31.236097 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.236682 11869 raft_consensus.cc:2376] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12. Re-sending same reply.
I20260709 12:11:31.138499 16583 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.141355 16228 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.208524 16659 raft_consensus.cc:993] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:31.237627 12020 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:31.193378 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.256013 11864 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:31.251933 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.257294 11868 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:31.258373 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.259073 11868 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:31.261152 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.261785 11869 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.202582 16374 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.255048 11871 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:31.263962 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.254894 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.252498 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.265913 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.229804 16589 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.271442 11867 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:31.253686 16583 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.235888 16529 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:31.281239 16602 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 12:11:31.283982 16589 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.285674 16589 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.290086 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 905) took 1590 ms. Trace:
I20260709 12:11:31.290518 12015 rpcz_store.cc:276] 0709 12:11:29.701081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.812427 (+111346us) service_pool.cc:224] Handling call
0709 12:11:29.843699 (+ 31272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.120485 (+1276786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.289773 (+169288us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002689d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:31.290026 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543227776}
I20260709 12:11:31.292259 16294 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.296028 11873 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:31.301198 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.294121 16587 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.302567 16587 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:31.303521 16587 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.304378 16593 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.304757 16587 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.263159 16460 raft_consensus.cc:1081] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:31.264650 16366 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.318135 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.318971 11864 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.319938 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.322325 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.264984 11872 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.310226 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.324935 11873 raft_consensus.cc:2410] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:31.326763 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:31.327801 11865 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:31.310711 16228 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:31.314013 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 167569us
I20260709 12:11:31.209360 16530 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:11:31.270418 16446 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.331686 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:31.307534 16529 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.264500 16586 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:31.346331 11865 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.348768 11873 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:31.343344 11871 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:31.353274 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:11:31.353555 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.355209 11865 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:31.360455 16374 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.361922 16374 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.364471 11873 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:31.364856 11873 pending_rounds.cc:85] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 5
I20260709 12:11:31.365093 11873 pending_rounds.cc:107] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:31.365302 11873 raft_consensus.cc:2889] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.369747 11867 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:31.371286 11867 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:31.371732 16228 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.372259 16392 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.373850 16361 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:31.374310 16361 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.374408 16294 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.375229 16361 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.380295 11864 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:31.395251 16016 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.401839 16016 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.408900 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:31.410120 16016 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.416494 11867 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.417415 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:31.418608 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.421190 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:31.430158 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:31.430992 11945 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:31.436734 11869 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:31.442848 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:31.435596 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:31.444609 11942 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:31.444901 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:31.446527 12016 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:11:31.446789 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:31.450023 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:31.427040 16617 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.447633 11943 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:31.457751 11986 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:31.461804 12014 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.463104 11986 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:31.452629 16595 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.469967 11947 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.472772 11946 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:31.452961 16617 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.464699 16586 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:31.497242 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.497290 16619 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.508432 12603 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:31.510397 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:31.511379 16016 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:31.511821 16016 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:31.512230 16016 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:31.535394 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:31.546608 11872 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:31.555254 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.559762 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55491us
W20260709 12:11:31.561262 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.527254 16487 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:31.573730 16487 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.575757 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:31.525902 16374 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:31.522048 16619 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.587790 16675 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.590183 16675 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.591207 16675 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.596509 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.603612 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.605240 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.607012 12602 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:31.607941 16487 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:31.611310 16487 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:31.611810 16487 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.612218 16583 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:31.617666 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.619851 16583 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:31.621315 11941 raft_consensus.cc:606] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:31.621795 11941 raft_consensus.cc:614] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:31.623055 16487 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:31.623984 16487 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:31.563560 16617 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.625608 16487 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.626137 16487 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:31.631119 16619 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:31.600641 16446 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.626261 16617 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.637498 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.639351 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.642841 12603 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:31.632292 16609 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:11:31.647027 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 443187us
W20260709 12:11:31.651741 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 199817us
I20260709 12:11:31.655725 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:31.666266 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.638140 16446 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.682093 16392 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.689504 16016 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.710107 16016 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.711221 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.716004 16487 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.667055 16576 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:31.694031 16392 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.730219 16392 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:31.730772 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 195504us
I20260709 12:11:31.731675 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:31.733618 16636 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.734067 16636 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.735011 16636 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.736289 16636 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.736440 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.736902 16487 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.694650 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:31.740720 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46173.1us
I20260709 12:11:31.741636 16361 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.671754 16366 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.747349 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.734148 16697 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.748428 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.748752 16697 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:31.749751 16697 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.752803 16685 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.753402 16685 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.753705 16530 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.754259 16530 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.755182 16530 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.756300 16589 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.756731 16589 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.757076 16589 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:31.757385 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.724133 16446 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:31.749349 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:31.762328 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.762708 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.767882 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.771205 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:31.692685 16529 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.782706 11944 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:31.754381 16685 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.769170 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:31.786023 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 123678us
I20260709 12:11:31.788434 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:31.792819 16487 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.784497 16138 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:31.792791 16374 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.798338 16487 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:31.804857 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 153944us
I20260709 12:11:31.805197 16487 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.809974 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.794176 16593 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:31.835748 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47429.7us
I20260709 12:11:31.836982 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:31.838688 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.800642 16446 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:31.800046 16138 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:31.846571 11986 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:31.847934 12018 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.849874 16593 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.850955 16593 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.851040 16617 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:31.820436 16374 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:31.859691 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:31.867803 16533 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.871928 16589 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.865162 16617 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:31.874328 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.852895 16138 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.883625 16617 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:31.884960 16617 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:31.885761 16659 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:31.887948 16589 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:31.889008 16617 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.894763 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:31.858783 16366 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.901986 16366 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:31.857450 16529 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:31.855535 16446 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:31.920769 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61684.4us
W20260709 12:11:31.922403 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45568.3us
I20260709 12:11:31.924163 16366 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:31.930984 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.895951 16016 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:31.946333 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 79343.1us
I20260709 12:11:31.959702 16619 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:31.967383 16676 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:31.958792 16374 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:31.978193 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:31.981683 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:31.955302 16587 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:31.985976 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:31.986609 16619 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.001791 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.009032 16016 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.009606 12016 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 4 to 6, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:32.015645 12019 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.017576 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.018195 11871 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
W20260709 12:11:32.020605 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.020975 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:32.026361 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:32.027068 12022 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:32.029721 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:32.030362 11869 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.034808 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:32.037191 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.007642 16595 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:32.038305 12014 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.045007 16356 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.045475 16356 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:32.046661 11864 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:32.047067 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61322.3us
I20260709 12:11:31.978240 16446 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:32.056536 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54856.7us
I20260709 12:11:32.058292 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:32.060364 11867 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:32.058435 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.064179 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:32.066195 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.023327 16711 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.066980 11939 raft_consensus.cc:2393] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:32.037079 11868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:11:32.068608 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:32.071239 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.022223 16138 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.074895 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.075047 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.082091 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.082454 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.083441 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.084733 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.085743 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.152541 11941 raft_consensus.cc:606] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:32.153082 11941 raft_consensus.cc:614] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:32.158968 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.159377 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.158984 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.161775 11939 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.062836 16228 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:11:32.162669 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.166486 11867 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:32.166680 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.081835 16619 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:32.214078 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.214706 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.215518 11940 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:32.085804 16711 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:32.158491 16617 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.168205 16718 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:11:32.238306 11943 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
W20260709 12:11:32.240132 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.363988 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.258579 16696 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.171588 16619 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:32.366864 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.367115 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.367650 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.229139 12014 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:32.277581 11942 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:32.281049 16587 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.366370 12577 leader_election.cc:336] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 2.072s (SENT)
I20260709 12:11:32.379299 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:32.382125 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 222847us
I20260709 12:11:32.369381 16619 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:32.279404 16617 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.389384 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:32.396404 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 181770us
I20260709 12:11:32.399210 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:32.390174 16697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.019s	sys 0.017s
I20260709 12:11:32.402683 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:32.405400 11947 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
W20260709 12:11:32.408293 16690 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.508s	user 0.009s	sys 0.021s
W20260709 12:11:32.410086 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.410276 16714 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:11:32.415248 16356 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.417026 16356 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.417769 16586 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.418259 16586 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:32.418741 16586 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.422283 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.427650 16698 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.549s	user 0.003s	sys 0.000s
I20260709 12:11:32.428368 16392 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.428992 16392 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.431370 16392 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:32.431672 16609 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:32.432194 16609 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:32.432587 16487 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
W20260709 12:11:32.447022 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 52846.8us
W20260709 12:11:32.450382 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47797.7us
I20260709 12:11:32.452132 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.452294 16602 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:32.453182 16602 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:32.433007 16697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.020s	sys 0.018s
I20260709 12:11:32.462898 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.478574 11943 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:32.461915 16696 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.480619 16677 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.485880 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 225776us
I20260709 12:11:32.487507 16138 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:32.492343 16710 raft_consensus.cc:993] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:11:32.528352 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.513370 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.545077 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.552023 11868 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:32.552531 11868 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:32.553859 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77623.9us
W20260709 12:11:32.570940 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.449994 16487 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.588441 16676 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.591586 16676 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.592001 16696 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.594182 16487 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:32.595625 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 116023us
W20260709 12:11:32.580868 16706 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.712s	user 0.020s	sys 0.052s
I20260709 12:11:32.440310 16711 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.554796 16685 raft_consensus.cc:1081] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:11:32.602377 12016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.016s
W20260709 12:11:32.605923 12016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.016s
I20260709 12:11:32.608749 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.632071 12014 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.597417 16366 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.637790 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 170695us
I20260709 12:11:32.645442 11868 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:32.668586 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59959.5us
I20260709 12:11:32.682085 12014 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:32.647890 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.654495 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:32.684474 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:32.646550 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.688323 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.646240 16697 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.692807 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:32.694619 12014 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:32.685559 16617 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:32.692420 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:32.652058 16676 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:32.689611 16530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:11:32.688934 16372 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:32.710366 16723 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:11:32.712039 16722 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:11:32.720496 16704 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.818s	user 0.006s	sys 0.007s
I20260709 12:11:32.696413 16619 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.725822 12018 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:32.726032 16724 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:32.701911 16734 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.728982 16712 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.805s	user 0.017s	sys 0.067s
I20260709 12:11:32.735100 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.736089 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:32.693437 16733 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:32.706037 16530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.010s	sys 0.000s
I20260709 12:11:32.725162 16619 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:32.750638 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51009.8us
I20260709 12:11:32.753237 12014 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.776664 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.777704 11866 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:32.776520 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 72244.6us
I20260709 12:11:32.759007 16734 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.780613 11871 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:32.789737 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.790693 11871 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:32.780841 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.781162 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:32.792514 11867 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:32.781409 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.793628 11864 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:32.783242 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.784494 16617 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.761724 16697 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.776777 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.785993 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:32.799844 11872 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:32.801599 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:32.802907 16529 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:32.809407 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.805027 16676 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.817499 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:32.819912 16726 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:11:32.812160 16436 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:32.810420 16529 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.820744 16529 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.824009 11868 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:32.826463 16676 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.826972 16676 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.828948 16725 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
W20260709 12:11:32.829674 16727 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:11:32.830866 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.831431 16595 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.004s
I20260709 12:11:32.831840 16595 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:32.832171 16685 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.832799 16685 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:32.833876 16685 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.837059 16446 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.837587 16446 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.839629 16446 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:32.839488 16609 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.841171 16609 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.843127 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:32.843691 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.858095 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:32.863034 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.868537 11867 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:32.869943 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50219.4us
I20260709 12:11:32.877936 12611 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:32.847675 16720 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.354s	user 0.003s	sys 0.000s
I20260709 12:11:32.878481 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.885800 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:32.888700 11867 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:32.890024 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:32.890291 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:32.891248 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.893616 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:32.895673 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.896771 16734 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.897315 16697 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.897799 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:32.899873 11864 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:32.900005 16372 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:32.904735 16586 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:32.906957 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.907299 16731 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.919229 16602 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:32.907898 16733 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.920013 12020 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.919955 16733 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.921145 16586 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:32.922406 16733 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:32.909032 16728 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
W20260709 12:11:32.924101 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 276274us
I20260709 12:11:32.924901 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.926054 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:32.927870 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.909368 16392 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:32.911211 16545 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:32.911609 16701 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:32.914819 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:32.952780 12603 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:32.915963 11867 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:32.864231 16436 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.953902 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:32.916621 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 73576us
I20260709 12:11:32.916894 11872 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:32.918658 16731 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.907639 16533 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.943552 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.944890 11942 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:32.944809 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.948505 16685 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:32.949256 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.957180 11868 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.959488 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:32.957451 11940 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.960253 12018 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:32.960449 11940 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:32.961686 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "628666a2024d4a61831835e7dee5737a"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:11:32.961786 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:32.962011 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:32.962296 11870 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:32.962365 11947 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.962770 11870 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.966337 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:32.967748 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:32.959332 11941 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:32.951947 16619 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.979441 16619 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.972429 12021 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:32.979935 16697 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.981571 16487 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.981788 16731 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:32.963521 16583 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:32.982381 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:32.982617 16583 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.982728 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:32.983062 16583 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.983530 11868 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:32.983716 16016 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:32.984211 16016 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:32.982292 16487 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:11:32.972543 12015 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:32.973205 12016 raft_consensus.cc:2393] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:32.966441 16685 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.979938 16619 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.988070 16685 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:32.974354 12018 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:32.974984 16732 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.975206 16586 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.972163 16366 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.990983 16586 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.991348 16366 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.983551 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:32.992444 16676 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:32.993021 16586 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:32.975546 16741 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.996420 16741 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:32.996904 16587 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.002s
I20260709 12:11:32.998682 16741 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:32.976297 16737 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.999483 16737 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.958561 16733 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:32.976087 11940 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.962767 16595 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:32.957363 16392 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:32.957957 16529 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:32.963858 16436 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:32.986049 16691 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.110s	user 0.010s	sys 0.035s
I20260709 12:11:32.985113 16016 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.005023 11940 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.006882 11947 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:33.007682 11870 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.003605 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:33.004971 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 93926.4us
I20260709 12:11:33.011786 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.009454 16741 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.056386 11912 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.027236 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:33.028038 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.057479 11865 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:33.050753 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:33.050760 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 122964us
I20260709 12:11:33.056389 12018 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:32.997375 16587 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.060081 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:33.063714 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:33.064373 12609 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:33.065729 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:33.008565 16595 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:33.072674 11870 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.029989 16545 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.079245 12018 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:33.081933 12610 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:33.085829 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:33.091583 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.092084 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.050523 16697 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:33.105628 11940 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:33.010759 16733 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.077953 16602 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.081245 16595 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.083460 16737 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:33.131137 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45426.5us
W20260709 12:11:33.143910 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 78265.3us
W20260709 12:11:33.144166 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 142317us
I20260709 12:11:33.145565 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.098145 16374 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:33.144201 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46377.7us
I20260709 12:11:33.106793 16586 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.110909 16705 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:33.109843 16602 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:33.110405 16530 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:33.158463 16752 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:33.094342 16711 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:11:33.159432 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.159878 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2657) took 2071 ms. Trace:
I20260709 12:11:33.090077 16545 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.141039 16366 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:33.178889 16753 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.179381 16753 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.179811 16753 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.179997 16545 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.149462 16374 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.185817 16374 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.186738 16436 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.189353 12606 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:33.097960 16734 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:33.190480 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:33.151049 16741 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:33.178113 11873 rpcz_store.cc:276] 0709 12:11:31.088454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.415532 (+327078us) service_pool.cc:224] Handling call
0709 12:11:31.415836 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.416212 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.416243 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.416740 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.645764 (+229024us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.645804 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.645866 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.866986 (+1221120us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:33.150781 (+283795us) raft_consensus.cc:1685] finished
0709 12:11:33.150814 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.159811 (+  8997us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1584,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":175846144,"thread_start_us":228179,"threads_started":1,"wal-append.queue_time_us":397329}
I20260709 12:11:33.109015 16697 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.140872 16138 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 12:11:33.206095 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 97143.6us
I20260709 12:11:33.161916 16602 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.189741 16751 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.218817 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.225605 16529 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.144503 16392 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.208066 16752 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:33.207013 16676 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.237267 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:33.238109 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:33.220958 16619 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.232935 16733 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.211359 16366 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:33.257620 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1899) took 1189 ms. Trace:
I20260709 12:11:33.255793 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.258185 11945 rpcz_store.cc:276] 0709 12:11:32.064553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.070147 (+  5594us) service_pool.cc:224] Handling call
0709 12:11:33.253651 (+1183504us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400388bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:33.253821 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249291648}
I20260709 12:11:33.213459 16751 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.265511 16755 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.266079 16755 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.268188 16755 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.268834 16749 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:11:33.269505 16749 consensus_queue.cc:1243] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:33.191674 16530 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.207813 16583 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:33.275759 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 119362us
W20260709 12:11:33.276415 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52303.6us
I20260709 12:11:33.277395 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.257479 16487 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.274179 16533 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.260044 16366 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:33.287992 16705 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:33.289856 16545 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:33.256616 16374 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.272109 16751 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.306008 16705 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.307312 16602 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.283517 16487 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.292315 16737 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.295275 16366 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:33.311097 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 96834.6us
W20260709 12:11:33.320101 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 43646.9us
I20260709 12:11:33.320842 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:33.313419 16487 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.325578 16595 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.329830 16759 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:33.336318 16366 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.337358 16595 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.337739 16746 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:33.338192 16746 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.338603 16746 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:33.296154 16533 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.313580 16737 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.347908 16530 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.349038 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:33.361123 12602 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:33.349606 16533 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:33.352685 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 207200us
I20260709 12:11:33.353772 16016 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:33.365314 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.366889 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.367215 11912 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:33.367496 11912 leader_election.cc:403] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.367818 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.368243 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.368575 12611 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.372583 12017 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.373732 16602 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.378392 16619 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:33.352722 16583 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:33.379338 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.380249 12017 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:33.383738 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.392931 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:33.384593 12017 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:33.393595 12018 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.394358 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.397830 16016 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:33.399784 16685 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.343542 16366 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.396014 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.402668 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:33.402930 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.403442 11944 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:33.399734 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.360041 16737 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.409857 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:33.318579 16741 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.413779 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:33.422137 16487 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.404317 16755 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.427604 12611 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:33.428874 11912 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.430838 12018 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:33.432365 16701 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:33.322552 16752 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.409996 16697 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.433799 16701 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.434092 16755 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:33.435196 16755 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.436144 16731 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.436540 16731 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:33.441591 16763 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:33.442165 16763 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.433451 16759 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.444010 16759 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:33.444303 16763 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.430466 16676 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:33.432611 16374 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.447384 16753 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.434191 16701 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:33.431401 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:33.461742 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:33.463019 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56891.2us
I20260709 12:11:33.444955 16759 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.462690 16545 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.469569 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.471769 11870 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:33.471697 11873 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:11:33.468005 16545 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.474028 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.474227 16545 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.474730 11869 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
W20260709 12:11:33.476061 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 198774us
I20260709 12:11:33.476222 16595 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.476673 16595 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.477037 16595 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.474540 16677 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.477499 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.477849 16677 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.478876 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.480173 16619 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.480669 16619 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.480055 16677 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:33.480223 16583 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.481101 16619 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.484278 16753 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.485438 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.487970 16763 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.489774 16617 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:33.490191 16617 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:33.491110 16617 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.437369 16731 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.494681 16731 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.496222 16487 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:33.496416 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:33.471115 16676 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.497411 16676 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:33.518411 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.519578 11867 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:33.524379 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.525070 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:33.525244 11866 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:33.527035 12017 pending_rounds.cc:85] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 4
I20260709 12:11:33.527415 12017 pending_rounds.cc:107] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:33.527729 12017 raft_consensus.cc:2889] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:33.534008 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55241us
I20260709 12:11:33.537523 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.540913 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:33.551399 12021 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:33.552500 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:33.548857 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:33.554418 12020 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.554530 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:33.555106 11869 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.556108 11872 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:33.557128 11867 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:33.492642 16617 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:33.562961 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.488194 16746 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.562368 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:33.566526 12021 raft_consensus.cc:2393] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:33.567028 12013 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.550591 16753 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:33.553611 16496 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.556070 16545 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.581180 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.576745 16586 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.585850 16636 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.577049 16487 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.588164 11770 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 8, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.542971 16701 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.597180 12016 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:33.601344 12020 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:33.626179 12611 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:11:33.626577 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74153us
I20260709 12:11:33.627512 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.628324 11869 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:33.551209 16751 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.498667 16676 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.633527 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:33.641976 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:33.642612 11872 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:33.596577 16753 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:33.636001 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:33.643743 11943 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:33.647962 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:33.648793 11944 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:33.651417 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:33.632843 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.601848 16636 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:33.655738 12022 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:33.656631 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:33.633615 16586 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:33.661922 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.632800 16741 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.599880 16748 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:11:33.679540 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:33.680951 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:33.601797 16496 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.681130 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:33.608354 16374 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:33.645706 16749 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.655284 16460 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.680531 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.675680 16366 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.740325 16366 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.740809 16366 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.632313 16711 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:33.626071 16487 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.715626 12016 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:33.724732 16756 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:33.736131 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.678031 16372 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.686998 16356 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.640720 16705 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:11:33.682382 16677 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:33.736694 11771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 193) took 22038 ms (client timeout 15000 ms). Trace:
I20260709 12:11:33.769225 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:33.770047 12020 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.739794 16609 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.690006 16529 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.704998 11770 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.774848 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:33.776446 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.776505 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.396s (SENT) [suppressed 34 similar messages]
W20260709 12:11:33.752130 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 71721.3us
I20260709 12:11:33.787278 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.726564 16685 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:33.790515 16587 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.726476 16576 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.791560 16576 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.792124 16576 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.727952 16593 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.798205 16593 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.798815 16593 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.789237 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.817654 16587 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:33.820381 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:33.825730 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.826056 16587 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.773293 16677 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:33.840693 16677 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.841297 16751 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:33.712885 16741 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.844959 16741 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:33.676028 16760 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:11:33.687325 16761 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:11:33.875763 11770 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:33.769060 11771 rpcz_store.cc:269] 0709 12:11:11.698517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.699072 (+   555us) service_pool.cc:224] Handling call
0709 12:11:33.727617 (+22028545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:31.713897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:31.714645 (+   748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:31.714698 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:11:31.714736 (+    38us) tablet.cc:662] Decoding operations
0709 12:11:31.716245 (+  1509us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:31.716352 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:31.716386 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:11:31.782423 (+ 66037us) tablet.cc:701] Row locks acquired
0709 12:11:31.782470 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:11:31.782662 (+   192us) write_op.cc:270] Start()
0709 12:11:31.782829 (+   167us) write_op.cc:276] Timestamp: P: 1783599091782593 usec, L: 0
0709 12:11:31.782863 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:11:31.783589 (+   726us) log.cc:844] Serialized 5880 byte log entry
0709 12:11:32.738530 (+954941us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800302c80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:32.832831 (+ 94301us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.063938 (+231107us) write_op.cc:301] APPLY: starting
0709 12:11:33.064067 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.183443 (+119376us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.183491 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.322628 (+139137us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.349086 (+ 26458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:11:33.349161 (+    75us) write_op.cc:312] APPLY: finished
0709 12:11:33.349609 (+   448us) log.cc:844] Serialized 129 byte log entry
0709 12:11:33.349808 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.349972 (+   164us) write_op.cc:454] Released schema lock
0709 12:11:33.350044 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.350534 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.350575 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2628398,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":230752,"apply.run_cpu_time_us":21315,"apply.run_wall_time_us":286594,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":553137,"prepare.run_cpu_time_us":37865,"prepare.run_wall_time_us":264047,"raft.queue_time_us":91416,"raft.run_cpu_time_us":67501,"raft.run_wall_time_us":141439,"replication_time_us":1049794,"spinlock_wait_cycles":24564608,"thread_start_us":793747,"threads_started":4,"wal-append.queue_time_us":182854}]]}
I20260709 12:11:33.735540 16749 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:33.851852 16764 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 12:11:33.774266 16529 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:33.931011 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 110776us
I20260709 12:11:33.932310 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.939952 12020 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:33.949443 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:33.903596 16460 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:33.837822 16737 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:33.846369 16609 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:34.022377 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.933955 16529 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.929093 16016 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.936509 16748 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.981611 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.773236 16753 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:34.052881 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 292479us
W20260709 12:11:34.056454 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65308.7us
W20260709 12:11:34.059748 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 337113us
I20260709 12:11:34.095170 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:33.774432 16636 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:33.958392 16755 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.087078 12019 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.980202 16751 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:33.993767 16776 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:11:34.057289 11945 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:34.097018 12022 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:34.098536 12611 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:11:33.845810 16586 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.059005 16763 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.141132 11770 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 7, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.081302 16769 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.959201 16619 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.148983 11941 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:34.084349 16545 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:34.160006 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.173825 16772 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.496s	user 0.001s	sys 0.000s
I20260709 12:11:34.096164 16016 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.141275 16761 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 12:11:34.285130 11770 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:34.317761 11869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.012s
W20260709 12:11:34.398483 11869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.016s
W20260709 12:11:34.395535 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 300924us
W20260709 12:11:34.182211 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 87256.7us
I20260709 12:11:34.405000 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:34.406644 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.285624 16748 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.408077 11770 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:34.370546 16787 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:34.415558 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:34.287647 16496 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:34.420156 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:34.374982 16138 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:34.425820 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 261250us
I20260709 12:11:34.411295 16763 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.287053 16587 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:34.427838 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.446056 16587 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:34.410842 16583 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.007s
I20260709 12:11:34.450043 16583 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.451125 16583 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.452286 12017 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:34.419793 16792 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.394778 16545 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.449160 16587 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:34.281827 16593 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.454411 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.391001 16751 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:34.183388 16755 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.185209 16460 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.462011 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:34.464224 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.471277 11944 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.502635 11941 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:34.454414 16777 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 12:11:34.284729 16782 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.258s
I20260709 12:11:34.499254 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.457737 16487 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.469822 16763 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.423429 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:34.486519 16749 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.505548 16737 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.471597 16545 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.460793 16138 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.509845 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.510362 16609 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.514511 16016 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.515864 16619 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.515744 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:34.516386 16366 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 12:11:34.519300 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:34.548300 16775 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.590s	user 0.001s	sys 0.001s
I20260709 12:11:34.499073 16751 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:34.531632 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75875.3us
I20260709 12:11:34.531790 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.535099 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:34.542945 11947 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:34.543155 11871 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:34.505728 11942 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:34.499864 16788 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.586355 11946 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:34.461753 11866 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.509146 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:34.550103 11867 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:34.503177 16795 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:34.561234 11868 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:34.504172 11941 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:34.466436 16792 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.510355 11948 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:34.618778 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:34.611194 11941 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.619599 11865 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:34.624387 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 224401us
I20260709 12:11:34.624594 16138 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.631235 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 939) took 1261 ms. Trace:
I20260709 12:11:34.567001 16366 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.644955 12015 rpcz_store.cc:276] 0709 12:11:33.369830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.370014 (+   184us) service_pool.cc:224] Handling call
0709 12:11:33.370471 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.539267 (+168796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.539314 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.563977 (+ 24663us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.728301 (+164324us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.728348 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.728426 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.631005 (+902579us) raft_consensus.cc:1685] finished
0709 12:11:34.631031 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.631168 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109110,"raft.queue_time_us":109431,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"thread_start_us":192429,"threads_started":2,"wal-append.queue_time_us":347093}
I20260709 12:11:34.660707 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2788) took 1131 ms. Trace:
W20260709 12:11:34.660595 11838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.030s
W20260709 12:11:34.663846 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.004s	sys 0.030s
I20260709 12:11:34.661276 12014 rpcz_store.cc:276] 0709 12:11:33.529692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.529988 (+   296us) service_pool.cc:224] Handling call
0709 12:11:33.530357 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.530774 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.530815 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.531335 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.659114 (+127779us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:33.659152 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.659213 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.660424 (+1001211us) raft_consensus.cc:1685] finished
0709 12:11:34.660449 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.660611 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13456,"raft.queue_time_us":806,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17487,"thread_start_us":83553,"threads_started":1,"wal-append.queue_time_us":212929}
I20260709 12:11:34.668113 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.617197 16790 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:34.671566 12021 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.609457 16788 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:34.674615 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.687191 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.692746 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.698148 12015 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:34.698494 11866 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:11:34.699378 11864 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [12.10-15.12]
I20260709 12:11:34.692049 16734 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.710103 16734 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.712555 16734 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:34.716584 16576 consensus_meta.cc:287] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.924s	user 0.014s	sys 0.000s
I20260709 12:11:34.717555 16576 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.719080 16788 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.678295 16016 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.720042 16016 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.728186 16593 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.722287 16016 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:34.730129 16677 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.889s	user 0.010s	sys 0.003s
W20260709 12:11:34.730386 16799 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:11:34.730734 16677 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.732874 16792 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.734223 16803 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:11:34.735275 16356 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.961s	user 0.005s	sys 0.008s
I20260709 12:11:34.735869 16356 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.734858 16803 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:34.736493 16806 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:34.676513 16753 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:34.729038 16595 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.251s	user 0.010s	sys 0.004s
W20260709 12:11:34.733039 16617 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 1.165s	user 0.009s	sys 0.003s
I20260709 12:11:34.749701 16769 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.739570 16755 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.748699 16595 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.751454 12013 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:34.756932 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2791) took 1223 ms. Trace:
I20260709 12:11:34.757648 16800 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.758209 16751 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:34.758371 16800 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.758860 16753 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.759658 16803 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:34.713415 16731 consensus_meta.cc:287] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.218s	user 0.013s	sys 0.000s
I20260709 12:11:34.721321 16366 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.757673 12013 rpcz_store.cc:276] 0709 12:11:33.533799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.567885 (+ 34086us) service_pool.cc:224] Handling call
0709 12:11:33.580213 (+ 12328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.751965 (+1171752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.756546 (+  4581us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540015d954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:34.756843 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692958464}
I20260709 12:11:34.755945 16595 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.762889 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2697) took 1257 ms. Trace:
I20260709 12:11:34.769704 11873 rpcz_store.cc:276] 0709 12:11:33.504999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.505164 (+   165us) service_pool.cc:224] Handling call
0709 12:11:33.505574 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.506018 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:33.575860 (+ 69842us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.715626 (+1139766us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b18003770e0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287
0709 12:11:34.715740 (+   114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.716298 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.716526 (+   228us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:34.716779 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.716981 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.717059 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.762627 (+ 45568us) raft_consensus.cc:1685] finished
0709 12:11:34.762654 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.762819 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6828,"prepare.queue_time_us":183873,"prepare.run_cpu_time_us":187,"prepare.run_wall_time_us":9048,"raft.queue_time_us":173839,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":19465,"spinlock_wait_cycles":9872128,"thread_start_us":524841,"threads_started":3,"wal-append.queue_time_us":537897}
I20260709 12:11:34.776053 12014 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:34.776854 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.740954 16746 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.761340 16800 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:34.814045 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.814554 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2796) took 1240 ms. Trace:
I20260709 12:11:34.814934 12021 rpcz_store.cc:276] 0709 12:11:33.574364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.786591 (+212227us) service_pool.cc:224] Handling call
0709 12:11:33.786921 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.672188 (+885267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.814301 (+142113us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b5400179b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:34.814490 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032863488}
I20260709 12:11:34.816226 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.817427 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.818560 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.819576 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.820063 12021 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.820876 16545 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.815130 12013 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11.
I20260709 12:11:34.822525 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.823055 12013 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.789820 16576 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:34.826283 16617 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.826943 16617 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.829109 16803 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.829713 16803 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.831828 16803 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.833592 16617 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.835650 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2800) took 1241 ms. Trace:
I20260709 12:11:34.836055 12020 rpcz_store.cc:276] 0709 12:11:33.593861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.946007 (+352146us) service_pool.cc:224] Handling call
0709 12:11:34.085856 (+139849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.106175 (+ 20319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.106233 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.106306 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:34.106362 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.835419 (+729057us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400179654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:34.835465 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.835588 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45901056}
I20260709 12:11:34.837747 16804 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:34.838629 11945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43956 (request call id 913) took 1436 ms (client timeout 1568 ms). Trace:
I20260709 12:11:34.838362 16804 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:34.839027 11945 rpcz_store.cc:269] 0709 12:11:33.402024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.402775 (+   751us) service_pool.cc:224] Handling call
0709 12:11:34.838443 (+1435668us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400426154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:34.838567 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881206656}
I20260709 12:11:34.818560 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 950) took 1108 ms. Trace:
I20260709 12:11:34.847321 12016 rpcz_store.cc:276] 0709 12:11:33.710451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.510740 (+800289us) service_pool.cc:224] Handling call
0709 12:11:34.511045 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.621564 (+110519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.621596 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.621648 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:34.621682 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.818333 (+196651us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400029254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:34.818383 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.818501 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253577088}
I20260709 12:11:34.849376 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:34.849723 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.849383 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.851727 12016 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:34.853693 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.855691 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:34.860193 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.863135 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:34.845242 16529 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.000s
I20260709 12:11:34.790469 16731 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.861330 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:34.866613 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.870002 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:34.870711 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:34.904881 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.863162 12016 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:34.840718 16804 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:34.873943 16805 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.855348 16753 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:34.921277 12021 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:34.922605 12013 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:34.904774 12606 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:34.880191 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2795) took 1307 ms. Trace:
I20260709 12:11:34.887413 16701 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.887558 12015 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:34.924853 12017 rpcz_store.cc:276] 0709 12:11:33.573238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.754662 (+181424us) service_pool.cc:224] Handling call
0709 12:11:34.879940 (+1125278us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54000c0654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:34.880079 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556236032}
I20260709 12:11:34.892138 16789 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:34.926378 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60669.1us
W20260709 12:11:34.927698 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66409.2us
I20260709 12:11:34.929863 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.930193 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.931766 12020 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:34.933063 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.934089 12020 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.931787 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.935504 12015 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
W20260709 12:11:34.935964 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.930871 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.937233 12013 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:34.930325 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.938164 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:34.947340 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:34.948149 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.860081 16746 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:34.949111 12015 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:34.949858 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.958710 12013 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.959875 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.960631 12013 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:34.954710 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.961513 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:34.963639 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:34.961820 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:34.965444 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:34.966009 12013 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.966337 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:34.965058 11864 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:34.968775 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:34.969383 11864 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:34.970626 12015 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.972786 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:34.973413 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:34.864094 16545 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:11:34.974011 12020 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.941716 16617 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:34.930945 16789 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:34.956867 16705 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.981992 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:34.986106 11870 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.983738 11865 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:11:34.954069 16804 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.957927 16746 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:34.929363 16731 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:34.928112 16529 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:34.990154 12013 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:34.974731 16609 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.965291 16356 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.992945 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.007025 12020 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.981568 16576 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:34.982982 16697 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:35.001811 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 333064us
I20260709 12:11:35.005154 12017 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.999778 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.010519 11866 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:35.011458 12013 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:34.998440 16746 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.014864 12013 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:35.014689 12020 raft_consensus.cc:1217] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:11:35.016770 12020 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 12:11:34.996253 16617 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:35.020538 11914 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:35.003064 16609 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.027518 12020 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.009380 16576 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.026312 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.008612 16016 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:34.929579 16805 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.034053 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.032177 12017 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.000146 16804 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.032128 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:35.030814 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 60218.7us
I20260709 12:11:35.037899 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.038089 11870 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:35.030135 16817 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:35.045398 12014 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.029219 16609 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.010016 16356 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.034925 16576 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.015072 16759 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:35.058789 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.059841 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.060279 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:35.064337 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.067282 12020 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.068557 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.068567 12610 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:35.072764 16796 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:35.073254 16796 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.073652 16796 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.076725 11870 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:35.127169 12603 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.050055 16697 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:35.126577 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58987.4us
I20260709 12:11:35.129948 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 947) took 1516 ms. Trace:
W20260709 12:11:35.129904 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 59863.4us
W20260709 12:11:35.068861 16812 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:11:35.130983 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.131727 12022 rpcz_store.cc:276] 0709 12:11:33.613649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.371636 (+757987us) service_pool.cc:224] Handling call
0709 12:11:34.372080 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.447657 (+ 75577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.447692 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.447739 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:34.447774 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.129674 (+681900us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b5400046ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:35.129743 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.129885 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173299456}
W20260709 12:11:35.132239 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.521s (SENT)
I20260709 12:11:35.043398 16016 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.134116 12014 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.134344 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.025365 16789 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.143776 12017 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
W20260709 12:11:35.146612 11839 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.574s (SENT)
I20260709 12:11:35.149164 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.140571 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.156942 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.065371 16436 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:11:35.133589 16602 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.165625 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2781) took 1665 ms. Trace:
I20260709 12:11:35.133456 16711 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.138386 16530 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.138971 16374 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.168980 12019 rpcz_store.cc:276] 0709 12:11:33.500521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.533637 (+ 33116us) service_pool.cc:224] Handling call
0709 12:11:33.559542 (+ 25905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.163643 (+604101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.159354 (+995711us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54000ab754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:35.165503 (+  6149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212674304}
I20260709 12:11:35.177716 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.174269 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:35.182518 12014 raft_consensus.cc:2376] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13. Re-sending same reply.
W20260709 12:11:35.185915 11839 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.625s (SENT)
I20260709 12:11:35.186422 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.145197 16697 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:35.190263 16816 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:11:35.191677 16697 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.192147 16636 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.192597 16460 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:35.193288 16805 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.193141 16460 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.193929 16752 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.156972 16792 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.195482 16460 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.164710 16817 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:11:35.200083 16804 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.081203 16617 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.160548 16487 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.149902 16392 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:35.208359 16392 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:35.165223 16676 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:35.216030 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.214214 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.221055 12013 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:35.215070 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.220491 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.219830 12016 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:35.223302 12610 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:35.214624 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.201381 16731 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:35.225831 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51719.8us
I20260709 12:11:35.210315 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.226333 12016 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:35.227917 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.228535 12609 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
W20260709 12:11:35.232080 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 160769us
I20260709 12:11:35.233688 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.204506 16711 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.181169 16602 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.208611 16529 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.235143 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.236410 12013 raft_consensus.cc:2368] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11.
I20260709 12:11:35.236342 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.237573 12602 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:35.232872 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:35.208757 16392 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.205696 16374 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.240926 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:35.206494 16530 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.249233 16602 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.249941 16530 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.249894 16533 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:35.239789 11945 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:35.251132 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.242980 11939 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:35.230772 16372 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.206184 16746 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.214321 16817 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:35.256820 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.249958 16711 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.258112 16832 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.258015 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.259799 12019 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.260357 16749 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.260743 16749 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.261515 16749 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.262040 16392 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.253291 16016 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.263376 16392 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.263629 16749 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.263970 12022 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.265101 16356 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:35.265462 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.266170 12017 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.266971 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.267773 12022 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.268201 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.269047 12013 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.268982 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.271847 16832 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:35.272950 16832 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.273916 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.274112 16228 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:35.274578 12016 raft_consensus.cc:2376] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9. Re-sending same reply.
I20260709 12:11:35.275601 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.276378 12016 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.246657 16759 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.270089 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.277228 16800 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:35.270174 12022 raft_consensus.cc:2376] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14. Re-sending same reply.
I20260709 12:11:35.278919 16759 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.279946 16759 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.280017 16800 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.284372 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.284668 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.285302 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.285547 11947 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:35.286093 12019 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:35.286226 12013 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:35.286890 12016 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:35.286183 12017 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:35.290674 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.293152 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.297231 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.298173 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:35.304665 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.305721 11868 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:35.283834 11946 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:35.291258 12020 raft_consensus.cc:2376] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16. Re-sending same reply.
I20260709 12:11:35.320281 16750 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:35.320919 16750 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.321879 16750 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.323794 16750 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.335009 16746 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.283234 16800 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:35.339731 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.344935 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:35.345942 12019 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.306846 16372 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:35.337319 16820 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
I20260709 12:11:35.350867 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.356552 11939 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.334869 16830 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:35.352785 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.363340 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.314383 16460 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:35.349344 16755 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.372849 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:35.360311 16795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.002s	sys 0.021s
I20260709 12:11:35.372885 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.372915 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.382349 12015 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:35.383181 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.384265 12017 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.359226 16746 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.387742 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:35.396230 11839 leader_election.cc:336] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.783s (SENT)
I20260709 12:11:35.396790 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:35.353194 16529 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:35.386528 16016 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:35.415701 16759 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:35.417383 16822 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 12:11:35.424072 16752 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.401127 16835 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:35.379240 16496 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:35.383773 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.386967 16746 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:35.408557 16374 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.390920 16792 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:35.409298 12020 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:35.391209 16731 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:11:35.410600 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.383239 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.431738 11867 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:35.435106 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.436053 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.437121 11944 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:35.437018 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.437654 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.446259 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.447618 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.453205 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.453358 12014 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:35.459585 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.367411 16811 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:11:35.383222 16795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.002s	sys 0.021s
I20260709 12:11:35.465481 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.464449 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:35.486111 12021 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.486833 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.486573 12017 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:35.465037 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.368810 16800 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.495324 16800 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.495936 12022 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.467144 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:35.496213 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.392023 16487 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:11:35.489614 12013 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
W20260709 12:11:35.505946 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65886.4us
I20260709 12:11:35.386359 16755 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.511773 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.462332 16746 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.514204 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.519807 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.520489 12022 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 7: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.523255 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.524266 12022 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
W20260709 12:11:35.509927 16701 consensus_meta.cc:287] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.004s
I20260709 12:11:35.460214 16016 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:35.501758 16795 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:35.537352 11839 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.845s (SENT)
I20260709 12:11:35.539641 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.540012 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.540334 11945 raft_consensus.cc:2376] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11. Re-sending same reply.
I20260709 12:11:35.540649 12014 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:35.531090 11866 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:11:35.510665 16783 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.548535 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:35.532687 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.533399 11872 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.510985 16805 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.550241 12020 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:35.552577 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.553785 11866 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.561218 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.562463 12014 raft_consensus.cc:2393] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.564291 16756 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.564751 16756 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:35.565132 16756 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.566501 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.542043 16356 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.570436 16356 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.573926 16795 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.574896 16361 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:35.575290 16361 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.578043 11864 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:35.559660 16783 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:35.581051 16780 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.431s	user 0.006s	sys 0.000s
I20260709 12:11:35.460866 16372 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.544265 16817 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:35.586603 16817 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.587051 16817 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.588084 16817 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.590161 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.590845 11870 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:35.591725 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.595526 16755 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.596941 16697 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.597388 16697 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:35.598389 16697 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.599574 16759 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.591681 16746 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.560531 16796 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.602809 16789 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:35.603854 16796 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:35.605098 16746 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:35.604959 16783 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.606949 11947 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:35.608245 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.609084 11945 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:35.609606 16356 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:35.612530 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49560us
I20260709 12:11:35.599701 16697 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.620606 11872 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:35.622332 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.625923 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.627002 12609 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:11:35.631474 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.525486 16576 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.632846 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.633493 11867 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:35.633862 16576 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.627200 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.634328 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.631513 11945 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:35.627980 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.637207 12610 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:35.637935 16677 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:35.633147 16821 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:35.552299 16805 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.640278 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:35.640892 11839 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.873s (SENT)
I20260709 12:11:35.641484 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.642984 12017 raft_consensus.cc:2376] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14. Re-sending same reply.
I20260709 12:11:35.644296 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.645475 12017 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:35.641485 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.647223 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:35.647365 16609 consensus_meta.cc:287] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.590s	user 0.000s	sys 0.013s
I20260709 12:11:35.646847 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.648398 12017 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.647948 16609 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.649253 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.650454 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.654480 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:35.589463 16817 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.658149 11866 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:35.658654 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:35.660036 12604 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:35.660429 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.655757 12017 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 6: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.652256 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.661571 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:35.627581 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.664347 11939 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:35.669279 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:35.670002 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.670310 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:35.672006 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.672260 12605 raft_consensus.cc:2368] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:35.649084 16805 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.674499 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.675602 12017 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.675808 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:35.651063 16755 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:35.678097 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.678939 12603 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:35.668960 16016 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.679026 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.692747 11865 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.694618 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.695464 12020 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:35.669361 16356 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.698994 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:35.702841 11988 connection.cc:256] RPC call timeout handler was delayed by -2.732522506000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 12:11:35.703871 16533 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:35.707787 11988 connection.cc:256] RPC call timeout handler was delayed by -2.5660225060000812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 12:11:35.708199 11988 connection.cc:256] RPC call timeout handler was delayed by -2.4661225059999197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:11:35.708523 11988 connection.cc:256] RPC call timeout handler was delayed by -2.4211225060000743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:11:35.708837 11988 connection.cc:256] RPC call timeout handler was delayed by -2.3977225060000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 12:11:35.709172 11988 connection.cc:256] RPC call timeout handler was delayed by -2.2312225059999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:11:35.630879 16756 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.711941 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:35.712038 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:35.709590 11988 connection.cc:256] RPC call timeout handler was delayed by -2.2150225059999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 12:11:35.712713 11939 raft_consensus.cc:606] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:35.713996 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.714524 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.715683 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:35.716809 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.716935 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.717506 12017 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:35.719254 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.659263 16731 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:35.722600 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2782) took 2206 ms. Trace:
I20260709 12:11:35.721982 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.723167 12018 rpcz_store.cc:276] 0709 12:11:33.501553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.501734 (+   181us) service_pool.cc:224] Handling call
0709 12:11:33.554138 (+ 52404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.600601 (+ 46463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.600631 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.608360 (+  7729us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.846000 (+237640us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:33.846053 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.846129 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.465631 (+1619502us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:35.695086 (+229455us) raft_consensus.cc:1685] finished
0709 12:11:35.695118 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.707516 (+ 12398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10902,"raft.queue_time_us":15103,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":6821,"spinlock_wait_cycles":8014080,"thread_start_us":169352,"threads_started":1,"wal-append.queue_time_us":342477}
I20260709 12:11:35.726094 16792 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:35.696862 16361 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:35.728258 16016 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.728449 16361 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.729616 16849 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.730837 16609 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.731184 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.732051 11866 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 6: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:35.733093 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.734239 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.735345 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.736438 11866 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.736747 16756 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:35.692312 16705 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.741882 16705 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.742453 16705 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.692216 16802 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.743192 16802 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.744414 16849 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.710456 16533 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:35.746029 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:35.694556 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.749269 12016 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.741928 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.748421 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.723474 12017 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:35.658666 16576 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:11:35.752795 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.753908 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.754199 11865 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:11:35.756373 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:35.804617 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 51095.7us
I20260709 12:11:35.794543 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.811798 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.811964 11869 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.812312 11912 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:35.812990 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.814803 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.814450 12017 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.707058 16356 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:35.758430 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.817565 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:35.787966 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 104213us
I20260709 12:11:35.826681 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:35.827975 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:35.758118 11866 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:35.832188 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:35.821281 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 68574.5us
I20260709 12:11:35.822371 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:35.822371 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.835909 11873 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 9: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:35.837121 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.748032 16755 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.838896 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 80573.4us
W20260709 12:11:35.866428 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.866667 11839 leader_election.cc:400] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11.
I20260709 12:11:35.867072 11839 leader_election.cc:403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.867177 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.756989 16366 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.882155 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.882896 11947 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.883324 11869 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:35.884826 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.844826 12015 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:35.886305 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:35.849570 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.853968 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.804697 16756 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:11:35.746577 16804 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.838662 16356 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.814129 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:35.814157 16392 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.004s
I20260709 12:11:35.753684 16849 raft_consensus.cc:2764] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:35.874548 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:35.884773 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:35.847690 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:35.887936 12016 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:35.888530 11869 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.839545 11873 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.889725 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:35.865319 16759 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.865895 16731 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.824414 16529 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.873729 12017 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:35.865022 16749 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:35.841434 16846 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.903741 11865 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.905920 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:35.892745 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.935472 12017 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.786397 16761 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 12:11:35.925298 11873 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:35.929374 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:35.874208 16487 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 10. Current term is 11.
I20260709 12:11:35.786013 16016 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:11:35.746421 16533 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.896605 16804 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.932009 16529 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.931536 16749 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.956529 16761 consensus_queue.cc:1243] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:35.934075 16786 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:35.936700 16755 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:35.957151 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:35.972855 11940 raft_consensus.cc:606] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:35.890285 16366 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:35.969774 11941 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:35.979378 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50134.3us
I20260709 12:11:35.980579 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:35.996851 11939 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:35.997937 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 108274us
I20260709 12:11:35.999121 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.000202 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:36.003232 12022 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:35.963384 16529 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.016254 11869 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:36.018733 11869 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:11:36.021870 11869 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:35.963758 16814 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.172s	user 0.005s	sys 0.000s
I20260709 12:11:36.030993 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:35.965920 16749 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:35.964545 16804 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.969831 16786 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.057022 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:36.073331 11865 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:36.060190 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:36.053766 11873 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:11:36.062448 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 63476.1us
I20260709 12:11:35.966861 16802 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:35.952939 16756 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:11:36.074438 11866 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:35.988129 16677 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:36.076105 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.007689 16609 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.077152 11947 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:36.060999 16755 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.079875 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.083964 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:36.065810 16785 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:36.052862 16734 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:11:36.078711 16701 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.078771 16830 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:36.108899 16801 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:36.109292 16829 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.921s	user 0.000s	sys 0.007s
I20260709 12:11:36.109674 16801 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.106083 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:36.110777 16801 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.083534 16731 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.112777 16731 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:36.113639 16731 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.114778 16366 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:36.111320 11947 raft_consensus.cc:606] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.118925 11947 raft_consensus.cc:614] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:36.092665 16530 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.097790 16016 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.126137 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:36.092042 16677 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:36.129385 16731 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.122611 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2717) took 1602 ms. Trace:
I20260709 12:11:36.117973 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:36.130383 11871 rpcz_store.cc:276] 0709 12:11:34.520409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.575124 (+ 54715us) service_pool.cc:224] Handling call
0709 12:11:34.575661 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.605636 (+ 29975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.605704 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.664710 (+ 59006us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.131378 (+466668us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:35.131420 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.131500 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.094243 (+962743us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:36.115556 (+ 21313us) raft_consensus.cc:1685] finished
0709 12:11:36.115579 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.122497 (+  6918us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":23680,"spinlock_wait_cycles":68533632,"thread_start_us":442301,"threads_started":1,"wal-append.queue_time_us":519209}
I20260709 12:11:36.078526 16487 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:36.139940 11867 raft_consensus.cc:2410] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:36.142767 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:36.107659 16701 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.139963 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60156.7us
I20260709 12:11:36.124081 16530 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.158370 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 323437us
I20260709 12:11:36.151786 16392 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.160210 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.158016 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.152665 16701 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.175726 12022 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:36.177803 16856 raft_consensus.cc:2764] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:36.178711 16856 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:36.179545 16856 consensus_queue.cc:1243] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:11:36.188508 16789 consensus_meta.cc:287] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.002s
I20260709 12:11:36.190861 16392 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.192366 16392 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:36.195389 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.158290 16821 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:36.250113 16821 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.251164 16821 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.251964 16593 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.252285 11912 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.252530 16593 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.254195 16785 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.129889 16677 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:36.214500 16817 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
I20260709 12:11:36.215066 16782 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.218025 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.218165 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.219313 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.268860 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:36.269762 11946 raft_consensus.cc:606] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.176491 12022 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:36.223300 11837 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:36.224723 16705 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.224746 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.275240 11947 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:36.230300 11944 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:36.240767 16848 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:11:36.162775 16530 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.242283 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.242390 16701 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.156795 16609 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:36.258288 12016 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:36.261992 11941 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:11:36.248113 16786 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:36.240641 16851 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.507s	user 0.000s	sys 0.003s
I20260709 12:11:36.276775 11944 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:36.284516 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 115086us
I20260709 12:11:36.284857 12610 raft_consensus.cc:1217] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Deduplicated request from leader. Original: 14.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 12:11:36.295867 12610 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:11:36.287011 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:36.292570 11941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1924) took 1852 ms (client timeout 2033 ms). Trace:
I20260709 12:11:36.298288 11871 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [14.14-15.15]
I20260709 12:11:36.298853 12606 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:36.297173 11941 rpcz_store.cc:269] 0709 12:11:34.440717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.461721 (+ 21004us) service_pool.cc:224] Handling call
0709 12:11:35.303678 (+841957us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b180015bd60. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba6e646 00007f1f1b9a858e 00007f1f1ba29f9e 00007f1f1ba2b7de 00007f1f1ba3727c 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c
0709 12:11:35.964646 (+660968us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b58007748d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba29fe7 00007f1f1ba2b7de 00007f1f1ba3727c 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c
0709 12:11:36.292499 (+327853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131102976}
W20260709 12:11:36.303383 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 80188.6us
I20260709 12:11:36.300560 11944 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.306995 11944 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.306511 16862 raft_consensus.cc:2764] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:36.313866 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.314499 16602 raft_consensus.cc:993] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:36.315045 16602 raft_consensus.cc:1081] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:36.315124 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.316323 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.316511 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.289968 12022 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.307698 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.318039 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.329173 11939 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:36.266749 16782 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.339025 12016 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:11:36.304672 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 146748us
I20260709 12:11:36.345321 11871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:11:36.346243 11871 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.346719 11871 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.352977 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:36.349084 11940 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:36.357872 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.317058 16697 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.290951 16789 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:36.334182 16855 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.253453 16593 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.389304 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.389462 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.367974 16487 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.289170 16356 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.414403 12604 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.416728 16755 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.333599 16760 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:11:36.368534 16753 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:11:36.424006 16847 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:36.368392 16750 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 12:11:36.427059 16805 consensus_meta.cc:287] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.001s
W20260709 12:11:36.434160 16361 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.010s
I20260709 12:11:36.458117 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.460142 12018 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:36.462096 16701 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.475203 16529 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.476696 11942 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:36.454962 16843 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:36.434167 16487 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:36.395450 16576 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:36.481236 11943 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:36.480681 16487 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.426226 16609 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.470216 16593 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.495851 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:36.489202 16749 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.500590 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:36.503329 11944 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:36.505096 11871 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.514386 11943 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:36.514819 11943 raft_consensus.cc:614] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:36.522634 16372 raft_consensus.cc:993] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:36.523335 16372 raft_consensus.cc:1081] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:36.527531 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:36.530354 11869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:11:36.531219 11869 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.531745 11869 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.477906 16805 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.541055 11871 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.438903 16782 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.545706 16705 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.547536 16749 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.557826 16356 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.574966 11948 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:36.575438 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.576293 12015 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:36.578716 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 220899us
W20260709 12:11:36.580235 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 159453us
I20260709 12:11:36.580969 11870 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:36.578877 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.566790 16782 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.589118 11869 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:36.579681 16804 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.000s
I20260709 12:11:36.578048 16862 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.592183 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.592218 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.594527 12018 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.597078 11869 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.597851 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.604760 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.605978 16805 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:36.607214 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:36.607896 12607 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.594087 16804 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.612149 16804 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.578454 16530 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.613329 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.614001 12014 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.615257 16016 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.615337 16530 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:36.616384 16529 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:36.619480 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.619012 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.620246 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.620872 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:36.626452 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.627104 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:36.628163 12014 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:36.628664 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.628863 12015 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:11:36.629300 12016 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.629709 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:36.603814 16697 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.638561 11912 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.639756 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:36.640426 12602 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.639801 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.641252 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:36.642127 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.643282 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:36.647096 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.645323 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:36.649552 12015 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.630376 16805 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.619907 16487 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.657258 12016 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:36.631078 16731 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.635248 16016 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.664170 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.645283 16676 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.666296 12015 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:36.644572 16881 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:36.661755 12018 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:36.646157 16755 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.681896 12602 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:36.661521 16530 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.639320 16677 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:11:36.683339 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:36.663189 16697 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:36.694363 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.683959 12607 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:36.684527 16705 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.698768 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:36.698963 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56597.7us
I20260709 12:11:36.694290 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:36.699801 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.703143 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 1941) took 1264 ms. Trace:
I20260709 12:11:36.705075 16755 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.704744 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:36.703641 11942 rpcz_store.cc:276] 0709 12:11:35.439106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.494848 (+ 55742us) service_pool.cc:224] Handling call
0709 12:11:35.847460 (+352612us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b58000ad798. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f209f90a0 00007f1f209f8984 00007f1f19f736d4 00007f1f19f73662
0709 12:11:36.702890 (+855430us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54003d5c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:36.703070 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318902912}
I20260709 12:11:36.707966 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.708936 12018 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.709376 12018 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:36.710386 16755 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:36.710783 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:36.710799 16487 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.712656 16487 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:36.713090 16487 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.713028 16755 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:36.715510 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:36.716329 12016 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:36.718299 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.718152 12018 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.720340 12018 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.676786 16676 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.721336 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.722613 16676 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.723260 16676 raft_consensus.cc:2764] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:36.723388 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.724153 16705 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.730006 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:36.730799 12013 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:36.703279 16881 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.730201 16705 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:36.731755 12018 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:36.731899 16705 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:36.703213 16880 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.731762 16881 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:36.736469 16880 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:36.736783 16705 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.737564 16880 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.721148 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 586) took 1141 ms. Trace:
I20260709 12:11:36.738562 11864 rpcz_store.cc:276] 0709 12:11:35.579645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.579806 (+   161us) service_pool.cc:224] Handling call
0709 12:11:35.580128 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.718813 (+1138685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.718851 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.718908 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:36.718945 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.720890 (+  1945us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001e0354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:36.720938 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.721087 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618192128}
I20260709 12:11:36.739760 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 964) took 1200 ms. Trace:
I20260709 12:11:36.740177 12020 rpcz_store.cc:276] 0709 12:11:35.538914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.761970 (+223056us) service_pool.cc:224] Handling call
0709 12:11:35.865461 (+103491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.062682 (+197221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.062717 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.063235 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.168412 (+105177us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:36.168481 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.739335 (+570854us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000532d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:36.739389 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.739438 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:36.739453 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.739696 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4085,"raft.queue_time_us":33680,"spinlock_wait_cycles":448612480,"thread_start_us":69496,"threads_started":1,"wal-append.queue_time_us":298869}
I20260709 12:11:36.701992 16677 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.743084 16677 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:36.744010 16677 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.718221 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.745209 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.751891 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.752202 11947 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:36.756871 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.756700 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:36.757695 11864 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:36.757925 11865 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.759155 11871 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:36.751649 16849 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.760322 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:36.760993 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.761482 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:36.762782 11871 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 6.
I20260709 12:11:36.763765 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:36.764405 11871 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.767542 16697 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.768096 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2742) took 1184 ms. Trace:
I20260709 12:11:36.768658 16697 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:36.768548 11870 rpcz_store.cc:276] 0709 12:11:35.583369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.591466 (+  8097us) service_pool.cc:224] Handling call
0709 12:11:36.767843 (+1176377us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54001b6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:36.768002 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273183616}
I20260709 12:11:36.771348 16849 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:36.771725 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 2064) took 1159 ms. Trace:
W20260709 12:11:36.772063 16879 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.254s	user 0.002s	sys 0.002s
I20260709 12:11:36.775807 11867 rpcz_store.cc:276] 0709 12:11:35.611927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.634102 (+ 22175us) service_pool.cc:224] Handling call
0709 12:11:36.771493 (+1137391us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54000947d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:36.771662 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160075648}
I20260709 12:11:36.772404 16877 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:36.778855 16870 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:11:36.772559 11868 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:36.781037 11868 pending_rounds.cc:85] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:36.781306 11868 pending_rounds.cc:107] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:36.781569 11868 raft_consensus.cc:2889] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.777458 16697 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.786942 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.787858 16849 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.737080 16881 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.789322 16697 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.793740 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.799870 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.803398 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:36.809973 12605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41000 (request call id 1037) took 1737 ms (client timeout 1776 ms). Trace:
W20260709 12:11:36.809988 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 100643us
W20260709 12:11:36.810992 12605 rpcz_store.cc:269] 0709 12:11:35.063932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.064060 (+   128us) service_pool.cc:224] Handling call
0709 12:11:36.800655 (+1736595us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540060e5d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:36.800870 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396224768}
I20260709 12:11:36.812436 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.782788 16016 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.815503 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:36.821287 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.814904 16856 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.822961 16593 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.823172 16844 raft_consensus.cc:2764] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:36.823501 16593 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.809873 16849 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:36.825671 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.826349 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:36.813417 16800 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.823983 16593 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.828404 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.835927 16849 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.830276 11865 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:36.830677 11871 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:36.837577 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:36.838459 16849 raft_consensus.cc:2764] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:36.840498 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:36.841642 16849 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.843146 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:36.844301 16849 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.819093 16697 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:36.847638 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.824005 16460 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.833877 16844 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.833745 16856 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:36.860539 11912 leader_election.cc:400] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:36.867986 11912 leader_election.cc:403] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.872869 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:36.876032 16801 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.852221 16750 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.878427 16760 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.889326 12605 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.880432 16446 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.879484 16533 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.877511 16786 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.885418 16711 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11.
I20260709 12:11:36.904964 16711 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:36.899057 16446 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.905881 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:36.906095 16446 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.860430 16460 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.889670 16750 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.890488 16756 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:36.855033 16697 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:36.912722 16460 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.920457 16697 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:36.917259 16372 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:11:36.917361 16750 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.925437 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:36.928965 16875 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
I20260709 12:11:36.935708 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.937461 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.895985 16760 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.866283 16855 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:36.947878 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:36.951642 16361 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:36.942267 16372 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.954980 16487 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:36.957906 16487 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:36.961825 16372 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:36.969691 16795 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:36.970386 16795 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:37.010380 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.010059 16460 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:37.016294 11941 raft_consensus.cc:2410] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:37.020442 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:37.021870 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:37.023020 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.025262 11944 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.025624 11944 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:37.026417 11944 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.027578 11944 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.962394 16361 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:37.048686 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.049440 11941 raft_consensus.cc:2376] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9. Re-sending same reply.
I20260709 12:11:36.971494 16795 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.024446 16487 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.023612 16849 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:37.072784 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:37.081291 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.091542 12017 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:37.092681 11941 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:37.094455 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.097086 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:37.098635 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41008 (request call id 543) took 1399 ms. Trace:
I20260709 12:11:37.102974 11869 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.099051 12604 rpcz_store.cc:276] 0709 12:11:35.685802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.685990 (+   188us) service_pool.cc:224] Handling call
0709 12:11:35.701446 (+ 15456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.415032 (+713586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.084365 (+669333us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400211bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:37.084595 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639015296}
I20260709 12:11:37.059041 11944 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:37.067024 11867 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.067595 11865 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:37.111346 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:36.962169 16760 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.112538 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.114230 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:37.115875 11944 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:37.118839 12018 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:37.120158 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.123016 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:37.123852 11941 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:37.095597 16881 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:37.124121 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 278521us
I20260709 12:11:37.108243 16016 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:37.135226 16893 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:11:37.104022 16756 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:37.108323 16792 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.075069 16487 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.095261 16372 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.140223 16760 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.141710 16361 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.148422 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:37.116575 16798 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:11:37.132812 16849 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.156245 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:37.122694 16880 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.168452 16750 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.166869 12014 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:37.167626 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:37.145705 16802 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:37.171933 11948 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.178164 11948 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:37.166103 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:37.179306 12018 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:37.174656 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:37.187327 11948 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.188984 11948 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.189865 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:37.189414 11946 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:37.189599 16880 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.198587 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:37.200711 16880 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:37.201151 12605 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.162477 16756 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.195343 12018 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.190487 16897 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:37.205556 16897 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.206053 16756 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:37.159569 16016 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:37.207509 16016 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.215546 16897 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:37.192675 16750 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:37.175048 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.218300 12022 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.218528 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:37.219741 16877 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.220606 16877 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.221179 16877 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:37.222374 16877 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.228518 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:37.231328 11867 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:37.234669 12018 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:37.236334 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:37.238085 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:37.239113 11867 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:37.240738 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:37.241473 11945 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:11:37.242710 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:37.256748 11947 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.245592 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.269428 11948 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:37.271237 12018 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:11:37.178306 16846 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.188886 16593 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.191576 16487 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:37.264948 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.255503 16857 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:37.309630 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44798.1us
I20260709 12:11:37.314842 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:37.310890 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.273010 16856 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.318625 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:37.230810 16802 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.317175 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:37.317639 11944 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:37.273422 16897 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:37.254931 16862 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:11:37.340644 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:37.343940 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.300196 16846 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.320600 16899 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.322188 16800 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.330883 16636 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:37.359112 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.358621 12022 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:37.363477 12020 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.362444 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2836) took 1187 ms. Trace:
I20260709 12:11:37.364903 12021 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:37.364441 12022 rpcz_store.cc:276] 0709 12:11:36.174747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.175052 (+   305us) service_pool.cc:224] Handling call
0709 12:11:36.175530 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.954197 (+778667us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b58007ba1d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba29fe7 00007f1f1ba2b7de 00007f1f1ba35b49 00007f1f1ba36416 00007f1f1ba32d8f 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4
0709 12:11:37.217887 (+263690us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b58007ba4d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba29fe7 00007f1f1ba2b7de 00007f1f1ba35b49 00007f1f1ba36416 00007f1f1ba32d8f 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4
0709 12:11:37.362059 (+144172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.362364 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748356096}
I20260709 12:11:37.366667 12022 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:37.368777 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:37.370738 11943 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 12:11:37.363952 16366 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:11:37.378583 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.361753 16844 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.361661 16636 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.412873 16636 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:37.399884 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.366276 16897 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.408070 16593 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:37.411350 16844 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:37.437124 11865 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:37.378945 16800 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.435007 11867 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:37.376099 16862 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.429994 12017 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:37.452455 11867 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:37.476444 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2765) took 1173 ms. Trace:
I20260709 12:11:37.477155 11868 rpcz_store.cc:276] 0709 12:11:36.302642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.338724 (+ 36082us) service_pool.cc:224] Handling call
0709 12:11:36.772109 (+433385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.782052 (+  9943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.454734 (+672682us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000947d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:37.476347 (+ 21613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995760512}
I20260709 12:11:37.490554 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:37.444342 16800 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:37.396008 16446 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.453516 16862 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:37.450344 16783 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:11:37.532612 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:37.585565 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:37.582172 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 244206us
I20260709 12:11:37.508651 11867 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:37.589810 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:37.591924 16897 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.592655 16897 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:37.506490 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 137533us
I20260709 12:11:37.598222 16697 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:37.603163 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:37.518003 16907 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:11:37.608140 16760 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:37.610030 11941 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.519647 16636 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.613302 12015 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:37.537387 16881 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.588865 16849 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.588672 16533 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.532276 16802 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:37.609298 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:37.618104 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:37.590441 16846 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:37.525593 16886 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:37.604803 16857 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:37.644892 11948 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:37.657812 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 48617.5us
W20260709 12:11:37.756420 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 97452.8us
I20260709 12:11:37.527822 16800 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:37.758216 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 163402us
I20260709 12:11:37.762113 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2745) took 2108 ms. Trace:
I20260709 12:11:37.593956 16897 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.529950 16844 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.767798 11866 rpcz_store.cc:276] 0709 12:11:35.654008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.935513 (+281505us) service_pool.cc:224] Handling call
0709 12:11:36.074248 (+138735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.076664 (+  2416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.761842 (+1685178us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002d00d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:37.762041 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309926656}
W20260709 12:11:37.668711 16786 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.002s
W20260709 12:11:37.797353 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.799008 11947 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 12:11:37.799553 11947 pending_rounds.cc:85] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 14
I20260709 12:11:37.799847 11947 pending_rounds.cc:107] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 12:11:37.800163 11947 raft_consensus.cc:2889] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.642208 16886 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:37.763515 16749 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.626787 16849 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:37.814579 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50107.5us
I20260709 12:11:37.824219 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:37.812925 16697 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.634393 16533 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:37.831144 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 228081us
I20260709 12:11:37.831502 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:37.844383 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.847080 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:37.786226 16795 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:37.817850 16749 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:37.828619 16753 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.835383 16734 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.830572 16697 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:37.839031 16750 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.892597 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:37.904537 11867 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:37.842149 16786 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.894191 11942 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:37.837168 16446 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:37.763764 16862 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:37.909464 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.911559 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.855120 16374 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.892207 16749 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:37.925168 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.892452 16356 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.852298 16881 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:37.900182 16760 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:37.924671 16910 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 12:11:37.940774 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 109362us
I20260709 12:11:37.927270 16016 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.934715 16912 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:11:37.955578 16753 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.909178 16734 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.934140 16356 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:37.934867 16374 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:37.950807 16760 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:38.110261 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 259816us
I20260709 12:11:37.891676 16925 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.112023 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 345836us
I20260709 12:11:37.966521 16750 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:11:38.117585 12577 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:37.967228 16016 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.144477 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:37.145973 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.978945 16936 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.171s
I20260709 12:11:38.108551 16915 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.111899 16906 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:38.157019 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 199335us
W20260709 12:11:38.162917 11770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 124) took 25575 ms (client timeout 15000 ms). Trace:
I20260709 12:11:38.145848 16933 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.169063 16933 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:38.170820 16927 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:11:38.171579 16933 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:38.163349 11770 rpcz_store.cc:269] 0709 12:11:12.587298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.600689 (+ 13391us) service_pool.cc:224] Handling call
0709 12:11:38.162839 (+25562150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:34.664573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:34.733984 (+ 69411us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:34.734031 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:11:34.734062 (+    31us) tablet.cc:662] Decoding operations
0709 12:11:34.734964 (+   902us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:34.735031 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:34.735076 (+    45us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:34.735744 (+   668us) tablet.cc:701] Row locks acquired
0709 12:11:34.735763 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:11:34.735954 (+   191us) write_op.cc:270] Start()
0709 12:11:34.736110 (+   156us) write_op.cc:276] Timestamp: P: 1783599094735899 usec, L: 0
0709 12:11:34.736136 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:11:34.790408 (+ 54272us) log.cc:844] Serialized 2898 byte log entry
0709 12:11:35.265811 (+475403us) op_driver.cc:464] REPLICATION: finished
0709 12:11:35.519441 (+253630us) write_op.cc:301] APPLY: starting
0709 12:11:35.522637 (+  3196us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:35.596424 (+ 73787us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:35.596546 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:36.115058 (+518512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:36.125644 (+ 10586us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:11:36.125700 (+    56us) write_op.cc:312] APPLY: finished
0709 12:11:36.126066 (+   366us) log.cc:844] Serialized 73 byte log entry
0709 12:11:36.126301 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:36.126458 (+   157us) write_op.cc:454] Released schema lock
0709 12:11:36.126517 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:36.127075 (+   558us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:36.127106 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":732,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":222159,"apply.run_cpu_time_us":15407,"apply.run_wall_time_us":621616,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":85091,"prepare.run_cpu_time_us":49743,"prepare.run_wall_time_us":335799,"raft.queue_time_us":198940,"raft.run_cpu_time_us":34818,"raft.run_wall_time_us":160145,"replication_time_us":517325,"thread_start_us":477501,"threads_started":4,"wal-append.queue_time_us":217408,"wal-append.run_cpu_time_us":43063,"wal-append.run_wall_time_us":2139484}]]}
I20260709 12:11:38.173668 16016 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.174090 16915 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.141840 16881 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:38.178115 16918 log.cc:927] Time spent T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:11:38.179863 16906 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.180943 16734 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.182188 16906 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:37.975898 16697 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.184402 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 2052) took 1017 ms. Trace:
I20260709 12:11:38.185113 16697 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:38.188262 16929 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:11:38.184777 12016 rpcz_store.cc:276] 0709 12:11:37.167170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.251138 (+ 83968us) service_pool.cc:224] Handling call
0709 12:11:37.251605 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.252382 (+   777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.252424 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.253128 (+   704us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.669383 (+416255us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:37.669434 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.669561 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.184176 (+514615us) raft_consensus.cc:1685] finished
0709 12:11:38.184199 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.184341 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2265,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":10992,"thread_start_us":415459,"threads_started":1,"wal-append.queue_time_us":729060}
I20260709 12:11:38.148548 16916 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.145066 16753 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:37.906260 16857 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.185127 16936 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.213116 16933 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.247115 16016 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:38.247684 16916 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.254768 16753 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.160167 16935 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:11:38.145330 16925 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.256871 16862 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.263677 16392 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:38.270310 16936 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.150381 16356 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.258935 16886 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:38.296743 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.000s	sys 0.019s
W20260709 12:11:38.299492 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.000s	sys 0.020s
I20260709 12:11:38.273100 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:38.273977 16921 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:11:38.282276 16934 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:38.270043 16016 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:38.302753 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 2056) took 1134 ms. Trace:
I20260709 12:11:38.306497 12014 rpcz_store.cc:276] 0709 12:11:37.168236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.272824 (+1104588us) service_pool.cc:224] Handling call
0709 12:11:38.302694 (+ 29870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:38.307948 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 989) took 1060 ms. Trace:
I20260709 12:11:38.302603 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 600) took 1070 ms. Trace:
I20260709 12:11:38.308300 12022 rpcz_store.cc:276] 0709 12:11:37.247565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.386865 (+139300us) service_pool.cc:224] Handling call
0709 12:11:37.388505 (+  1640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.445035 (+ 56530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.445089 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.445148 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.445197 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.307717 (+862520us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5400029254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:38.307765 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.307892 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129381760}
I20260709 12:11:38.309943 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 953) took 1016 ms. Trace:
I20260709 12:11:38.309036 11870 rpcz_store.cc:276] 0709 12:11:37.230481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.232705 (+  2224us) service_pool.cc:224] Handling call
0709 12:11:37.245203 (+ 12498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.245424 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:37.393913 (+148489us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.300104 (+906191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.300174 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:38.300237 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.300341 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.300528 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272166,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"thread_start_us":1013138,"threads_started":2}
W20260709 12:11:38.310536 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.310338 11947 rpcz_store.cc:276] 0709 12:11:37.293290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.304883 (+ 11593us) service_pool.cc:224] Handling call
0709 12:11:37.310938 (+  6055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.800663 (+489725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.309706 (+509043us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54002b3754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:38.309886 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121243392}
I20260709 12:11:38.283233 16916 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:38.321645 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 176372us
I20260709 12:11:38.321712 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1951) took 1286 ms. Trace:
I20260709 12:11:38.270684 16938 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.282670 16942 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:38.299752 16935 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.263011 16933 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:38.353994 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.325380 11944 rpcz_store.cc:276] 0709 12:11:37.020688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.146461 (+125773us) service_pool.cc:224] Handling call
0709 12:11:37.147175 (+   714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.323726 (+176551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.307118 (+983392us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540013d8d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:38.307344 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391101184}
I20260709 12:11:38.270440 16919 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:38.357914 11944 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:38.304390 16792 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:38.387981 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 128107us
I20260709 12:11:38.303946 16886 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:38.304272 16941 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.389578 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:38.390339 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 63021.9us
I20260709 12:11:38.302446 16897 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.393594 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:38.301975 16392 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.403501 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:38.405395 11944 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:38.299335 16862 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.390234 16785 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.429492 11947 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:38.431654 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 2055) took 1263 ms. Trace:
I20260709 12:11:38.432197 12018 rpcz_store.cc:276] 0709 12:11:37.167947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.279157 (+111210us) service_pool.cc:224] Handling call
0709 12:11:37.284366 (+  5209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.616613 (+332247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.616681 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.623983 (+  7302us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.839505 (+215522us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.839542 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.839626 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.431384 (+591758us) raft_consensus.cc:1685] finished
0709 12:11:38.431414 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.431577 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10229,"raft.queue_time_us":14175,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8622,"thread_start_us":541751,"threads_started":2,"wal-append.queue_time_us":519587}
I20260709 12:11:38.447322 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.447799 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:38.448413 11870 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:38.448643 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.449568 11869 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:11:38.448500 12022 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:38.449709 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:38.451900 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:38.457319 11872 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:38.452011 11868 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:38.407269 16760 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.407328 16938 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.451400 16844 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.401713 16593 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:38.394578 16921 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:38.465466 11866 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:38.398840 16886 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.397559 16750 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:38.397910 16801 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:38.461477 16374 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.390439 16935 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.463740 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:38.469058 16874 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.959s	user 0.006s	sys 0.002s
I20260709 12:11:38.460973 16955 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.397375 16734 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:11:38.486922 16902 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.317s	user 0.013s	sys 0.000s
I20260709 12:11:38.401068 16941 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.352239 16942 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.489167 11872 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
W20260709 12:11:38.490285 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.491784 16946 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:11:38.492014 16392 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.493122 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1952) took 1472 ms. Trace:
I20260709 12:11:38.468855 16938 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.400643 16016 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.508598 16881 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.461921 16817 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:38.402442 16897 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.451705 16957 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:11:38.446594 16785 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:38.514287 16950 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:38.523857 11941 rpcz_store.cc:276] 0709 12:11:37.020984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.131102 (+110118us) service_pool.cc:224] Handling call
0709 12:11:37.154847 (+ 23745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.613040 (+458193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.492887 (+879847us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54003d4354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:38.493063 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046322048}
I20260709 12:11:38.476542 16844 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.527726 11865 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:38.528813 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:38.584983 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56265us
I20260709 12:11:38.529603 16931 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:38.530946 16959 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.532074 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82434.4us
W20260709 12:11:38.552281 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 156452us
I20260709 12:11:38.524065 16753 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.535161 16938 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.522516 16919 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:38.597681 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1946) took 1623 ms. Trace:
I20260709 12:11:38.609223 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:38.571218 16392 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.602711 11940 rpcz_store.cc:276] 0709 12:11:36.973813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.999491 (+ 25678us) service_pool.cc:224] Handling call
0709 12:11:37.015741 (+ 16250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.016301 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.016335 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.016951 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.163230 (+146279us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:37.163278 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.163359 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.312762 (+1149403us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:38.593502 (+280740us) raft_consensus.cc:1685] finished
0709 12:11:38.593550 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.597612 (+  4062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":13208,"spinlock_wait_cycles":10984832,"thread_start_us":110829,"threads_started":1,"wal-append.queue_time_us":133772}
I20260709 12:11:38.515352 16955 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.584347 16016 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:38.631731 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2754) took 2331 ms. Trace:
I20260709 12:11:38.591995 16925 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.631947 16933 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.632212 11873 rpcz_store.cc:276] 0709 12:11:36.295992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.296130 (+   138us) service_pool.cc:224] Handling call
0709 12:11:36.299317 (+  3187us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:36.313285 (+ 13968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.313324 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:36.314635 (+  1311us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.504030 (+189395us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:36.520654 (+ 16624us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.521005 (+   351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.521126 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.299880 (+1778754us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:38.627279 (+327399us) raft_consensus.cc:1685] finished
0709 12:11:38.627364 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.627495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7076,"prepare.queue_time_us":35446,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":52,"raft.queue_time_us":14098,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":9659,"spinlock_wait_cycles":60190464,"thread_start_us":188874,"threads_started":1,"wal-append.queue_time_us":195399}
I20260709 12:11:38.597113 16783 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.634929 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:38.522156 16943 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:11:38.596984 16936 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.639263 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:38.660157 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
W20260709 12:11:38.645638 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52510.7us
I20260709 12:11:38.623972 16753 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.666906 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.661330 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:38.681027 11869 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:38.680603 12022 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:38.665465 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.685328 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:38.692500 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:38.699940 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.700763 11866 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:38.643989 16750 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.630460 16392 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.655757 16933 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.710085 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:38.711052 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:38.715754 12014 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
I20260709 12:11:38.654590 16783 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.657588 16760 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.713740 16750 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.716411 16783 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.716804 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:38.716571 16760 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.718080 16750 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.718711 16760 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.597626 16959 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.723661 16959 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.724485 16936 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.680636 16862 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:38.714736 16874 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:38.692835 16753 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.738610 16886 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.771535 16942 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.725034 16936 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.753746 16956 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 12:11:38.755169 16965 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.755842 16969 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.756701 16947 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:11:38.757453 16844 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.758412 16785 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.759779 16955 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:38.761209 16392 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:38.763073 11945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43956 (request call id 937) took 2945 ms (client timeout 1645 ms). Trace:
W20260709 12:11:38.815799 11945 rpcz_store.cc:269] 0709 12:11:35.817662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.817778 (+   116us) service_pool.cc:224] Handling call
0709 12:11:38.762875 (+2945097us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540038fed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:38.762977 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011681152}
I20260709 12:11:38.763372 16958 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.764813 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:38.765697 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1960) took 1180 ms. Trace:
I20260709 12:11:38.768405 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:38.769137 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:38.769670 16961 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:11:38.770030 16978 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.770813 16941 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.770763 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:38.772614 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:38.781661 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.772425 16897 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:38.795423 16952 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 12:11:38.795886 16953 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:11:38.837944 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 119042us
I20260709 12:11:38.796119 16948 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:38.798909 16967 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:38.802330 16969 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.739061 16933 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.805197 16979 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.806069 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:38.761464 16949 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.808073 16975 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.803758 16965 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.748497 16862 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:38.818627 16977 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:11:38.822532 16955 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.822849 16487 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.853760 16487 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:38.855170 16933 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.854975 16487 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.855878 16979 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.856691 16487 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.858352 16753 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.858899 16969 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.849069 16916 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.859602 16975 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.861217 16916 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.862013 16975 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:38.841809 16948 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.830651 12602 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:38.826977 11948 rpcz_store.cc:276] 0709 12:11:37.585478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.594651 (+  9173us) service_pool.cc:224] Handling call
0709 12:11:37.595032 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.647139 (+ 52107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.765469 (+1118330us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54002e59d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:38.765639 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113963904}
I20260709 12:11:38.786897 16935 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.824524 16958 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.838846 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:38.838469 16228 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.850549 16749 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.001s
W20260709 12:11:38.823168 16697 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.002s
I20260709 12:11:38.805837 16942 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.835101 16978 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.868280 16979 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.883772 16965 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:38.863179 16948 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.875275 16936 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.898880 16935 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.884645 16228 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.869333 16955 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.911382 16697 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:38.915704 16958 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:38.923405 16792 consensus_meta.cc:287] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 12:11:38.884585 16749 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.898753 16862 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:38.963774 16978 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.967103 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58674 (request call id 992) took 1665 ms. Trace:
I20260709 12:11:38.972105 16800 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.975173 16228 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:38.975895 16636 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:38.975675 16697 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.868970 16949 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:38.899147 16942 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:38.989974 16792 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.047713 12021 rpcz_store.cc:276] 0709 12:11:37.301360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.306334 (+  4974us) service_pool.cc:224] Handling call
0709 12:11:38.966858 (+1660524us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b5400028d54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:38.967018 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103864704}
I20260709 12:11:39.055709 12606 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:39.074193 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 390956us
I20260709 12:11:39.054924 16881 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.076709 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:39.077988 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.077948 11948 raft_consensus.cc:2376] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8. Re-sending same reply.
I20260709 12:11:39.079453 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.081199 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:39.082934 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.083616 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.085443 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.085826 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.087211 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:39.087236 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.088127 12017 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:39.090215 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.090988 11940 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:39.093148 11944 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:39.094125 11866 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:39.095494 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.099293 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.094022 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.101969 11941 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:39.102254 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.103169 11940 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:39.105943 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.106801 11945 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:39.111814 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.113986 12021 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:39.111086 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.117192 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.117662 11948 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:39.117894 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.117969 11945 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:39.125353 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.126001 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.085247 16920 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:39.139220 11947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.014s
W20260709 12:11:39.139343 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.035s
W20260709 12:11:39.141296 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.036s
W20260709 12:11:39.141439 11947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.014s
I20260709 12:11:39.140389 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.143338 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.143633 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.132117 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:39.145084 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.145190 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.145776 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:39.145876 11873 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:11:39.146626 12018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.017s	sys 0.037s
I20260709 12:11:39.107966 16983 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.144495 11864 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:39.157312 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.062668 16938 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.160531 12017 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 7.
I20260709 12:11:39.163463 11873 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:39.168532 12604 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:39.168622 12602 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:39.158284 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:39.169032 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.163767 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.164625 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.170389 11873 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:39.169818 11869 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.130686 16955 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.167520 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.176266 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.162946 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.177814 12607 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:39.166635 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.177835 12014 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:39.174110 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.179443 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.180228 11873 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:39.181573 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.182310 12609 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:39.158970 16978 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.189815 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 949) took 2290 ms. Trace:
I20260709 12:11:39.190923 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.184389 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:39.190469 11946 rpcz_store.cc:276] 0709 12:11:36.887512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.887741 (+   229us) service_pool.cc:224] Handling call
0709 12:11:36.888143 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.232373 (+344230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.177158 (+1944785us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540010ed54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:39.177372 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692145024}
I20260709 12:11:39.195202 16016 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:39.169962 16855 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.202900 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.203384 12606 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:39.171433 16886 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.169821 16916 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.173664 16753 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.205503 11869 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:39.197376 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.171464 16897 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:39.169800 16366 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.196183 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.175908 16844 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.181325 16936 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.214600 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.175949 16977 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.215399 12017 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:39.217276 16976 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:39.176272 16933 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.218194 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.196712 16984 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.245709 12609 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:39.197557 16979 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:39.351187 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.351292 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 116960us
W20260709 12:11:39.381476 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.228075 16919 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.157s
W20260709 12:11:39.369426 11988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.744s (SENT) [suppressed 17 similar messages]
W20260709 12:11:39.286401 16783 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.569s	user 0.015s	sys 0.002s
I20260709 12:11:39.353734 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.243548 16936 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.354907 16697 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.350234 16933 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.232522 16897 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.218505 16886 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.231743 16749 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.229846 16366 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.215987 16855 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.350409 16984 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:39.388456 16949 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.235630 16844 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:39.394776 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.197850 16978 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.147217 16920 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.212831 16750 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 12:11:39.398314 16487 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.013s
I20260709 12:11:39.169050 16983 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.228904 16753 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.283279 16977 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.396615 16976 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:39.399562 16636 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.601878 16886 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.602566 16636 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.603139 16938 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.605026 16636 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.397341 16979 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.605751 16979 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.229130 16916 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.611476 16916 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:39.550622 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.612995 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.613691 16936 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.614315 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.558508 16795 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.615715 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.615640 16795 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:39.551865 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 427336us
W20260709 12:11:39.563918 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 194512us
I20260709 12:11:39.619048 16844 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.621652 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.621995 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.622398 11864 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:11:39.622889 11873 raft_consensus.cc:2410] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:39.566138 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.566493 16992 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.561744 16942 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.511943 16984 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.593462 11867 raft_consensus.cc:2410] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:39.595719 16977 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.595860 16920 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.597748 16983 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.599922 16753 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:39.601733 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:39.426934 16783 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.624051 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.611680 16897 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:39.641985 11869 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:11:39.645262 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 217029us
I20260709 12:11:39.643409 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1948) took 2624 ms. Trace:
I20260709 12:11:39.628257 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:39.645817 11943 rpcz_store.cc:276] 0709 12:11:37.018867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.019031 (+   164us) service_pool.cc:224] Handling call
0709 12:11:37.019488 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.371269 (+351781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.643147 (+2271878us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400425754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:39.643348 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806880512}
I20260709 12:11:39.644251 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:39.656244 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.657827 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.628861 16936 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.660425 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.661069 11869 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:39.662640 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.662740 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:39.640441 16800 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.005s
I20260709 12:11:39.665786 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.666708 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:39.668326 11945 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:39.669075 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.619546 16976 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.670303 17006 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:39.670797 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.685643 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.652709 16711 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.691675 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.662494 16824 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.665266 16817 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.662859 16753 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.701471 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.670797 16877 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.706106 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:39.708694 16994 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:39.662333 16636 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:11:39.689100 16951 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:39.688036 16897 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:39.714788 16933 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.715098 16897 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.717526 16897 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:39.719305 16366 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:39.719669 16999 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:39.721728 11944 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:39.722913 12022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2873) took 1109 ms. Trace:
I20260709 12:11:39.723182 11944 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:39.723345 12022 rpcz_store.cc:276] 0709 12:11:38.613167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.682070 (+ 68903us) service_pool.cc:224] Handling call
0709 12:11:38.685388 (+  3318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.869736 (+184348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.869763 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.885143 (+ 15380us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.419812 (+534669us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:39.419863 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.419931 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.722697 (+302766us) raft_consensus.cc:1685] finished
0709 12:11:39.722721 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.722853 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124059,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8485,"thread_start_us":683899,"threads_started":2,"wal-append.queue_time_us":776238}
I20260709 12:11:39.726475 16783 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.672818 16936 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:39.727638 17001 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.005s
I20260709 12:11:39.714845 11941 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:39.708357 16817 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.732577 16978 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.709183 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.697350 16976 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.734818 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.735396 17008 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.736493 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.705344 16753 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:39.642679 16992 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.732623 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2802) took 1043 ms. Trace:
I20260709 12:11:39.723353 11769 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.739135 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.743167 11870 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
W20260709 12:11:39.696034 16886 consensus_queue.cc:1175] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "46f08e8ff3774f25acad18252e5cd57d" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 12:11:39.741053 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.701768 16711 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:39.741523 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94841.8us
I20260709 12:11:39.741825 11872 rpcz_store.cc:276] 0709 12:11:38.689458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.690808 (+  1350us) service_pool.cc:224] Handling call
0709 12:11:38.691216 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.869480 (+178264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.869511 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.869578 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:38.869607 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.732408 (+862801us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001a7554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:39.732467 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.732572 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409368832}
I20260709 12:11:39.753168 11769 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 4 to 6, term changed from 8 to 10, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.755695 11769 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:39.738461 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 65875.5us
I20260709 12:11:39.756824 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.704725 16824 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.757925 11769 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.758543 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.759145 11941 raft_consensus.cc:2393] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:39.739881 16753 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.735893 17008 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.781937 11769 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 9, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 9 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.783424 17008 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.784695 11944 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:39.784299 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.785959 11769 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:39.787467 16989 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
I20260709 12:11:39.787768 11769 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 11, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 11 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.789389 11769 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 4 to 5, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 5 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.790946 11769 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.792562 11769 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.793800 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 9, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 9 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.757711 16951 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:39.710094 16877 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.749683 16977 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.802932 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45680.1us
I20260709 12:11:39.800693 11943 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:39.805578 11872 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.806644 16977 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:39.808913 16977 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:39.810015 17002 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.005s
I20260709 12:11:39.802625 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.812582 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:39.813189 11945 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:39.810667 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2882) took 1116 ms. Trace:
I20260709 12:11:39.813735 12019 rpcz_store.cc:276] 0709 12:11:38.693831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.821003 (+127172us) service_pool.cc:224] Handling call
0709 12:11:38.821357 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.826518 (+  5161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.826550 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.827161 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.215949 (+388788us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:39.216089 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.216162 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.810454 (+594292us) raft_consensus.cc:1685] finished
0709 12:11:39.810475 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.810606 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4714,"raft.queue_time_us":5703,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5560,"thread_start_us":369598,"threads_started":1,"wal-append.queue_time_us":673150}
I20260709 12:11:39.795450 11769 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index -1 to 9, term changed from 11 to 13, VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added, no longer has a pending config: VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65), VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66), VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67), NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.817986 16951 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:39.822604 16992 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.823761 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:39.824431 11944 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:11:39.825690 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:39.826650 16992 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:39.827082 16992 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.827454 16992 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:39.834151 16901 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:11:39.836088 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2131) took 2879 ms. Trace:
I20260709 12:11:39.837980 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:39.839995 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.839212 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.841840 11769 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.760317 16800 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:39.852277 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.852953 11864 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:39.751327 16936 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:39.836460 11939 rpcz_store.cc:276] 0709 12:11:36.956255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.958450 (+  2195us) service_pool.cc:224] Handling call
0709 12:11:36.958828 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.959077 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.959101 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.963220 (+  4119us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.099254 (+136034us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.146532 (+ 47278us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.153121 (+  6589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.153208 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.671197 (+2517989us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800245e60. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:39.835776 (+164579us) raft_consensus.cc:1685] finished
0709 12:11:39.835892 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.836026 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6295,"prepare.queue_time_us":32504,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":6629,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1597,"spinlock_wait_cycles":4408704,"thread_start_us":66620,"threads_started":1,"wal-append.queue_time_us":147470}
I20260709 12:11:39.855345 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.855440 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.799254 16855 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:39.780239 16916 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:39.759270 16975 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:11:39.812192 16948 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.000s
I20260709 12:11:39.859432 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.876024 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.861100 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:39.853325 16857 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:39.811295 16982 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:11:39.843425 11769 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 3 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 8 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.874318 16855 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.907181 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 13, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:39.911046 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:39.926770 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:39.921867 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:39.837023 16992 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:40.017215 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 95449.8us
I20260709 12:11:40.019351 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.025571 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1947) took 3051 ms. Trace:
I20260709 12:11:40.026108 11942 rpcz_store.cc:276] 0709 12:11:36.974653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.018470 (+ 43817us) service_pool.cc:224] Handling call
0709 12:11:37.046638 (+ 28168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.911177 (+864539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.025237 (+2114060us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540037ffd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:40.025485 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948244352}
I20260709 12:11:39.881456 16948 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.034376 12017 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:40.035285 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.027714 16932 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.014608 16857 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.036856 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 231386us
I20260709 12:11:40.062361 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.052850 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.056083 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:40.045621 12016 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 10: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:40.057499 16932 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.066773 17016 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.067199 16932 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.067303 16919 consensus_queue.cc:1059] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:40.030900 16749 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:40.030248 16936 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.079075 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.008103 16855 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.083042 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:40.080996 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.093052 16756 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.093376 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.094035 12021 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:40.101236 16979 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.044598 17017 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:40.116631 17017 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:40.117841 17005 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.603s	user 0.002s	sys 0.006s
I20260709 12:11:40.091195 16894 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.089059 16749 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.122577 16711 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.115926 16374 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.092434 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.059149 16995 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:40.132948 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.087929 16933 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.087718 16942 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:40.123210 16487 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.139621 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.069366 16857 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.097396 16992 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.129865 16374 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:40.135852 16881 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.088521 16936 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.151485 16979 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.152299 16824 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.154829 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.158492 11873 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:40.138873 16933 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.163028 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.168145 11873 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 7.
I20260709 12:11:40.169328 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.172150 16948 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.155431 17017 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:40.147591 16984 consensus_meta.cc:287] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 12:11:40.187495 12609 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.175161 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.189673 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:40.190948 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:40.191685 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.156016 16881 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.145004 16487 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.193928 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.197757 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:40.198565 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.162837 16976 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.174156 16933 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.203423 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.167546 16942 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.148078 16677 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:40.201815 16881 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.197527 16995 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.205670 16487 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.211974 16942 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.192986 16984 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.236320 16995 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.240505 16936 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.242129 16995 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.243853 16857 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.244454 11870 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.254652 16975 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.255460 16975 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:40.261664 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.262636 16855 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:40.262995 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.266543 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2090) took 1821 ms. Trace:
I20260709 12:11:40.267093 11865 rpcz_store.cc:276] 0709 12:11:38.444710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.444861 (+   151us) service_pool.cc:224] Handling call
0709 12:11:38.445145 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.584486 (+139341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.266217 (+1681731us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b54002d9954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:40.266461 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189167488}
I20260709 12:11:40.272385 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2803) took 1582 ms. Trace:
I20260709 12:11:40.272789 16984 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.234953 16942 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.232471 16979 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.275472 16979 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.272809 11868 rpcz_store.cc:276] 0709 12:11:38.689874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.690004 (+   130us) service_pool.cc:224] Handling call
0709 12:11:38.690302 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.852555 (+162253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.852601 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.852660 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:38.852706 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.272172 (+1419466us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001608d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:40.272213 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.272329 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372491136}
I20260709 12:11:40.281708 16749 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.232718 16374 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.286983 16862 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.287520 16862 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.289665 16855 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.290248 16855 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.292390 16855 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.293511 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39778 (request call id 610) took 1212 ms. Trace:
I20260709 12:11:40.287544 11837 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.294028 11867 rpcz_store.cc:276] 0709 12:11:39.080735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.080882 (+   147us) service_pool.cc:224] Handling call
0709 12:11:40.293273 (+1212391us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400094cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:40.293450 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168314368}
I20260709 12:11:40.294624 16932 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.295650 16995 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.295771 11837 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.296535 16936 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:40.296737 16997 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.652s	user 0.005s	sys 0.005s
I20260709 12:11:40.296432 16995 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:40.298193 11837 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.298854 16932 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.299340 11870 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:11:40.333657 11870 pending_rounds.cc:85] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 9
I20260709 12:11:40.334164 11870 pending_rounds.cc:107] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:11:40.334396 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.300797 16356 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:40.301753 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.302060 16857 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:40.344444 16857 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.346271 16877 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.346745 16857 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.304322 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.308073 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.310055 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.311054 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.312402 16849 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:40.314631 16753 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 12:11:40.362488 11837 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.363013 12014 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:40.313306 12606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 545) took 1194 ms. Trace:
I20260709 12:11:40.313205 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:40.314832 16533 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.316605 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:40.396651 11943 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.317305 16915 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.317765 16862 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.317301 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:40.326709 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 236590us
I20260709 12:11:40.404706 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.405699 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:40.333518 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.299940 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:40.409961 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47558.2us
I20260709 12:11:40.412139 11943 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:40.300133 16979 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.337703 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:40.339874 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.340096 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.423080 12016 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:40.421468 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:40.341768 11912 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:40.342581 16795 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.342645 16916 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:40.343109 16982 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.343422 16992 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:40.343737 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.350941 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.454216 12013 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
W20260709 12:11:40.319054 16993 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.805s	user 0.000s	sys 0.005s
I20260709 12:11:40.361852 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:40.455862 12022 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:40.366621 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.363958 12606 rpcz_store.cc:276] 0709 12:11:39.118994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.119140 (+   146us) service_pool.cc:224] Handling call
0709 12:11:40.313126 (+1193986us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b5400650254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:40.313250 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121165184}
I20260709 12:11:40.334508 11870 raft_consensus.cc:2889] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:40.460235 16987 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.064s	user 0.002s	sys 0.000s
I20260709 12:11:40.426292 16973 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:40.461170 16973 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:40.340384 16886 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:40.462131 16973 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.463423 16973 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.431646 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:40.445986 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 104326us
I20260709 12:11:40.447765 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:40.456729 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 90215us
I20260709 12:11:40.448647 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.403779 16932 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.450858 12608 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:40.466076 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.466540 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:40.479528 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.456663 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.444031 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.426785 16995 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.443806 16795 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:40.438995 16978 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:40.514149 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 48123.7us
W20260709 12:11:40.514422 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46386.8us
I20260709 12:11:40.535246 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.404407 16753 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.537673 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.566291 16942 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.569254 16942 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.486485 16446 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.501770 16979 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.452077 16916 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.536700 16756 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.591404 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.605577 11866 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.514057 16877 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:40.551730 16984 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.533562 16849 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.610162 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2868) took 2002 ms. Trace:
I20260709 12:11:40.625358 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.616997 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.629218 11942 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:40.623868 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.619448 11945 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.612627 12020 rpcz_store.cc:276] 0709 12:11:38.608231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.611394 (+  3163us) service_pool.cc:224] Handling call
0709 12:11:38.635590 (+ 24196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.635795 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:40.174398 (+1538603us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b1800251c80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf
0709 12:11:40.174531 (+   133us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.606814 (+432283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:40.606890 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:40.606953 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.607031 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.610107 (+  3076us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8670,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":11230,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":11389184,"thread_start_us":485370,"threads_started":2}
I20260709 12:11:40.491088 17033 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.465631 16992 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.454599 16982 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.589268 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:40.645399 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.646289 11868 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:40.646617 11946 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:40.465620 16487 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.598645 16795 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:40.634775 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.651211 11945 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:40.639829 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:40.652381 11870 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:40.592047 16446 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:40.642442 11872 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:11:40.642524 11865 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.657030 11872 pending_rounds.cc:85] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 10
I20260709 12:11:40.600164 16979 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.552289 16372 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:40.605790 16756 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.671208 16756 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.657425 11872 pending_rounds.cc:107] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:11:40.673919 11872 raft_consensus.cc:2889] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:40.660161 16446 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.678452 16975 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.679137 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.680245 11942 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:40.683943 16753 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:40.623512 16916 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.684990 16916 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:40.685683 16916 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:40.686471 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.688405 16881 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.689759 11873 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:40.691213 16881 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:40.692976 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.693969 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:40.696715 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.697935 12608 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:40.657677 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.624725 16984 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:40.662024 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 522455us
I20260709 12:11:40.653646 16533 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:40.724053 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 267418us
I20260709 12:11:40.711424 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:40.714097 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.731160 12020 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.725463 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:40.634519 16849 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.656308 16795 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.661779 16979 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.694036 17032 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.722095 16984 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.714591 16487 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.712934 16593 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:11:40.742077 17006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.005s	sys 0.008s
I20260709 12:11:40.744678 16976 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.746587 16795 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:40.772444 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.747897 16855 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:40.777930 16855 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.780169 16855 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.780705 16855 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:40.768939 17006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.006s	sys 0.008s
I20260709 12:11:40.782130 17006 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:40.783133 17006 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:40.767894 16933 consensus_meta.cc:287] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.003s
I20260709 12:11:40.781186 16855 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.767373 17032 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:40.804828 16915 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.795877 16886 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:40.793321 16916 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:40.790125 16933 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:40.816643 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.824152 12020 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
W20260709 12:11:40.827869 17008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.001s
I20260709 12:11:40.810879 16982 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.827111 16849 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.826459 16916 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.842437 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.843338 12021 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 9.
W20260709 12:11:40.836266 17008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.015s	sys 0.002s
W20260709 12:11:40.902053 17004 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.189s	user 0.001s	sys 0.010s
W20260709 12:11:40.902614 17038 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:11:40.903656 17039 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:11:40.907696 17025 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.672s	user 0.001s	sys 0.004s
W20260709 12:11:40.908891 17055 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:11:40.905431 17023 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.671s	user 0.001s	sys 0.001s
I20260709 12:11:40.912850 17032 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:40.916177 16986 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.532s	user 0.004s	sys 0.001s
I20260709 12:11:40.916554 16992 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:40.950078 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2814) took 1073 ms. Trace:
I20260709 12:11:40.951187 11864 rpcz_store.cc:276] 0709 12:11:39.876017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.877392 (+  1375us) service_pool.cc:224] Handling call
0709 12:11:39.877815 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.879287 (+  1472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.879330 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.879885 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.131862 (+251977us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:40.394017 (+262155us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.430494 (+ 36477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.430975 (+   481us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.907003 (+476028us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:40.948942 (+ 41939us) raft_consensus.cc:1685] finished
0709 12:11:40.949242 (+   300us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.949780 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36795,"prepare.queue_time_us":483846,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":40480,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":8424,"spinlock_wait_cycles":8662912,"thread_start_us":506630,"threads_started":2,"wal-append.queue_time_us":331593}
W20260709 12:11:40.958215 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 304525us
I20260709 12:11:40.959403 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2809) took 1108 ms. Trace:
W20260709 12:11:40.961823 11871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.007s	sys 0.005s
W20260709 12:11:40.962456 11871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.005s
I20260709 12:11:40.966195 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 1978) took 1853 ms. Trace:
W20260709 12:11:40.970292 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 383416us
I20260709 12:11:40.966826 11948 rpcz_store.cc:276] 0709 12:11:39.112391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.118569 (+  6178us) service_pool.cc:224] Handling call
0709 12:11:39.118961 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.121527 (+  2566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.121606 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.139107 (+ 17501us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.644925 (+505818us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:39.644967 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.645031 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.901379 (+1256348us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:40.965122 (+ 63743us) raft_consensus.cc:1685] finished
0709 12:11:40.965186 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.965893 (+   707us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2734,"raft.queue_time_us":2488,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5324,"spinlock_wait_cycles":3393792,"thread_start_us":451008,"threads_started":1,"wal-append.queue_time_us":536879}
W20260709 12:11:40.975127 11940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.001s	sys 0.013s
I20260709 12:11:40.974887 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:40.975679 11940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.013s
I20260709 12:11:40.977830 12017 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:40.980530 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:40.825487 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:40.986186 12020 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:40.986505 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.989485 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.989931 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.990813 11941 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:40.970528 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2871) took 2361 ms. Trace:
I20260709 12:11:40.992560 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.993652 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:40.994194 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:40.995604 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2815) took 1111 ms. Trace:
I20260709 12:11:40.996079 11873 rpcz_store.cc:276] 0709 12:11:39.884134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.190704 (+306570us) service_pool.cc:224] Handling call
0709 12:11:40.995162 (+804458us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54003557d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:40.995370 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145497856}
I20260709 12:11:40.996982 11947 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:41.002795 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:40.959960 11869 rpcz_store.cc:276] 0709 12:11:39.850605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.850756 (+   151us) service_pool.cc:224] Handling call
0709 12:11:39.851162 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.851541 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.851567 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.851973 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.131488 (+279515us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:40.131529 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.131611 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.887733 (+756122us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:40.958663 (+ 70930us) raft_consensus.cc:1685] finished
0709 12:11:40.958710 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.959169 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":898,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":8150,"spinlock_wait_cycles":7457920,"thread_start_us":279173,"threads_started":1,"wal-append.queue_time_us":365491}
I20260709 12:11:41.006717 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 606) took 2557 ms. Trace:
I20260709 12:11:40.991362 12015 rpcz_store.cc:276] 0709 12:11:38.609131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.609281 (+   150us) service_pool.cc:224] Handling call
0709 12:11:38.609691 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.679344 (+ 69653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.679385 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.680068 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.076040 (+395972us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:39.076080 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.076144 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.915615 (+1839471us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:40.969670 (+ 54055us) raft_consensus.cc:1685] finished
0709 12:11:40.969724 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.970239 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17312,"raft.queue_time_us":186880,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":401249024,"thread_start_us":387167,"threads_started":2,"wal-append.queue_time_us":494008}
I20260709 12:11:41.018492 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.019009 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.026595 16361 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.027812 16361 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.025357 16372 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.036571 16361 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.037823 16862 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.038093 16782 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.038904 16881 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.840929 16849 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.040863 16855 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.044344 16760 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:40.889956 16877 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:41.046945 17013 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.047852 17037 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.049983 16886 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.055471 16933 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.047024 16749 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:11:41.059981 16817 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.060202 16984 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.065668 16533 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.065948 16977 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:41.018565 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.002377 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:41.126123 11866 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:41.135723 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 155691us
I20260709 12:11:41.128554 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 961) took 2021 ms. Trace:
I20260709 12:11:41.105646 16361 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.150195 16877 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:41.153338 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.153903 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:41.162688 11948 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:41.163132 17037 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.164125 16984 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.164672 11864 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:41.165251 11869 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:11:41.166360 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.007402 11871 rpcz_store.cc:276] 0709 12:11:38.449134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.449610 (+   476us) service_pool.cc:224] Handling call
0709 12:11:38.449953 (+   343us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:38.450339 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:38.471755 (+ 21416us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.626360 (+154605us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:11:38.628418 (+  2058us) log.cc:844] Serialized 104 byte log entry
0709 12:11:38.640343 (+ 11925us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:39.794555 (+1154212us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18003aa4a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:40.285033 (+490478us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b18003aa4a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf
0709 12:11:40.285246 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.964109 (+678863us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.964764 (+   655us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.005608 (+ 40844us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.005958 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.006151 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.006245 (+    94us) raft_consensus.cc:1685] finished
0709 12:11:41.006262 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.006616 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17621,"prepare.queue_time_us":33060,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":11122,"raft.queue_time_us":91273,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":16617,"spinlock_wait_cycles":16082688,"thread_start_us":852550,"threads_started":3,"wal-append.queue_time_us":254925,"wal-append.run_cpu_time_us":2440,"wal-append.run_wall_time_us":1005339}
I20260709 12:11:41.141389 11940 rpcz_store.cc:276] 0709 12:11:39.107012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.107550 (+   538us) service_pool.cc:224] Handling call
0709 12:11:39.107968 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.108475 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:11:39.132938 (+ 24463us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.279495 (+1146557us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800385960. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d323a 00007f1f1ba3da2a
0709 12:11:40.976627 (+697132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.001712 (+ 25085us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.002228 (+   516us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:11:41.002501 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.002605 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.067226 (+ 64621us) raft_consensus.cc:1685] finished
0709 12:11:41.105488 (+ 38262us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.128483 (+ 22995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2138,"prepare.queue_time_us":24320,"raft.queue_time_us":53914,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":12373,"spinlock_wait_cycles":30072576,"thread_start_us":696472,"threads_started":1,"wal-append.queue_time_us":1765836}
I20260709 12:11:41.146111 16533 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.182121 16487 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.182773 16366 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:41.182953 16487 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.183756 16366 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.188023 17013 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:41.188709 17013 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.188777 16886 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.192526 16881 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.194547 16855 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.195302 16855 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.195879 16855 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.196354 16915 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:41.197003 16915 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.201072 16849 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.105257 16862 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.218721 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.218977 16366 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.220623 16862 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.194694 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.222426 11872 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:11:41.223516 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 69777.2us
I20260709 12:11:41.226415 16969 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.226662 16374 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.226917 16969 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:41.227494 16969 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.233242 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.168701 16756 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.191792 16886 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:41.240942 17031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.020s	sys 0.063s
I20260709 12:11:41.233237 16487 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.236248 16881 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:41.255242 17031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.020s	sys 0.063s
I20260709 12:11:41.229847 16361 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.195355 16977 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:41.269266 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 271558us
I20260709 12:11:41.283836 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:41.286119 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.285650 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.292405 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:41.291224 16446 consensus_meta.cc:287] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.500s	user 0.015s	sys 0.003s
W20260709 12:11:41.301788 11867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.019s	sys 0.023s
W20260709 12:11:41.302284 11867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.019s	sys 0.024s
I20260709 12:11:41.302162 17003 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:11:41.305382 16991 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.732s	user 0.012s	sys 0.037s
W20260709 12:11:41.306015 16991 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.794s	user 0.012s	sys 0.037s
W20260709 12:11:41.310971 16973 consensus_meta.cc:287] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.012s
I20260709 12:11:41.313378 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.314509 11864 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:41.315220 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.314347 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:41.316581 11869 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:41.316754 16356 consensus_meta.cc:287] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.955s	user 0.006s	sys 0.017s
I20260709 12:11:41.318413 12605 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:41.321787 16830 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.326140 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.326915 11872 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:41.331609 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:41.333122 11870 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:41.321837 16756 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.334455 16487 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.335757 16795 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.006s
I20260709 12:11:41.335366 16487 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:41.336156 11944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.018s	sys 0.019s
W20260709 12:11:41.336666 11944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.018s	sys 0.020s
I20260709 12:11:41.337618 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.337934 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2155) took 1290 ms. Trace:
I20260709 12:11:41.328334 16446 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.338418 11944 rpcz_store.cc:276] 0709 12:11:40.047852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.048040 (+   188us) service_pool.cc:224] Handling call
0709 12:11:40.048456 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.055214 (+  6758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:40.055246 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:40.617477 (+562231us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:11:40.617878 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.337230 (+719352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.337369 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.337483 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.337549 (+    66us) raft_consensus.cc:1685] finished
0709 12:11:41.337565 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.337867 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6305,"raft.queue_time_us":9319,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":10876672,"thread_start_us":718815,"threads_started":1,"wal-append.queue_time_us":687719}
I20260709 12:11:41.340247 11942 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.341063 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.342041 11871 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:41.343001 16830 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.343652 16795 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.346745 17037 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.348389 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.351042 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:41.358865 16361 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.359589 17059 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.360890 16942 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.359678 17061 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:41.362097 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.362326 17061 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:41.362692 17061 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:41.362725 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.363688 12013 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:41.363893 17061 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.365403 12020 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.338431 11873 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:41.338467 16487 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.341382 16446 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:41.377626 11986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.017s
I20260709 12:11:41.372699 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:41.391873 11986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.006s	sys 0.018s
I20260709 12:11:41.321885 16855 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.389217 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:41.386981 16356 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:41.388336 17061 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.410027 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.370080 16942 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:41.431221 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 227371us
I20260709 12:11:41.422830 17003 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.436180 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.439980 16977 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.455425 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2164) took 1111 ms. Trace:
I20260709 12:11:41.467270 11871 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:41.477993 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.463944 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.484257 11942 rpcz_store.cc:276] 0709 12:11:40.344112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.683469 (+339357us) service_pool.cc:224] Handling call
0709 12:11:40.683830 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.340734 (+656904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.455101 (+114367us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400426654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:41.455346 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508724480}
I20260709 12:11:41.476114 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.475777 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:41.457716 12605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41000 (request call id 1066) took 2696 ms (client timeout 2245 ms). Trace:
W20260709 12:11:41.490386 12605 rpcz_store.cc:269] 0709 12:11:38.761295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.764594 (+  3299us) service_pool.cc:224] Handling call
0709 12:11:41.457391 (+2692797us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400624b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:41.457599 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5731501312}
I20260709 12:11:41.493021 12015 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.475318 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.483325 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:41.449445 16830 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:41.521785 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 224827us
I20260709 12:11:41.479856 16942 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.520364 17059 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.530272 17059 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.527328 16830 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.527402 12019 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:41.533905 16830 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:41.534982 16830 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.535643 16533 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:41.535620 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.538208 16533 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:41.456959 16979 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.702s	user 0.002s	sys 0.017s
I20260709 12:11:41.480726 17003 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.533305 17059 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.573412 12020 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:41.552055 16979 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.594082 16533 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:41.597770 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:41.598150 16533 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.597858 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.598785 12013 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.602456 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.603127 12018 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:41.605016 16991 raft_consensus.cc:3055] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:41.605525 16991 raft_consensus.cc:740] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:41.606057 16533 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.606796 16991 consensus_queue.cc:260] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.608251 16991 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.617916 17006 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.618635 17006 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.621364 17006 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.618610 12013 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:41.599709 12022 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
W20260709 12:11:41.630214 17071 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:41.632380 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.635421 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.636279 12021 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:41.637390 17058 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.637835 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.639956 16795 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.641193 16855 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.637938 17058 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.649920 17058 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.650204 12016 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:41.654872 12014 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:41.655850 16979 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.656136 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 2908) took 1008 ms. Trace:
I20260709 12:11:41.629272 16969 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.656519 12014 rpcz_store.cc:276] 0709 12:11:40.647785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.812705 (+164920us) service_pool.cc:224] Handling call
0709 12:11:41.655903 (+843198us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b5400179b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:41.656062 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924596608}
I20260709 12:11:41.654762 12603 raft_consensus.cc:2410] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:41.658819 16969 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.661142 17003 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.663074 11941 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:41.664701 16533 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.665194 16533 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.668296 16533 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.669751 17013 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.672173 17013 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.631299 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:41.626398 17059 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.674088 17059 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.676720 17059 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:41.687170 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:41.687441 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:41.688063 12016 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.688932 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.690124 12015 raft_consensus.cc:2410] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:11:41.690800 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 344215us
I20260709 12:11:41.692140 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:41.693647 16374 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.695106 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.695200 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:41.695581 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.696236 12019 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:41.696388 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:41.686496 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 960969us
I20260709 12:11:41.698143 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.698791 12019 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:41.700850 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.702014 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.702950 12608 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:41.704427 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.578300 16915 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.701375 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:41.706911 17006 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:41.705899 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.707286 16915 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.726163 12015 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:41.728349 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:41.729068 12603 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:41.722179 16991 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.737068 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:41.737780 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.738184 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.738399 12608 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.738469 12016 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:41.739327 16991 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.746642 12019 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:41.746263 12018 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:41.753754 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:41.740932 16977 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.766528 11942 raft_consensus.cc:1240] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:41.770298 11944 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:41.735852 17058 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.772811 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.759153 16991 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:41.777370 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85384.5us
I20260709 12:11:41.758162 17013 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:41.780563 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:41.785363 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:41.786633 11941 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.792008 17003 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.791846 16374 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.783182 16977 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.807276 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:41.806167 12016 raft_consensus.cc:2410] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:11:41.815225 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.821200 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.793977 17013 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:41.806331 17003 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.807803 16915 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:41.831651 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:41.829772 11941 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:41.836002 11944 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:41.831035 17003 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.840181 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:41.830569 16374 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:41.863219 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 157744us
W20260709 12:11:41.865794 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 93079.3us
W20260709 12:11:41.871554 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.873319 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.876869 11941 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:41.876955 11873 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:41.876626 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.869671 16973 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.882803 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:41.867625 16533 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.887662 11869 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:41.890177 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:41.875766 17058 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.883934 16942 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:41.899742 11871 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
W20260709 12:11:41.903911 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84504.4us
I20260709 12:11:41.904639 11912 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:41.917904 16932 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.918632 11872 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:41.918577 16932 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.920135 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:41.915047 12608 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:41.907352 17013 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:41.907176 16973 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.926537 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:41.939357 16932 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:41.940696 17080 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:11:41.942114 17077 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:41.946077 16374 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.954389 12015 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:41.955596 12019 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.956573 16942 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:41.959136 16942 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.961861 16973 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.965775 17069 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.966400 17069 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.966813 17069 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.921389 16977 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:41.980644 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:41.987295 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 88909.2us
I20260709 12:11:41.996731 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:41.994128 16374 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:42.000737 17082 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:11:42.004194 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.012850 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:42.014125 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 114026us
I20260709 12:11:42.017904 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:42.026787 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99391.6us
I20260709 12:11:42.009915 16374 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:42.031967 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.012239 17006 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:42.036628 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46500.6us
I20260709 12:11:42.038683 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:42.039131 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.039783 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.042371 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:42.044370 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.039889 16915 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.036207 16372 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:42.045069 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:42.046075 16366 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:42.050335 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 52487us
I20260709 12:11:42.047082 17061 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.070606 17061 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.071082 17061 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.072058 11986 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.072674 16857 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.073417 17059 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.067776 17003 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.073982 17059 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.074473 17059 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.075835 17003 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.075932 17069 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.076548 11986 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.077639 16969 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.078611 16446 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.050696 16374 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.079051 16446 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.079510 16446 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.073437 16857 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.054934 16366 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.095310 16857 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.085381 17069 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.067041 16372 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:42.104379 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.107470 12603 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.102128 16366 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:42.124399 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 85860.1us
I20260709 12:11:42.127424 17069 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:42.132512 16487 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.133338 16487 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.135802 16487 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.138068 16372 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.145964 16991 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.147882 12608 raft_consensus.cc:2368] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:42.114355 16857 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.156198 16857 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.159505 16857 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.160210 17062 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:42.180601 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52397.8us
I20260709 12:11:42.179725 16830 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:42.183015 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:42.195686 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 115886us
I20260709 12:11:42.198662 12603 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:42.204990 17059 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.208063 17059 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.211512 16857 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.218760 11912 leader_election.cc:400] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:42.219303 11912 leader_election.cc:403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:42.220479 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:42.225682 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:42.223037 16802 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:11:42.228945 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:42.229888 16677 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.230366 16677 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.230780 16677 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.232487 16446 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.235670 17006 raft_consensus.cc:2764] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:42.237920 16795 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.243022 17090 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.243546 17090 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.243935 17090 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.246783 16991 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:42.257651 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.216379 16915 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.261209 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.266525 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.268278 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.271126 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:42.272555 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 89666us
I20260709 12:11:42.277199 16366 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.281179 16366 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:42.296633 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:42.301033 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58540us
I20260709 12:11:42.302681 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.298316 16374 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.305946 16374 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.311997 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.321192 12603 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:42.308950 16374 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.322988 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:42.331514 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.332315 12603 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:42.334167 16915 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:42.334367 17092 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:42.334830 16915 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:42.335944 16915 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.338440 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.339352 12608 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:42.338454 16446 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.339793 17061 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.341569 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.313925 16366 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:42.341801 12018 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:42.313993 16795 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:42.329044 17090 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:42.358332 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64340.1us
I20260709 12:11:42.364749 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.365268 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.368338 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.369484 12016 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.348641 17062 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.371609 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.372102 12015 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.347569 16677 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.377848 16677 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:42.381655 16366 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.374306 17062 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:42.386365 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 71905.4us
I20260709 12:11:42.387391 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:42.388976 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.391032 16857 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:42.391620 16857 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.392072 16857 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.392252 17003 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:11:42.393671 16677 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.394055 16677 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:42.395001 16677 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.370976 17000 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:42.396332 16677 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.401402 12017 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.392108 12016 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:42.417445 16487 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.418808 16487 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:42.419494 17095 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
W20260709 12:11:42.419970 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 46035.8us
I20260709 12:11:42.420281 17059 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.420977 11986 leader_election.cc:400] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:42.421386 11986 leader_election.cc:403] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:42.421900 17093 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:42.422056 17059 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.425576 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.427642 16487 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.430841 17090 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.431748 12603 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.434566 17090 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:42.447206 17090 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.448356 17090 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:42.437723 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48930.4us
W20260709 12:11:42.442381 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.443876 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.444911 16969 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.450883 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.450917 16969 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.454414 16366 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.454919 16366 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.455355 16366 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.456663 11942 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:42.458145 12019 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:42.459719 16969 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:42.478116 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.453522 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:42.479346 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62317.7us
I20260709 12:11:42.498251 12603 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.483286 16857 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.483906 16969 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.500787 16857 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.500957 16969 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.501834 16969 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.483513 17061 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.509953 17058 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:42.487054 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.512750 12018 raft_consensus.cc:2410] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:11:42.497717 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 76057us
I20260709 12:11:42.484911 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.496279 11867 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:42.516445 11867 pending_rounds.cc:85] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:42.522346 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:42.516865 11867 pending_rounds.cc:107] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:42.526156 11867 raft_consensus.cc:2889] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.475235 17062 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.536024 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.534221 16802 raft_consensus.cc:2764] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:42.543394 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.552466 11870 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:42.541676 17059 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
W20260709 12:11:42.553948 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.516368 17006 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:42.556717 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.537664 17061 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.562770 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:42.563236 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 78463.2us
I20260709 12:11:42.537796 17000 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
W20260709 12:11:42.624650 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57868.1us
I20260709 12:11:42.639936 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.642552 11870 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 6 to 9, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:42.644728 16372 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.645045 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:42.645711 16372 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.655028 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.657019 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.657876 12015 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.665613 12022 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.666846 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.667732 11869 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.666982 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.667047 11942 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.667874 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.670104 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:42.670267 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.672467 12019 raft_consensus.cc:2368] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:42.662171 16991 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.680568 17091 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.688416 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.689306 12019 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:42.682113 16677 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:42.674042 17061 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.696863 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:42.674921 16372 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.699249 17090 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.690557 16991 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:42.703405 17090 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.703668 16991 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.699213 17062 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.700021 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.730798 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.731556 11871 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.733803 12015 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:42.735308 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:42.708379 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74865.4us
I20260709 12:11:42.690013 17003 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:11:42.722043 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.722400 11864 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:42.695101 16677 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:42.725999 12022 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.748209 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:42.702138 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:42.737226 11868 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:42.687065 17091 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:42.744843 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.696906 17061 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.744131 12018 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:42.760955 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.769965 12016 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:42.772883 11944 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:42.772970 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:42.739888 17090 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:42.785988 17090 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.788383 17090 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.774501 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.789713 11867 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.773977 12015 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:42.792869 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.793964 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:42.794207 12019 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:42.794502 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:42.794930 11865 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:42.795451 11864 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:42.795872 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.796505 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.796960 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.798753 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.748500 16969 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.800009 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:42.800841 11868 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:42.748878 16487 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.777477 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.777881 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.778692 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.778574 11941 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:42.779743 17091 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.786432 12018 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.776846 11948 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.753497 16366 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.796538 11865 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.815495 16366 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:42.816557 17110 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:42.816819 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.818747 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:42.822582 11869 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:42.813313 17091 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.761708 17061 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.801369 16969 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:42.759896 17062 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:42.828931 11947 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
W20260709 12:11:42.831647 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56384.6us
I20260709 12:11:42.839514 11944 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:42.841478 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.841780 11871 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:42.842701 11942 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
W20260709 12:11:42.845001 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.864610 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.837713 17110 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.868147 17110 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:42.869410 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.871156 11948 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.871930 11939 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:42.872529 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.873137 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.874579 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.875227 11945 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.871213 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.879046 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.879606 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.879878 11939 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:42.881093 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:42.887317 12608 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:42.888885 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.833283 16487 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:42.891786 16487 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:42.892078 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.892544 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.892850 11941 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.893288 16677 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:42.894025 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.894428 16677 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.894613 11946 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.896136 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.896762 11940 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:42.898445 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.899786 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:42.902009 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:42.903491 16795 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:42.903735 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.906001 11948 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:42.905944 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.907678 11865 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:42.908676 16915 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:42.910375 16915 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:42.911137 16915 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:42.912274 17062 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.912643 17062 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:42.913671 17062 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:42.915249 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48468.4us
I20260709 12:11:42.916646 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.917642 16969 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:42.918067 16969 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:42.918437 16969 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:42.922592 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:42.927376 17062 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.928148 11941 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:42.933956 11945 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:42.938719 11867 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:42.942452 16802 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:42.945923 17006 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.954213 16830 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.967176 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:42.972838 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 306541us
I20260709 12:11:42.974560 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.979625 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:42.983467 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61020.2us
W20260709 12:11:42.989403 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.970366 16802 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:42.977468 17006 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.016497 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.987849 17000 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.018388 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:42.992100 16915 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.022200 11946 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:42.998584 16228 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:11:42.987861 16830 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.028656 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.029507 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.030283 11945 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:43.032461 16366 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.033499 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.046494 11771 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.049209 11771 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 7 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 10 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.051712 11771 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.053712 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 125) took 11178 ms. Trace:
I20260709 12:11:43.056236 11771 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 13, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.059600 11771 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.061187 11771 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.062806 11771 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.064014 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.064353 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.064924 11941 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:43.065481 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.065917 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.065837 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.066390 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.025703 16991 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:11:43.072742 16372 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.081872 16802 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.083280 16802 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.083598 16969 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.073622 16372 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.087975 16372 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.091070 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.094566 16830 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.097368 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.069099 17061 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:43.107966 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 115219us
I20260709 12:11:43.109266 11771 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 7 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.111135 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.115450 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.104163 16991 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.095563 17006 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.108896 16915 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.119282 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.121196 11771 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.127902 11942 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:11:43.130528 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.132089 11946 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:43.134667 17061 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:43.140550 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.141240 11946 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:43.143165 17120 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:43.145377 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.145318 12017 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:43.054216 11769 rpcz_store.cc:276] 0709 12:11:31.869127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.870674 (+  1547us) service_pool.cc:224] Handling call
0709 12:11:32.087465 (+216791us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99d090 00007f1f1ba3bf3a 00007f1f217f1e9c 00007f1f218f004e 00007f1f1fdb12a4 00007f1f1fdb1232 00007f1f1fdb1161 00007f1f1fdb10dc 00007f1f1fdb0392 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:43.029775 (+10942310us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:40.601851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:40.613437 (+ 11586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:40.613482 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:40.613500 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:40.615171 (+  1671us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:40.615236 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:40.615273 (+    37us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:40.616607 (+  1334us) tablet.cc:701] Row locks acquired
0709 12:11:40.616624 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:40.616779 (+   155us) write_op.cc:270] Start()
0709 12:11:40.616903 (+   124us) write_op.cc:276] Timestamp: P: 1783599100616728 usec, L: 0
0709 12:11:40.616923 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:40.651586 (+ 34663us) log.cc:844] Serialized 6787 byte log entry
0709 12:11:41.856420 (+1204834us) op_driver.cc:464] REPLICATION: finished
0709 12:11:42.094816 (+238396us) write_op.cc:301] APPLY: starting
0709 12:11:42.094967 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:42.243103 (+148136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:42.243299 (+   196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:42.327566 (+ 84267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:42.327941 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:11:42.328005 (+    64us) write_op.cc:312] APPLY: finished
0709 12:11:42.328555 (+   550us) log.cc:844] Serialized 156 byte log entry
0709 12:11:42.335469 (+  6914us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:42.335857 (+   388us) write_op.cc:454] Released schema lock
0709 12:11:42.335947 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:42.336510 (+   563us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:42.336543 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":286,"reported_tablets":26,"spinlock_wait_cycles":238985088,"child_traces":[["op",{"apply.queue_time_us":238011,"apply.run_cpu_time_us":29038,"apply.run_wall_time_us":241676,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":439261,"prepare.run_cpu_time_us":89988,"prepare.run_wall_time_us":762693,"raft.queue_time_us":398666,"raft.run_cpu_time_us":25380,"raft.run_wall_time_us":168640,"replication_time_us":1239243,"thread_start_us":1142789,"threads_started":4,"wal-append.queue_time_us":713343}]]}
I20260709 12:11:43.144025 11771 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.118227 16991 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.148365 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.149952 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.151367 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.152963 12021 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:43.119184 17000 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.118064 16830 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:43.124645 16969 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:43.158084 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.162025 16366 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.162549 16366 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:43.162979 16366 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.165912 16830 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.166359 16830 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.157635 17006 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.167335 16830 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.149602 17120 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.168629 16830 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.169387 17120 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.170789 17120 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.170636 17000 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.179757 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:43.186893 16915 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.187147 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:43.188252 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.148209 17061 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.161003 11771 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.195585 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.197693 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.197808 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.198416 11870 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:43.201867 11946 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:43.232649 11948 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.235214 11946 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:43.191383 16969 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.193922 17061 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:43.246243 11942 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.244710 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.241084 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.227555 11771 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.248142 11771 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.253934 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.254981 11944 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:43.255870 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.256541 11945 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.258378 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.259944 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.260115 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.260654 11866 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.260927 11865 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:43.261062 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.261814 11870 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:43.262341 11871 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:43.262801 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.263474 17061 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.264818 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.264035 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.276316 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.277952 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.279237 11864 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:43.281836 11771 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.284016 16991 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.285877 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.286633 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.287736 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.288416 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.266062 17125 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:43.273190 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:43.293932 11946 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:43.306370 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:43.296844 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.243181 16969 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:43.295184 11771 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:11:43.302224 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.308403 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.309852 11944 raft_consensus.cc:2368] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:43.310258 11948 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:43.311487 11866 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:43.312817 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:43.312943 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.313638 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.314656 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.315124 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.317382 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.316282 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.323303 11945 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:43.314280 11943 raft_consensus.cc:2376] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15. Re-sending same reply.
I20260709 12:11:43.325259 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.321738 11869 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:43.326053 11771 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 11, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 11 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:43.330482 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.313865 16969 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.306691 17062 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:43.349792 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.351560 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.356679 16366 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.357918 16915 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.362617 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.366986 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.340737 17125 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.363462 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.369518 16366 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:43.366469 11771 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 9, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 9 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.372278 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.373873 11771 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.376143 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.379500 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:43.379552 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 106451us
I20260709 12:11:43.382202 11864 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:43.383715 16366 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.373894 17062 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.370076 17125 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.391811 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.388955 17062 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:43.389073 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:43.395303 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:43.364764 16915 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:43.389895 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.390698 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.397186 11942 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:43.397334 11941 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:43.397189 11771 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.398816 16372 raft_consensus.cc:2764] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:43.398936 17091 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.401185 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:43.401957 11869 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:43.406366 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.396400 17125 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.414004 11866 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.414189 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:43.417073 11864 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:43.399164 16915 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.423648 17090 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:43.424633 16372 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:43.425673 17110 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:43.426033 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:43.426179 16795 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:43.427412 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.427492 17110 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.428582 17110 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:43.428987 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.430330 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:43.430974 17119 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.432264 17119 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:43.431461 16487 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:43.400604 17091 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:43.442804 17139 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.443441 17139 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:43.444515 11866 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:43.399130 17126 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 12:11:43.445729 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 78941.3us
W20260709 12:11:43.450227 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48735.8us
I20260709 12:11:43.444718 17139 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.446419 17091 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.457491 16228 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.458035 16228 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.459481 16991 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.437075 17110 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.461834 17110 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.433393 17119 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.463407 17119 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.452975 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.492053 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.491284 11771 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 8, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 8 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.497833 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:43.503017 16366 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.506196 11771 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:11:43.503243 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 73013.4us
I20260709 12:11:43.507974 12608 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:43.517174 11945 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.517699 11940 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:43.490947 16830 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.522724 12021 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.529072 11864 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:11:43.504536 17062 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:11:43.535545 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 91960.9us
I20260709 12:11:43.530020 16487 consensus_queue.cc:1243] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:43.540838 11771 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 12, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.506212 17136 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:11:43.550228 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.549036 17133 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:11:43.556492 17143 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.557917 12608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:43.572638 12608 raft_consensus.cc:606] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.565817 11771 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.558876 16228 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.575665 11771 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.576838 16228 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.578490 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:43.579231 11940 raft_consensus.cc:606] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.562266 17142 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:43.580694 17142 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:43.549255 17120 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:43.581809 17142 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.583125 17142 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.583519 16915 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.586474 12608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:43.587227 12608 raft_consensus.cc:606] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:43.552891 16969 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.590965 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:43.590927 11771 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.591794 11940 raft_consensus.cc:606] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.593381 16372 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.593897 16372 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:43.592691 16969 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:43.549641 17139 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.603008 11771 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:11:43.603967 12603 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:43.605849 17091 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.607457 11947 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.609052 17091 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:43.610280 16915 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:43.594921 16372 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.613929 16366 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.618659 17120 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:43.619272 17120 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:43.620949 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.620429 17120 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.622685 17120 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:43.626561 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 77692.9us
I20260709 12:11:43.627166 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:43.627704 17126 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:43.629205 17126 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:43.630442 17138 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:43.630878 17138 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.631896 17138 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:43.615540 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74082.8us
I20260709 12:11:43.617089 17061 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.634795 17138 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.636497 17061 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:43.613299 16372 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:43.639971 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 125736us
I20260709 12:11:43.614935 17110 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.641003 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:43.641924 16487 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.642158 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:43.642364 16487 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.613126 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:43.642993 16487 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.643334 11940 raft_consensus.cc:606] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.642401 17110 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.647712 17125 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.651342 16991 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:43.651386 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:43.654819 11940 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:43.655829 17091 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:43.659834 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 116127us
W20260709 12:11:43.689368 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.664247 16969 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:43.668851 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 176849us
W20260709 12:11:43.670600 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.674577 16487 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.686861 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:43.660509 17144 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.696470 11986 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:43.698676 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:43.689105 17145 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:43.703881 16487 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.704674 17146 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:43.705200 17144 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:43.707587 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.710960 17061 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.711511 11988 leader_election.cc:400] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:43.712185 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:43.712486 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.713687 11866 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:11:43.713881 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:43.711750 17061 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 12:11:43.768224 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54469.7us
I20260709 12:11:43.709172 17119 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.771867 16228 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.772418 16228 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:43.772701 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.773399 16228 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.774777 16228 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:43.779127 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59656.5us
I20260709 12:11:43.717989 16372 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:43.782682 17090 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:43.784893 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:43.786253 17119 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.788731 17119 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:43.769688 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:43.790742 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:43.790887 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:43.791501 12603 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:43.793462 11837 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:43.796181 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:43.797431 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 85330.8us
I20260709 12:11:43.724608 17146 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:43.798920 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:43.802969 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:43.804785 16366 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.805186 16366 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:43.808974 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.809509 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.809880 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:43.810216 12014 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:43.810689 12016 raft_consensus.cc:2376] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13. Re-sending same reply.
I20260709 12:11:43.811229 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.811551 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.812291 12019 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:43.813083 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.794780 17090 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.813933 12019 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:43.815781 12014 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:43.817734 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.819732 17090 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.819783 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.820374 17090 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.820116 16366 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.821389 16366 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.821262 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.825973 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.804327 17119 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.828490 17119 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.829063 17119 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.830523 17125 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.832890 17140 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:43.802081 16372 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.833619 17140 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:43.834877 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.834738 17140 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.836108 12015 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:43.836163 17146 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.837466 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.838222 12013 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
W20260709 12:11:43.840780 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.841709 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.845971 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:43.846663 11947 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.847093 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.851142 12017 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:43.815606 17091 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:43.864804 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:43.839941 17062 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.870600 12015 raft_consensus.cc:3060] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.884830 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.878088 16372 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:43.878479 17156 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.886538 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.890892 12014 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:43.804695 17120 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:11:43.892328 17156 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:43.895051 17156 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:43.896204 16372 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:43.889883 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:43.921979 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.871551 16969 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.938097 12013 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:43.871145 16915 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:43.942833 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:43.947517 17120 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.160910 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.158494 12017 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:44.161708 12013 raft_consensus.cc:2376] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12. Re-sending same reply.
I20260709 12:11:43.918942 17144 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.166431 16487 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:43.902043 17091 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:43.923164 17062 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:44.122174 17119 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:43.984534 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 152464us
I20260709 12:11:44.136672 16366 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:44.032308 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.146816 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.983090 16915 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:44.160504 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.166452 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.180083 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.178377 16366 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.167497 12015 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:44.173143 16487 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.173110 17153 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.160877 17135 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.174160 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.176887 12017 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.174268 17120 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.181895 16366 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.184106 12015 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.190256 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:44.192215 11872 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:44.209254 12577 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:44.186059 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:44.193960 12018 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:44.210343 11866 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:44.199869 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:44.201917 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.171842 16991 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 12:11:44.213666 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:44.206061 16487 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:44.303476 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.283782 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.194423 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.183931 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.208617 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:44.351990 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 142820us
I20260709 12:11:44.191619 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.271303 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.354123 11867 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:44.271628 16366 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.363390 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.355156 12019 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:44.364387 12014 raft_consensus.cc:2393] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:44.194100 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.366073 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:44.364984 12013 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:44.180234 11947 raft_consensus.cc:2468] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
W20260709 12:11:44.252429 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.347591 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.212078 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.373415 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:44.181908 17142 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:44.350346 16487 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:44.362047 12017 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:44.183241 17144 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.375859 12022 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:44.358397 12015 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:44.377610 12013 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:44.379060 16366 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.380474 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.407087 12019 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:44.406769 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.329342 17136 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.409286 12017 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.381688 17142 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.181772 17062 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.181190 16915 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.182539 17091 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.386422 16991 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:44.335451 17119 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.355666 16228 raft_consensus.cc:2804] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.290692 17110 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.200762 17120 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:44.412364 16366 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.418125 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:44.423053 12019 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.192306 17090 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.431051 16228 raft_consensus.cc:697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:44.432356 16228 consensus_queue.cc:237] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.413841 17126 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.185918 17135 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.421475 17119 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.492838 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:44.506806 17120 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.507689 17120 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:44.511397 16366 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.512153 16366 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.509069 17120 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.514546 16366 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.514941 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:44.516144 11864 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:44.514724 17120 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.183012 17153 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:44.519857 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 316738us
I20260709 12:11:44.520022 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.467706 12019 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:44.541030 11867 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:11:44.468134 16915 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.552688 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.553895 12015 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:44.530345 17165 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.424867 17136 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.570927 12608 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:44.530663 16991 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:44.575037 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49059.4us
I20260709 12:11:44.453630 17110 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.580221 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:44.589483 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 203608us
I20260709 12:11:44.593816 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:44.596307 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:44.566630 17157 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 12:11:44.597882 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:44.615494 11941 raft_consensus.cc:2368] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
W20260709 12:11:44.600215 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.608770 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:44.620296 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:44.471602 17126 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.627400 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:44.628199 12015 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:44.522545 17119 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.630483 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:44.631040 11942 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:44.638121 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:44.639009 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:44.628464 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48353.9us
I20260709 12:11:44.642270 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:44.642830 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.645318 16366 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.639984 11944 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:44.645411 16487 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.646873 16487 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.562605 17145 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:11:44.647294 16487 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.646106 16366 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.572880 17165 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:44.648612 11988 leader_election.cc:400] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11.
I20260709 12:11:44.611446 17090 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:44.655138 16366 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.661255 16366 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:44.657188 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:44.661921 16366 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.598404 17163 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:11:44.598016 16991 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.690717 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:44.656251 17149 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:44.712393 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45624.4us
I20260709 12:11:44.717409 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:44.713801 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.713894 12603 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.719240 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.714576 16366 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.720729 16366 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.721462 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.659139 16795 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:44.723205 17154 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
I20260709 12:11:44.726842 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:44.673786 17169 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:44.705341 17146 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.734429 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.715644 17171 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.685488 17155 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:44.744395 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.721046 17149 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:44.724423 16969 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.760875 16366 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.761505 16366 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.754285 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:44.761970 16366 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.757982 16487 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.725392 17173 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.766701 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.739630 17142 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.740018 17146 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:44.771674 16487 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:44.747179 17156 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.760005 17149 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.776878 11914 leader_election.cc:400] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:44.734027 16795 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.814481 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1037) took 1120 ms. Trace:
I20260709 12:11:44.814998 12021 rpcz_store.cc:276] 0709 12:11:43.695937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.696160 (+   223us) service_pool.cc:224] Handling call
0709 12:11:43.713388 (+ 17228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.713785 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.713816 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.726855 (+ 13039us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.869804 (+142949us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:43.869869 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.869981 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.814176 (+944195us) raft_consensus.cc:1685] finished
0709 12:11:44.814213 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.814381 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67823,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":67760,"threads_started":1,"wal-append.queue_time_us":524875}
I20260709 12:11:44.816272 16795 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.778784 17139 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.782816 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.817902 16969 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.818451 16969 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.819561 17156 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:44.784716 17170 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:44.785156 17159 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.820902 16969 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.740557 17165 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.786887 16991 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.789129 17110 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:44.790042 17164 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:11:44.772557 17090 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.793336 16366 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.754145 17171 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.799085 17136 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.776922 17135 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:44.801498 17166 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:11:44.774246 17146 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.764498 17183 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.887534 12017 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:44.769974 17173 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:44.810264 17119 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:44.895529 17126 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:44.819618 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.899811 16366 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:44.900768 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 81239.7us
I20260709 12:11:44.901724 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:44.845158 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 122474us
W20260709 12:11:44.837126 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.821486 16969 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.844064 17187 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:44.914692 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 187974us
I20260709 12:11:44.898847 17169 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.775502 17153 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:44.908659 17156 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:44.973668 17182 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:44.905635 17126 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.977864 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:44.908491 16795 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.907819 16991 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.915724 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:44.980242 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.986480 17156 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:44.988090 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.010802 16991 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.011643 11945 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:11:45.012478 17168 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.013389 16991 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.012858 17156 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.990219 17149 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:44.991636 17133 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.991895 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:44.992743 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:44.993907 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.019224 12605 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:44.994716 17171 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.018078 17133 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.034977 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.035959 12611 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:44.916675 16969 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:45.043102 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 127469us
I20260709 12:11:45.050438 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.051328 12611 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:11:45.051476 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.052137 12017 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:45.052256 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.059962 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.060704 12017 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:45.062240 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:44.981079 17090 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:45.067232 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.073303 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.073712 17193 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:45.074422 12605 raft_consensus.cc:2393] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:45.053958 17062 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.064069 17120 consensus_meta.cc:287] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.001s
I20260709 12:11:45.079545 11837 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:45.079799 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.080044 11912 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.081427 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:45.081857 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 334252us
I20260709 12:11:45.035372 17126 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.059305 17173 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.054764 17190 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.046397 16795 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:11:45.066109 17153 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.122274 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.078080 17136 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:45.082861 17180 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.136197 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 141948us
I20260709 12:11:45.144675 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:45.123791 17144 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.003s
W20260709 12:11:45.139771 17191 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:45.124516 17091 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.125818 17188 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:45.146656 17126 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:45.147886 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66521.3us
I20260709 12:11:45.162040 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.115497 17193 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:45.126300 16915 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.002s
I20260709 12:11:45.155594 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.156999 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.123556 17149 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:45.151139 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.560s (SENT)
I20260709 12:11:45.159118 12020 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:45.162384 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.148366 17169 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:45.164532 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.173346 16915 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:45.173959 16915 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:45.161154 17135 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.174955 16915 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.175061 17135 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.168347 17190 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.180058 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.181699 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.181973 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.183477 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.184337 11947 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.145500 17153 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.168671 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.169854 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.186820 12017 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:45.186955 12019 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:45.187080 11940 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:45.169961 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.187918 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.188771 11942 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:45.170449 11943 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:45.085886 17062 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.171972 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:45.184993 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.193442 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.163417 17188 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.202576 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.203320 12018 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.159101 17091 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.190968 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.205732 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.165268 17193 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:45.196708 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.198446 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.205996 12019 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
W20260709 12:11:45.209482 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 58393.2us
I20260709 12:11:45.194367 11945 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
W20260709 12:11:45.210250 11839 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.590s (SENT)
I20260709 12:11:45.210696 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.210942 11988 leader_election.cc:400] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:45.211437 11988 leader_election.cc:403] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.207520 17120 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:45.212536 17120 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.212975 17120 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:45.213519 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.214426 12016 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:45.216552 16969 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.217576 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.218348 12022 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:45.218508 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.219419 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.219672 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.220188 12022 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:45.219504 17062 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.221496 12015 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.171325 17144 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.192996 17169 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:45.208348 17091 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.155268 17180 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.235733 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.249316 17192 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.241560 17062 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:45.236308 17173 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.254158 17173 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.254345 17062 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.254657 17173 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.254886 17062 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.255332 17062 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.241123 17138 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.221307 17110 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.257716 17138 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.258129 17138 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.257918 17110 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.260411 17110 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.236591 11947 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:45.207952 17119 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:45.221514 17193 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.243672 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.206212 17188 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:45.238477 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.248s (SENT) [suppressed 52 similar messages]
I20260709 12:11:45.263732 12018 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:45.236219 17189 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.279614 17189 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:45.280256 17189 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.286571 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.236004 17144 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.231089 17190 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:45.277164 12018 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:45.277093 17169 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.247681 17135 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.271082 12022 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
W20260709 12:11:45.321226 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57572.1us
I20260709 12:11:45.323720 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:45.320894 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 297874us
I20260709 12:11:45.332150 17136 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.333052 17140 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:45.333588 17140 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:45.333878 17175 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.333735 17213 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:45.334443 17175 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:45.334059 17062 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.334661 17140 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.335274 17090 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:45.335799 17090 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:45.335444 17175 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.336202 17140 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.336898 17175 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.336784 17062 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.336710 17090 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.338801 17090 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.339285 16372 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.339828 16372 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.344048 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.345079 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:45.348511 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 110081us
I20260709 12:11:45.310050 17144 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.352558 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.354619 11947 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:45.319715 17125 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.355108 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.360255 11944 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.356631 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.355178 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.357772 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.358536 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.358160 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.357508 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.369823 12013 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.371351 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.372537 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.372977 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.373211 11943 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:45.351002 17110 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.348287 17119 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.368398 17145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.015s	sys 0.000s
I20260709 12:11:45.386394 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.387028 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:45.388249 11871 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:45.353068 17163 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:45.390136 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.355069 17213 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.394114 11871 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:45.394152 11944 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:45.394526 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.398500 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:45.362797 17192 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.390286 17145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.015s	sys 0.000s
I20260709 12:11:45.409137 12022 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.401245 12016 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:45.402127 11873 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.402681 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.414155 12018 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:45.415180 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.415995 11939 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.404768 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.409754 11869 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:45.415344 16372 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.420219 11944 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:45.397567 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:45.394058 17119 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.396194 17213 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.423053 11871 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:45.395005 17163 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.435314 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.441493 17163 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.446131 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.446357 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:45.363145 17146 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.449259 11942 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:45.449656 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.452244 17119 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.452867 17119 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.445256 17159 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 12:11:45.455786 17207 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:11:45.458340 17208 log.cc:927] Time spent T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:45.462147 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.464291 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.464665 11939 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:45.465322 11948 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:45.439177 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115622us
I20260709 12:11:45.373699 17125 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.453230 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.389882 17110 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.424124 17145 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.472633 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:45.472868 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:45.477789 12016 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.447569 17213 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:45.478888 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92589.6us
I20260709 12:11:45.482800 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.472267 16372 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.419987 17192 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.490298 17133 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.492444 17174 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.493080 17174 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.494040 11865 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:45.494529 17180 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.495611 17110 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.488935 17168 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.492365 17192 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.503702 17142 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:45.504256 17142 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:45.505661 17217 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.513329 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.513903 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.514523 11945 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:45.477176 16228 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.521673 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.522950 12603 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:45.523126 12611 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:45.523492 12603 pending_rounds.cc:85] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 11
I20260709 12:11:45.523931 12603 pending_rounds.cc:107] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:45.524359 12603 raft_consensus.cc:2889] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.525125 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:45.521955 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49439.3us
I20260709 12:11:45.525885 11939 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:45.525283 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:45.528163 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45477.2us
I20260709 12:11:45.529633 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.531225 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:45.532382 11948 raft_consensus.cc:1275] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:45.534214 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.534969 12605 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:45.535964 17179 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:45.543938 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.544098 11837 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:45.493455 17174 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.440726 17190 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.549118 17218 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:45.550733 17218 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:45.551339 17218 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.522806 16228 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.556218 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:45.557494 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.543200 17110 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.566061 17159 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:45.480760 17145 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.575625 16487 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.576314 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:45.505345 17142 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.555923 17197 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.580826 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.560246 16228 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.560467 17196 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.562602 16372 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.596328 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.572836 17156 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:45.598583 16487 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.649276 17141 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.599706 17120 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.600112 17156 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:45.659749 17125 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.595548 17196 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.556262 17133 consensus_queue.cc:1048] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:45.582868 17192 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.568118 17219 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:45.727903 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 131672us
I20260709 12:11:45.757043 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.600206 17169 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:45.731635 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:45.733134 12018 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.591926 17197 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.753298 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 185910us
I20260709 12:11:45.763059 16487 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:45.763731 17120 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.763836 17169 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:45.764596 17165 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.764809 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.768096 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.769112 17220 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.221s
I20260709 12:11:45.772341 17213 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:45.772970 17173 consensus_meta.cc:287] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.011s
I20260709 12:11:45.737197 17144 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.773918 17146 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.764626 17156 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.776600 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 2131) took 1496 ms. Trace:
W20260709 12:11:45.777096 17138 consensus_meta.cc:287] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.003s
I20260709 12:11:45.829588 17173 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.830410 17138 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.832245 17173 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.832732 17138 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.834281 17144 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.777448 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.836052 11947 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:45.837905 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.822294 12020 rpcz_store.cc:276] 0709 12:11:44.279842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.303136 (+ 23294us) service_pool.cc:224] Handling call
0709 12:11:45.776334 (+1473198us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400028354. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:45.776499 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839012736}
W20260709 12:11:45.840912 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.780108 16915 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.845297 16915 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.847522 16915 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.847395 17218 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.780788 16969 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:45.782145 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 329843us
I20260709 12:11:45.855849 11947 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:11:45.858400 11946 raft_consensus.cc:2368] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:45.807667 11948 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
W20260709 12:11:45.812839 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.752625 17167 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.868435 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.870877 11944 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:45.814306 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 49601.8us
I20260709 12:11:45.857878 16969 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.812422 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.740463 17189 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.754705 17196 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.757097 17142 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.813721 17169 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:45.814932 17193 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 12:11:45.850852 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.852509 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.789691 16228 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.798869 17197 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.784660 17174 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.865432 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:45.911082 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45747.9us
I20260709 12:11:45.817893 16372 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:45.874060 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.814831 16487 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.916831 16487 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:45.917222 16487 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.874935 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62626.7us
I20260709 12:11:45.918547 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.755563 17091 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.773301 17163 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.892716 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.929457 12610 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.900560 11945 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
W20260709 12:11:45.901903 17175 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.007s
W20260709 12:11:45.866757 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45622.7us
I20260709 12:11:45.909894 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.932135 12022 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.915329 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.920957 16228 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.914902 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.933506 12020 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.925803 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:45.937072 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:45.902014 17135 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.939543 11943 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:45.902388 17153 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.933115 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.926355 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:45.937779 12019 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.922060 16366 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.943056 11939 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:11:45.943851 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.932617 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:45.945034 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.938161 11946 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 10: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:45.941007 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:45.946211 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 72241.9us
I20260709 12:11:45.946992 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:45.948537 11941 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:45.945142 17153 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.949862 17153 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.950747 17090 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:45.911499 17193 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:45.948101 17135 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:45.957145 16366 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:45.921881 17215 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.929311 17138 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:45.958500 12603 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:45.959575 12013 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:45.931339 17209 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:45.953267 17193 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:45.947582 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:45.970654 16969 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.939824 17173 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.975139 12020 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:45.986308 17173 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.982045 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:45.986614 17229 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:45.986840 17173 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.921209 17226 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:11:45.998931 17091 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:45.999332 17233 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.999778 17233 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.000200 17233 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:46.007189 17188 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.006s
I20260709 12:11:46.007747 17188 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:46.010596 17230 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:46.012261 17213 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.013316 17145 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.015115 17174 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.016860 17163 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.975508 17149 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.019583 17149 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.019954 17149 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.022008 16915 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.022580 16915 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.022967 16915 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.025506 17153 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.025846 17215 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.028019 17153 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.029870 17138 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.030866 17138 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.038152 17226 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.038932 17226 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:45.976269 16487 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:46.012471 17225 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:45.945588 17167 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.977278 16366 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.029351 17156 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:46.053001 17189 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:45.984005 17192 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.055958 17167 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:46.057021 17167 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.059813 17218 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:46.061158 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:46.064961 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.045253 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:46.077870 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:45.999898 17091 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:46.085182 16487 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.085624 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:46.040122 17226 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:46.094301 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 160002us
I20260709 12:11:45.984251 12019 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:46.091333 12022 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:46.091643 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.097208 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:46.097880 11941 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.098308 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:46.099356 12013 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.098521 11986 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.099489 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.098276 12019 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.088608 17192 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:46.109436 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 124287us
I20260709 12:11:46.100993 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.112747 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.114737 16487 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.115106 16487 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:46.115595 16487 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.115007 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:46.107524 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:46.117942 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:46.113243 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.122977 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.123524 11943 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.124409 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:46.124948 12608 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:46.121701 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:46.129621 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.122097 11941 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:46.132380 12013 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:46.134420 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:46.138525 17205 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.139346 17205 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:46.140360 17205 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.144179 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:46.144981 11946 raft_consensus.cc:606] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:46.145448 11946 raft_consensus.cc:614] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.111490 17153 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:46.170574 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 213765us
I20260709 12:11:46.172199 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:46.173147 11946 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:46.173249 12019 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:46.174424 12013 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:46.145483 17189 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.151288 17145 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.122630 16969 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.133713 17187 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.119215 17218 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.158522 17233 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.162295 17215 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.164650 11943 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:46.169883 17188 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:46.112783 17120 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.149839 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.175793 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:46.179873 12610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:46.193063 12610 raft_consensus.cc:606] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:46.193447 12610 raft_consensus.cc:614] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.142436 17179 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:46.186609 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 57116.7us
I20260709 12:11:46.186848 11940 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:46.142282 17141 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:11:46.194657 16228 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.219537 16228 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.220464 16228 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.220788 17197 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.223028 17141 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.223428 17141 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:46.224310 17141 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.225931 17173 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.171761 17226 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.197364 17196 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.232707 17196 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.181448 17153 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:46.237679 17153 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.197408 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:46.198738 17192 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.199333 17215 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.244247 17215 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.244719 17215 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.199347 16969 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.199440 17234 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:46.245364 16969 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.201295 17233 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.200153 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:46.194314 17120 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.201722 17179 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.208959 17193 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:46.249102 17193 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.215283 17219 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.249486 17193 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:46.249886 17219 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.212368 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:11:46.216765 17217 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.710s	user 0.004s	sys 0.010s
I20260709 12:11:46.250916 11940 raft_consensus.cc:606] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:46.251274 17217 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:46.218369 17110 consensus_meta.cc:287] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.001s
I20260709 12:11:46.252164 17110 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.218854 17135 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.184208 17189 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:46.195272 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45526.5us
I20260709 12:11:46.253894 17189 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.236199 12603 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
W20260709 12:11:46.244782 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.257928 17110 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.258490 17110 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:46.198760 16487 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.260380 16487 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.248574 17120 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.261986 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:46.263005 11940 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:46.248616 17179 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.260793 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:46.262075 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.264645 11943 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.265888 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:46.266649 12019 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:46.247728 16969 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:46.256664 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59351.9us
I20260709 12:11:46.279567 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:46.284252 12610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:46.294005 17217 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.295200 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:46.229863 17141 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.294474 17217 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:46.299255 16487 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.303916 16487 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:11:46.270756 17236 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:46.302152 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:46.292645 11943 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:46.316593 12013 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:11:46.318002 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:46.285666 17180 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.311699 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:46.259449 17110 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.330989 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:46.343909 12016 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.331494 12022 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:46.326748 11837 leader_election.cc:400] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:46.309916 17217 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.347433 11866 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.348095 11865 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.349859 11869 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:46.323463 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:46.350283 11869 pending_rounds.cc:85] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 7
I20260709 12:11:46.342789 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:46.346246 11837 leader_election.cc:403] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.350584 11869 pending_rounds.cc:107] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:46.350805 12014 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.350914 11869 raft_consensus.cc:2889] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:46.352770 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.353133 11942 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:11:46.353850 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:46.234807 17169 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.361116 12021 raft_consensus.cc:2368] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:46.356788 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:46.355773 16487 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:46.377689 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.373998 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.435043 11867 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.380376 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.436084 11864 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:46.420293 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.250450 17193 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.381420 11870 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.374881 11866 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:11:46.427954 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:46.325755 17218 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.390089 12015 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:46.378229 11871 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.351382 17120 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.450160 12016 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
W20260709 12:11:46.448843 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 76210.7us
I20260709 12:11:46.452343 12610 raft_consensus.cc:606] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:46.384075 17165 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.363478 17167 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.367882 17173 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.356485 17180 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.456060 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:46.368716 17169 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.466243 16372 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:46.467756 17120 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:46.468837 17174 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.468292 17180 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:46.479983 17242 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:11:46.488186 17193 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.370133 16915 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.460284 17188 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:46.489662 17142 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.510757 16372 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.511294 16372 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:46.462733 17165 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:46.460090 17234 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:46.518078 17120 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.522197 17197 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.525727 17188 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:46.527308 17188 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.535816 17187 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.536044 16915 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.500675 17174 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.537175 17174 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.540853 11941 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:46.541677 17165 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:46.543192 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.554352 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.466456 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:46.379300 17215 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.493528 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.557740 11942 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.369832 17149 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.564714 16372 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.555222 11941 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:46.566623 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 100299us
W20260709 12:11:46.490485 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62634us
I20260709 12:11:46.571120 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.571548 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.572633 11871 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:46.569715 11867 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:46.584949 17215 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:46.587604 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.588883 16372 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.599547 12014 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:46.606920 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:46.613309 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.607705 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.627074 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.581224 11864 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:46.631879 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.518151 17219 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.635880 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.640057 11867 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.645457 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.646143 11864 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.602334 17091 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.646570 11869 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:46.651099 11869 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.652483 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.653455 11871 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
W20260709 12:11:46.654217 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.654383 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 363563us
I20260709 12:11:46.655709 11871 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:46.659437 11871 pending_rounds.cc:85] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:46.659833 11871 pending_rounds.cc:107] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:46.660192 11871 raft_consensus.cc:2889] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.668131 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.670791 11940 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.680202 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:46.681041 11946 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.679327 16915 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.688030 16915 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.690891 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.692564 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.691665 11870 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
W20260709 12:11:46.693773 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.694542 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.695433 11870 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:46.695925 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.696125 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.696309 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.697075 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.697619 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.698335 11870 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:46.699200 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.693817 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.700060 11870 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:46.700628 11869 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.702704 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.701390 11867 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:46.703387 11870 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.670473 17219 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.704586 11867 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:11:46.648357 17217 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.665642 17205 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.724766 11942 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:46.681425 17091 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:46.710448 17219 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:46.715807 17215 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:46.776063 16366 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.697175 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.736111 17205 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.879738 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.764746 17215 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.850790 17226 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:46.841012 11941 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
W20260709 12:11:46.877179 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 242486us
I20260709 12:11:46.884845 16372 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.855104 17149 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.882339 11864 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:46.781919 16366 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.885299 16372 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:46.889618 16372 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.890622 16372 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.896546 11869 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
W20260709 12:11:46.885521 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 281950us
I20260709 12:11:46.854327 17217 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:46.897970 11864 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:46.853308 11870 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
W20260709 12:11:46.900450 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.908394 17205 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:46.909297 17248 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:46.915622 11946 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:46.922495 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.923048 17219 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:46.923774 11873 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:46.925089 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:46.926030 12605 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:46.926896 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.927709 11873 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.930058 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.930946 11870 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
W20260709 12:11:46.931949 17246 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 12:11:46.932662 11864 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.936002 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:46.937261 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.938254 11866 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:11:46.939119 17215 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:46.943939 17254 log.cc:927] Time spent T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:46.945318 17149 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.903375 16969 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:46.945974 17149 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.948237 17149 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:46.948768 17149 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:46.950857 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.952704 11946 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.884174 17226 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:46.957140 16795 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.959419 16795 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.959738 17226 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.961015 17226 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.962776 11946 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:46.953836 11940 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:46.978062 11914 leader_election.cc:400] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:46.979146 11914 leader_election.cc:403] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.977681 11873 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:46.950166 17167 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:46.981840 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.949251 17149 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:46.983410 12019 raft_consensus.cc:2410] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:46.984179 11869 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:46.983193 16366 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:46.986460 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 259124us
I20260709 12:11:46.992236 12013 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:46.988363 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:46.992364 12014 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:46.993927 16372 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.994581 16372 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:46.995306 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:46.995916 12014 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:46.996043 11873 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:46.998626 16372 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.001991 16795 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.001628 17156 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:46.983728 17090 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:47.012923 16915 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.014803 17174 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:47.016894 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.977440 17233 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:47.019102 17233 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:47.019559 17233 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:47.020604 17233 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.022760 11940 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:11:46.993837 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:47.027633 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.982270 17219 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.034507 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.034873 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:47.035130 12014 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.035602 11869 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
W20260709 12:11:47.040617 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.037107 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:47.055877 12014 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:46.990912 17235 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13.
I20260709 12:11:47.074095 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.062747 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.064723 12605 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:47.068040 16228 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:47.077883 16228 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:47.060390 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 316777us
I20260709 12:11:47.080663 11872 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:47.084347 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.086081 12019 raft_consensus.cc:2410] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:47.086560 11942 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:47.088208 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.031391 17234 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.094877 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.089349 11946 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:47.095582 12019 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:47.087378 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:47.089093 11873 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:11:47.091439 11943 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:47.052435 17179 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.092033 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:47.097297 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:47.036753 17135 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:47.098368 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:47.057684 17196 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:47.100911 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.102387 11940 raft_consensus.cc:606] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:47.103188 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.108271 11869 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:47.110250 17196 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:47.111088 17256 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.111357 17196 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.111809 17256 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.113330 17135 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.114053 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.114603 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.114802 11868 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.115206 11872 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.115597 17135 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.116875 11943 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:47.118911 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.119586 11866 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:47.119824 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.120374 11873 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:47.120904 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.122478 11871 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.125995 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.126830 11867 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.120518 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.121486 11870 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.138553 11871 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:47.049739 17219 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.146727 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.148485 11873 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:11:47.152555 11864 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:11:47.144991 11867 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:47.149199 11870 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:47.151533 11872 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:47.106606 17193 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.126282 17215 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:47.087916 16915 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:47.160305 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.160987 11943 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.135943 17174 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.134891 17234 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:47.138844 17179 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:47.141727 17226 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:47.178893 17179 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.180271 17256 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:47.190256 17260 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:47.165807 17193 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:47.195336 11839 connection.cc:256] RPC call timeout handler was delayed by -1.6958638349999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 12:11:47.198665 17165 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.006s
I20260709 12:11:47.199999 17165 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.195437 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:47.201750 11839 connection.cc:256] RPC call timeout handler was delayed by -1.6763788429998385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 12:11:47.201876 11940 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:11:47.202122 11839 connection.cc:256] RPC call timeout handler was delayed by -1.5787156300000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:11:47.202430 11839 connection.cc:256] RPC call timeout handler was delayed by -1.5672221839997746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:11:47.202728 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1916258369997195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:11:47.203020 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0750854849998177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 12:11:47.172403 17215 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:47.203311 11839 connection.cc:256] RPC call timeout handler was delayed by -1.0348729279999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2691s for a response
I20260709 12:11:47.255008 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.231204 11868 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:11:47.263484 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.266892 11939 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:47.258368 11943 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:47.270733 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.277036 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.280133 17217 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.280332 17219 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.281143 17193 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.285993 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:47.286851 17167 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.287633 17167 raft_consensus.cc:2764] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:47.289153 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.289994 17219 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.291613 17234 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.292479 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.293305 17219 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.295707 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.277746 17188 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:47.297793 17219 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.297648 17215 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.299705 11839 leader_election.cc:400] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:47.300014 11839 leader_election.cc:403] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.276412 17266 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.303310 17266 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.304572 17188 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
W20260709 12:11:47.304950 17261 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:47.306937 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:47.308223 17233 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.310781 17188 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.311276 17188 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.295557 17149 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.311699 17188 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.313764 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.314520 11864 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.318326 11868 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:47.318534 17266 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.318971 11872 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.319331 11872 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:47.320227 11872 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.321358 11872 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.326248 11869 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:47.333129 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.334065 11870 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:47.335331 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.335561 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.336009 11942 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:47.336349 11873 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:47.336947 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.337393 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.337599 11867 raft_consensus.cc:2376] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15. Re-sending same reply.
I20260709 12:11:47.338791 11865 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:47.351617 11864 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:47.360625 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.361682 11942 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:47.362632 17219 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.363217 17219 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.365394 17219 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.367748 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.368827 11868 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:47.368984 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.371263 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.375550 11872 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:47.375994 11872 pending_rounds.cc:85] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 8
I20260709 12:11:47.376238 11872 pending_rounds.cc:107] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:47.376765 11872 raft_consensus.cc:2889] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.382395 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.385788 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.386904 11866 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:47.388027 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.389042 11868 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:47.394022 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.395118 11869 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:47.400344 11945 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:47.403143 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.403738 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.404089 11947 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
W20260709 12:11:47.435470 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.436674 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.437711 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 370143us
W20260709 12:11:47.492802 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 83078.2us
W20260709 12:11:47.493625 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.494096 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:47.492065 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 409570us
I20260709 12:11:47.499115 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.504092 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.390410 17266 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.509721 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.492028 17149 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:47.522061 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.501013 17153 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:47.523321 17274 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:11:47.562299 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:47.514385 17193 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.498231 17263 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:47.500694 16915 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:47.571741 16372 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.498533 17120 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:47.516563 17264 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:47.580145 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65664us
I20260709 12:11:47.505992 17174 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:47.581637 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.533468 17153 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.517060 17266 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:47.589306 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 80909.2us
I20260709 12:11:47.591796 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.595278 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.587095 17263 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.534289 17215 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:47.598757 17263 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:47.599823 17215 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.600062 17266 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.599654 17263 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.614447 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.588557 17153 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.618559 12013 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:47.532312 17149 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.631019 17149 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.632356 17280 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:47.638056 17247 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.790s	user 0.002s	sys 0.008s
I20260709 12:11:47.616096 17180 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:11:47.608385 17197 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:11:47.642856 17234 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.643596 17234 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.644536 17197 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:47.646530 17255 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:47.647380 17255 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.649817 17156 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.650592 17156 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:47.653806 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.654625 17263 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.617122 16795 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:47.612461 17215 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.659548 17215 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:47.659752 16795 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:47.660352 16795 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:47.593406 17193 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:47.592083 17205 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.653443 17156 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:47.674538 17275 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:47.660949 17215 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.641324 17091 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.595906 17264 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:11:47.606743 17271 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:11:47.661474 16795 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:47.709018 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 113844us
I20260709 12:11:47.713251 17279 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.713397 17193 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.713969 17279 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.715986 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.716207 17279 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.716876 17279 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.717609 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.720516 17233 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.720979 17233 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:47.721834 17205 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.721935 17233 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.723492 17233 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:47.725499 17267 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.546s	user 0.000s	sys 0.002s
I20260709 12:11:47.727696 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:47.728672 17263 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.729880 17263 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:47.731022 17263 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.728744 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:47.735064 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.704090 17255 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.738476 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:47.742766 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.742908 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.743520 11940 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:47.744479 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.744899 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.745512 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.746292 12015 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:47.746698 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.747171 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.747427 11947 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:47.747658 12014 raft_consensus.cc:2376] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16. Re-sending same reply.
I20260709 12:11:47.746322 17215 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.749701 11947 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 15. Ops: []
I20260709 12:11:47.700170 17091 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:47.750448 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 132902us
I20260709 12:11:47.734058 17279 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.751928 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.759701 11947 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:47.751722 16795 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.771032 17091 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.772881 17217 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.773980 17153 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.776238 17153 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:47.758129 17234 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.777107 17234 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.736840 17193 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:47.779069 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.779350 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.779858 11942 raft_consensus.cc:2368] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:47.780997 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.781621 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.782481 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.784337 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.784927 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.784273 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.785653 12019 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:47.785619 12013 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.751638 17215 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.794282 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.794807 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.791250 12015 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.791448 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.792052 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.796445 12020 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.777654 17234 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.793555 12017 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:47.794894 11948 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:47.806970 12017 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:11:47.807253 17268 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.629s	user 0.003s	sys 0.001s
I20260709 12:11:47.808285 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.798456 12022 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:47.756548 17279 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.757426 17205 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.809551 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.790241 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.799256 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:47.795993 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.800161 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.799475 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.806910 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:47.813409 11948 raft_consensus.cc:2410] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:11:47.813731 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.814483 11864 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:47.817050 11873 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:47.817253 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.819074 12019 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:47.819962 11942 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 10: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:47.821645 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:47.805305 17234 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.823977 11945 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:47.825599 11942 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:47.826166 11866 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:47.829793 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.830397 17282 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:47.823340 17217 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.834389 17217 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.837711 17219 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.838740 17219 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.841022 17219 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.848971 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:47.850654 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.762845 17196 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:11:47.855093 12020 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:47.856055 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.856844 12013 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:47.856815 11867 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:47.857992 11870 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:47.818733 17279 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.859905 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.860775 11865 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:47.862318 11871 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.851075 17219 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.866773 16487 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.814054 17215 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.824715 17153 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.852289 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.844125 17149 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.793234 16915 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:47.873291 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.867329 16487 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:47.866158 17188 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
I20260709 12:11:47.876741 11866 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.872608 17234 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.883589 17234 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.884081 17234 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.884359 17217 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.888415 16487 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.872725 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:47.877821 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:47.893126 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.895076 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:47.895838 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:47.897706 17173 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.898298 17173 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:47.899087 17277 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 12:11:47.900945 17091 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:47.903786 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.904893 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:47.905735 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.866724 17167 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.906399 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.911469 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.912039 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:47.906428 12013 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:47.852789 17233 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:47.895263 17256 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.930135 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:47.908187 11872 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.905984 11839 leader_election.cc:400] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:47.910526 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:47.910975 12017 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.935408 11839 leader_election.cc:400] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:11:47.873216 17273 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.874033 17205 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.874032 17149 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.907289 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.945585 11871 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:11:47.917083 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.907791 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:47.923787 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:47.947547 11867 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
W20260709 12:11:47.925402 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 47339.1us
I20260709 12:11:47.907094 16487 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.949425 16487 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.949858 16487 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.950134 17293 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.936372 16366 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:47.959230 16487 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.937458 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:47.938347 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:47.902855 17193 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.962638 17193 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.963192 17193 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.962675 16487 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.964721 16487 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.968150 17173 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.965199 16487 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.971797 16487 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:47.972497 16487 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:47.972947 16487 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.973242 17193 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:47.977641 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:47.982167 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:47.983126 16487 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.991067 16487 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.982824 11865 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:47.983222 17193 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.013273 17193 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.014058 17193 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:47.918303 11870 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:48.001165 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:47.987982 17165 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:47.950930 17293 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.041132 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.017318 17193 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.044956 17293 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.047489 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.048372 11939 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:48.049878 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.059034 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.061726 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:48.067090 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 159358us
I20260709 12:11:47.913070 17235 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.871889 17219 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.088378 12016 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:48.080158 17292 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:11:48.062155 17149 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.090663 17292 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:48.090878 11866 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:48.091075 17292 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:48.092005 17292 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.093053 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:48.062407 17273 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.093780 12606 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:48.095675 11770 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.915480 17135 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.163s
I20260709 12:11:47.889282 17188 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.100575 17188 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.077935 17189 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.101378 11868 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:48.104044 17219 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.111059 11912 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:48.113349 16795 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.113865 16795 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.114267 16795 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.081215 17235 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.117713 17235 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.118846 11947 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.905715 17264 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 12:11:47.929733 17256 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:48.126479 17256 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.127640 17256 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.921043 17167 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:48.141819 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 212377us
I20260709 12:11:48.143429 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.093325 17292 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:48.178108 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 96830.2us
I20260709 12:11:48.180318 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.202594 17125 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.203218 17125 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:48.203611 17125 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.095731 17273 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.155179 17189 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:48.177968 17282 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:48.166683 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.214536 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 277106us
I20260709 12:11:48.167637 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:48.211022 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.225863 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:48.227164 17291 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:48.227834 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:48.231241 17291 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:48.233485 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.239647 17291 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.243913 17167 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.195209 17135 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
W20260709 12:11:48.266685 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 99131.1us
I20260709 12:11:48.267648 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.268093 17282 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.268501 17282 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.268834 17282 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.270912 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.271864 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.272459 11948 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.278780 11940 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:48.282085 16366 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:48.282670 16366 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.284824 16366 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.286507 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.288244 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.290088 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.290863 12015 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:48.291311 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:48.291432 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.291600 16366 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.292194 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.293567 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:48.293707 16366 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:48.295008 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.292202 12020 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:48.295784 11947 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:11:48.296918 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:48.297027 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.298053 12013 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:48.298075 16366 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.299599 16366 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:48.163398 11944 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:48.305922 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.306879 11866 raft_consensus.cc:2376] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14. Re-sending same reply.
I20260709 12:11:48.311654 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.312944 11865 raft_consensus.cc:2410] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:48.315248 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.294375 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:48.322079 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.325395 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:48.326529 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.327450 11873 raft_consensus.cc:2376] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18. Re-sending same reply.
I20260709 12:11:48.327502 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:48.290690 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.330358 11770 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.241400 17215 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.333812 11865 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:48.334147 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:48.334611 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:48.336023 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.277767 16915 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.336901 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.339151 11866 raft_consensus.cc:2376] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10. Re-sending same reply.
I20260709 12:11:48.339785 11940 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:48.342832 16372 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:48.321686 17289 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:48.339964 16366 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.347538 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:48.348824 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.352573 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:48.321738 17167 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:48.358415 17174 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.358908 17174 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:48.359303 17174 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.364039 11873 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.368454 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.333323 17293 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.371553 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.372490 11865 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:48.369292 11866 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:48.337584 17226 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.344385 17270 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:48.382763 17167 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.383205 11770 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:11:48.394579 11771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 175) took 12716 ms (client timeout 15000 ms). Trace:
I20260709 12:11:48.399993 11770 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:48.406689 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 72183.8us
I20260709 12:11:48.407918 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.337172 17090 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:48.344570 17273 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:48.378404 17233 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:48.419081 11770 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.379652 17293 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:48.342417 17125 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.430092 17293 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.434513 12013 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:48.439674 17125 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.435477 11770 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:48.395345 11771 rpcz_store.cc:269] 0709 12:11:35.677694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.692819 (+ 15125us) service_pool.cc:224] Handling call
0709 12:11:48.394484 (+12701665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:43.701710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:43.702733 (+  1023us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:43.702807 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:11:43.702839 (+    32us) tablet.cc:662] Decoding operations
0709 12:11:43.821319 (+118480us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:43.821453 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:43.821487 (+    34us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:11:43.824630 (+  3143us) tablet.cc:701] Row locks acquired
0709 12:11:43.824690 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:11:43.824897 (+   207us) write_op.cc:270] Start()
0709 12:11:43.825155 (+   258us) write_op.cc:276] Timestamp: P: 1783599103824814 usec, L: 0
0709 12:11:43.825193 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:11:43.970395 (+145202us) log.cc:844] Serialized 10237 byte log entry
0709 12:11:45.141852 (+1171457us) op_driver.cc:464] REPLICATION: finished
0709 12:11:45.353454 (+211602us) write_op.cc:301] APPLY: starting
0709 12:11:45.360713 (+  7259us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:46.210993 (+850280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:46.211126 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:46.544831 (+333705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:46.545208 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 12:11:46.599139 (+ 53931us) write_op.cc:312] APPLY: finished
0709 12:11:46.718598 (+119459us) log.cc:844] Serialized 228 byte log entry
0709 12:11:46.890379 (+171781us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:46.891214 (+   835us) write_op.cc:454] Released schema lock
0709 12:11:46.891330 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:46.916480 (+ 25150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:46.916516 (+    36us) write_op.cc:454] Released schema lock
0709 12:11:47.304326 (+387810us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
Metrics: {"mutex_wait_us":64758,"reported_tablets":51,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":185002,"apply.run_cpu_time_us":61889,"apply.run_wall_time_us":1570964,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":42578,"prepare.run_cpu_time_us":29178,"prepare.run_wall_time_us":750050,"raft.queue_time_us":151733,"raft.run_cpu_time_us":26869,"raft.run_wall_time_us":91574,"replication_time_us":1316488,"spinlock_wait_cycles":46597376,"thread_start_us":595158,"threads_started":5,"wal-append.queue_time_us":908417,"wal-append.run_cpu_time_us":46636,"wal-append.run_wall_time_us":2571585}]]}
I20260709 12:11:48.425450 17297 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.442796 17297 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.445194 17297 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:48.445680 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.446712 11770 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.451097 17156 raft_consensus.cc:993] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:48.452440 12610 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:48.331278 17189 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.459417 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:48.467188 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.448918 11770 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.350942 16969 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 12:11:48.485275 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77448.5us
I20260709 12:11:48.487347 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:48.488116 11945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.023s
W20260709 12:11:48.489549 11945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.008s	sys 0.024s
I20260709 12:11:48.421672 17299 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:48.486979 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 15, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.501961 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.506227 17263 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.507171 17263 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.507486 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.491498 17125 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:48.414363 17174 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.421355 17135 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:48.537216 11770 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 11 to 12, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.418540 16795 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.544085 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:48.491242 17291 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:48.491869 17298 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:48.572999 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85701us
I20260709 12:11:48.574748 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.546445 17273 raft_consensus.cc:1081] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:48.559592 16969 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.584088 11946 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:48.576476 17299 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.617254 11939 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:48.618875 11939 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:48.577123 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.579313 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.619298 11770 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 9 to 12, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:48.623768 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.630461 12013 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:48.631709 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54758us
I20260709 12:11:48.632872 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.633682 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:48.596596 17233 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:48.646760 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.620666 11939 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.581796 17300 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.579313 17197 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:48.663429 11948 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
W20260709 12:11:48.667116 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 172470us
I20260709 12:11:48.668390 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.665150 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.670112 11948 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.576057 17298 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.643684 17263 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.641902 17291 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:48.588769 16969 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.666724 17299 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.700803 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:48.678994 16915 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:48.674839 17215 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:48.712764 17305 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:48.715394 17174 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.692307 17296 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:48.725515 17279 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.004s
I20260709 12:11:48.726102 17279 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.706841 17196 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:48.728340 17279 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.728502 17196 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.730150 11770 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.731300 16969 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:48.731945 16915 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:48.732292 11770 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.732944 16915 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:48.729357 17256 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.004s
W20260709 12:11:48.740836 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 108064us
I20260709 12:11:48.743408 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.742889 11770 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.731635 17196 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.749078 17291 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 12:11:48.758601 17312 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:11:48.761134 17318 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:11:48.761968 17291 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:48.762499 17308 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:11:48.763741 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.764828 17291 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:48.765462 17291 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:48.774726 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.782418 11770 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.796885 16372 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.797993 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:11:48.764818 17313 log.cc:927] Time spent T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:48.797792 16372 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.745428 17286 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:48.808669 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:48.754114 16969 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:48.795405 11948 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:48.827263 16372 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:48.827055 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 158747us
I20260709 12:11:48.832671 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.832937 16372 raft_consensus.cc:2764] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:11:48.828056 17234 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.008s
I20260709 12:11:48.834105 17234 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.836678 17234 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.837301 17334 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.838281 17334 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.838843 17334 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.839668 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.840559 11941 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:48.841282 17334 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:48.841794 16795 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.849670 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.852496 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.750718 17299 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:11:48.830113 17273 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.767943 17300 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:11:48.856185 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.869201 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:48.855899 17292 consensus_meta.cc:287] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.679s	user 0.014s	sys 0.000s
I20260709 12:11:48.874922 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.880039 11866 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:48.880267 11948 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.878031 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.883210 11864 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:48.860687 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.886329 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:48.887131 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 112550us
I20260709 12:11:48.883504 12017 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:48.889505 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.890336 12017 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:48.862087 17273 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:48.892831 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:48.830401 17233 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.908885 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.915261 11873 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:48.914774 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:48.882766 17327 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:48.921655 17292 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.922997 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.923934 11941 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:48.925037 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:48.890774 11866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecd86af74b304d58a84939321319d52b"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:11:48.925866 17298 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.910071 17256 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:48.927016 17256 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:48.913456 17153 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.042s	user 0.013s	sys 0.003s
I20260709 12:11:48.928092 17153 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.910718 17226 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.930335 17226 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:48.931372 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1055) took 1041 ms. Trace:
I20260709 12:11:48.933638 17234 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:48.887606 16969 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:48.925993 11866 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:48.927435 17149 consensus_meta.cc:287] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.003s
I20260709 12:11:48.931845 11945 rpcz_store.cc:276] 0709 12:11:47.890219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.892492 (+  2273us) service_pool.cc:224] Handling call
0709 12:11:47.892796 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.910595 (+ 17799us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:11:47.980916 (+ 70321us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b1800394f00. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf 00007f1f1ba4d038
0709 12:11:48.495440 (+514524us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.735561 (+240121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.736252 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.736428 (+   176us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:11:48.736474 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.736576 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.931003 (+194427us) raft_consensus.cc:1685] finished
0709 12:11:48.931123 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.931296 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119849,"prepare.queue_time_us":525547,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":21997,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":24494,"spinlock_wait_cycles":2863872,"thread_start_us":692248,"threads_started":2,"wal-append.queue_time_us":352618}
I20260709 12:11:48.909809 17273 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.933301 17226 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.956024 11839 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:48.958184 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:48.859795 17291 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:48.964107 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:48.986692 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:48.965770 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.987725 11864 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:48.987717 11941 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:48.987103 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:48.995990 17226 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:48.996739 17226 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:48.999302 17282 consensus_meta.cc:287] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.730s	user 0.014s	sys 0.000s
I20260709 12:11:48.975231 11866 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.977254 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:49.008836 11945 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:48.980523 17324 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:11:48.985021 11839 leader_election.cc:403] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.985237 11870 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.962266 17256 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:48.976295 17234 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.013862 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:49.011454 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94042.4us
I20260709 12:11:49.012362 16969 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.018865 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.025231 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.014647 17299 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.014065 17234 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.004405 17269 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.947914 11948 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:49.036624 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:48.984627 17149 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.038740 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.039752 11864 raft_consensus.cc:2368] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14.
I20260709 12:11:49.040060 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.041383 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.042508 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.043503 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.010006 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:49.064671 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.069993 11864 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:49.078712 11945 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:49.080734 11872 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:49.008035 17282 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.102038 11870 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:49.116048 11870 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:49.128512 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:49.131011 11941 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:49.082741 11945 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:49.067521 17340 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.082666 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.106884 11866 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:49.147989 11944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 2063) took 1367 ms (client timeout 1664 ms). Trace:
W20260709 12:11:49.148512 11944 rpcz_store.cc:269] 0709 12:11:47.780922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.781061 (+   139us) service_pool.cc:224] Handling call
0709 12:11:49.147772 (+1366711us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400426b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:49.147891 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691592064}
I20260709 12:11:49.149855 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:49.151525 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:49.154894 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.155530 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:49.155663 11865 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:49.156554 17149 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:49.156883 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:49.157246 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.158123 11865 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:49.158905 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.159699 11865 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.155081 17282 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:49.161101 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:49.173317 12014 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:49.176342 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:49.181634 12019 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:49.163841 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51102.3us
I20260709 12:11:49.162871 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:49.185992 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:49.139964 17293 consensus_meta.cc:287] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.688s	user 0.015s	sys 0.000s
I20260709 12:11:49.186025 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:49.144646 17339 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:11:49.199875 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:49.191469 11866 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:49.195431 16372 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:49.196691 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:49.213768 16372 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.214257 16372 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:49.220341 11865 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:49.221776 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:49.222043 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.222743 11865 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.223466 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:49.227375 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:49.215920 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:49.187728 17235 raft_consensus.cc:2764] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:11:49.232173 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46226.8us
I20260709 12:11:49.235188 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:11:49.236801 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48187us
I20260709 12:11:49.242772 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:49.243199 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:49.233983 11865 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:49.244447 12605 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:49.235226 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:49.212321 17174 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.246878 16372 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:49.258714 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:49.260104 11865 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:49.236972 17090 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.226743 17323 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.235639 17279 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.264936 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:49.280050 16372 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.283939 11866 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.280443 11865 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:49.287402 11865 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:49.289068 11865 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:49.238659 17153 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.231346 17344 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.199803 17293 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.306170 11944 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:49.309360 11942 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:49.303406 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 2168) took 1012 ms. Trace:
I20260709 12:11:49.300130 17340 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:49.300840 17311 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.621s	user 0.000s	sys 0.005s
I20260709 12:11:49.323503 12019 rpcz_store.cc:276] 0709 12:11:48.290618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.291036 (+   418us) service_pool.cc:224] Handling call
0709 12:11:49.303181 (+1012145us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400178c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:49.303339 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995664640}
I20260709 12:11:49.326512 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1059) took 1108 ms. Trace:
I20260709 12:11:49.327937 11942 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:49.326951 11943 rpcz_store.cc:276] 0709 12:11:48.217969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.218770 (+   801us) service_pool.cc:224] Handling call
0709 12:11:48.220674 (+  1904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.225350 (+  4676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.225391 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.226013 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.550029 (+324016us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:48.550071 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.550187 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.300084 (+749897us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:49.326141 (+ 26057us) raft_consensus.cc:1685] finished
0709 12:11:49.326169 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.326435 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4218,"raft.queue_time_us":5586,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":9412992,"thread_start_us":323577,"threads_started":1,"wal-append.queue_time_us":368219}
I20260709 12:11:49.240612 17255 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:11:49.331923 17234 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.266260 17256 raft_consensus.cc:2764] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:11:49.305101 17348 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 12:11:49.304255 17353 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:49.282784 17090 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:49.353241 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 110547us
I20260709 12:11:49.283025 17323 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:49.352133 11866 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:49.319972 17279 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.368615 17090 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.368881 17323 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:49.403892 17358 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:49.394763 17270 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:49.407975 17270 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:49.408069 17293 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.399353 17273 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:49.411345 17269 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.412171 17297 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.412528 17273 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:49.412561 17297 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:49.414319 17327 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.414721 17327 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:49.415110 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:49.415414 17279 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:49.415621 17327 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.416958 17327 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.417163 17297 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.419381 17323 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.420039 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 2994) took 1044 ms. Trace:
I20260709 12:11:49.420491 12020 rpcz_store.cc:276] 0709 12:11:48.375588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.375824 (+   236us) service_pool.cc:224] Handling call
0709 12:11:48.376215 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.395554 (+ 19339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.395602 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:48.395654 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:48.395710 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.419779 (+1024069us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54000b5754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:49.419830 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.419973 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43822336}
W20260709 12:11:49.430505 17321 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.594s	user 0.003s	sys 0.000s
I20260709 12:11:49.434870 17323 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.445887 17167 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:49.419180 17297 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.450459 17286 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:49.451265 17286 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:49.456089 17090 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.457759 17323 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:49.458573 17323 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:49.477624 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 261760us
W20260709 12:11:49.466089 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 222964us
I20260709 12:11:49.468957 17340 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:49.505755 17179 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:49.506407 17340 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:49.509009 17340 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.510669 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:49.517936 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.461486 17323 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:49.534847 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2255) took 1214 ms. Trace:
I20260709 12:11:49.522058 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:49.536136 11946 rpcz_store.cc:276] 0709 12:11:48.320171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.027465 (+707294us) service_pool.cc:224] Handling call
0709 12:11:49.027869 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:49.031384 (+  3515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.031418 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:49.049174 (+ 17756us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.237564 (+188390us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.237611 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.474242 (+236631us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5400241154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:49.474324 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.474405 (+    81us) raft_consensus.cc:1685] finished
0709 12:11:49.474425 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.534735 (+ 60310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7053,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":36229,"spinlock_wait_cycles":7094144,"thread_start_us":153841,"threads_started":1,"wal-append.queue_time_us":135488}
I20260709 12:11:49.543118 16228 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:49.463279 17090 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.544646 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:49.545222 17340 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:49.520083 17327 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.558508 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.560091 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.553280 17323 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.558627 17256 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:49.583209 17299 consensus_meta.cc:287] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.000s
W20260709 12:11:49.657721 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 71341.3us
W20260709 12:11:49.657881 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94817.7us
I20260709 12:11:49.623504 17323 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.564566 17327 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.690447 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:49.663853 17256 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:49.711620 17256 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:49.712396 17374 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:11:49.693856 17323 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.726806 11942 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:49.727421 17331 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.868s	user 0.003s	sys 0.000s
I20260709 12:11:49.728012 17270 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.663272 17299 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:49.721166 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2935) took 1353 ms. Trace:
W20260709 12:11:49.729463 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 486766us
I20260709 12:11:49.732309 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2252) took 1458 ms. Trace:
I20260709 12:11:49.737318 11988 leader_election.cc:400] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14.
I20260709 12:11:49.736318 11940 rpcz_store.cc:276] 0709 12:11:48.274111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.379782 (+105671us) service_pool.cc:224] Handling call
0709 12:11:48.385323 (+  5541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.481411 (+ 96088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.481467 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.494999 (+ 13532us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.658770 (+163771us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:48.658817 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.658900 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.726507 (+1067607us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:49.731849 (+  5342us) raft_consensus.cc:1685] finished
0709 12:11:49.731883 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.732218 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88920,"raft.queue_time_us":145536,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":23074,"spinlock_wait_cycles":13691264,"thread_start_us":77518,"threads_started":1,"wal-append.queue_time_us":281628}
I20260709 12:11:49.737838 11988 leader_election.cc:403] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.734488 11869 rpcz_store.cc:276] 0709 12:11:48.368116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.368459 (+   343us) service_pool.cc:224] Handling call
0709 12:11:48.368746 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.368954 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:48.885301 (+516347us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.046534 (+161233us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.440143 (+393609us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b180036c6a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:49.720200 (+280057us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b180036c6a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:49.720497 (+   297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.720593 (+    96us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.720682 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.720807 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.721042 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17570,"prepare.queue_time_us":565665,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":108,"raft.queue_time_us":699434,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":100588928,"thread_start_us":638767,"threads_started":2,"wal-append.queue_time_us":197955}
I20260709 12:11:49.674645 17135 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:49.752466 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:49.759069 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84359.1us
I20260709 12:11:49.759954 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:49.779081 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2256) took 1435 ms. Trace:
I20260709 12:11:49.801024 16372 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.791546 11941 rpcz_store.cc:276] 0709 12:11:48.343576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.243867 (+900291us) service_pool.cc:224] Handling call
0709 12:11:49.262560 (+ 18693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.262869 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:49.575042 (+312173us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.778564 (+203522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.778634 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.778705 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.778800 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.778996 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22805,"prepare.queue_time_us":359274,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2180,"thread_start_us":425647,"threads_started":2}
I20260709 12:11:49.747767 17149 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.751332 17334 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.750986 17298 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.808215 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:11:49.766469 17300 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.807809 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:49.829180 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92039.8us
I20260709 12:11:49.792972 17263 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.806141 17264 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.800287 17299 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.781791 17135 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:49.883167 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:49.855252 17282 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14.
W20260709 12:11:49.935287 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52270.7us
I20260709 12:11:49.871876 17149 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.816488 17334 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:49.815963 17298 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:49.966908 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 91886us
I20260709 12:11:49.904115 17296 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:49.975337 17296 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:49.981072 17296 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:49.933841 17270 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.952330 17279 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:49.909405 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 149527us
I20260709 12:11:50.002863 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:50.003883 12018 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:49.903970 17263 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.010000 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bace639158f425898b2859f751fc2cd"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:11:50.010706 12016 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:50.011369 16372 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.011946 16372 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.012857 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:50.013461 12603 raft_consensus.cc:606] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:49.972610 17292 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.014019 12603 raft_consensus.cc:614] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:49.969774 17282 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.015508 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:50.019767 11940 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:49.984232 17367 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:49.998346 17291 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.940806 17299 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:50.003403 17310 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:11:50.014635 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:49.956950 17205 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:49.985594 17167 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:49.923795 17264 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.021955 16372 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.016263 12611 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:50.026067 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:50.024435 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 216742us
I20260709 12:11:50.036052 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.028631 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:50.036996 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:49.968242 17149 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.030580 11941 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:50.038484 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:50.036917 11940 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:50.017954 17279 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.003422 17234 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:50.019044 17327 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:49.856026 17300 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:50.087175 17381 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:11:50.133337 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:50.090415 11939 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:50.087949 17376 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:11:50.133649 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2189) took 1116 ms. Trace:
I20260709 12:11:50.022356 17292 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.028872 17282 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.148674 17149 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:50.149704 17135 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:50.032955 17388 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:50.150624 11898 heartbeater.cc:646] Failed to heartbeat to 127.10.114.126:46571 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.10.114.126:46571 timed out after 15.000s (SENT)
I20260709 12:11:50.033201 17291 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:50.151131 17399 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.151710 17399 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.152009 17291 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.150312 17282 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.153861 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2199) took 1111 ms. Trace:
I20260709 12:11:50.151149 17388 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.154336 11872 rpcz_store.cc:276] 0709 12:11:49.042098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.134564 (+ 92466us) service_pool.cc:224] Handling call
0709 12:11:49.135040 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.730315 (+595275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.730358 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.739793 (+  9435us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.998140 (+258347us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.998210 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.998337 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.153615 (+155278us) raft_consensus.cc:1685] finished
0709 12:11:50.153634 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.153792 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":615267,"raft.queue_time_us":608800,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11082,"thread_start_us":187613,"threads_started":1,"wal-append.queue_time_us":296768}
I20260709 12:11:50.141222 17234 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.158941 17270 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.163830 17383 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:11:50.031433 17367 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.165633 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2198) took 1123 ms. Trace:
I20260709 12:11:50.047804 16372 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.158857 17388 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.163074 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:50.169312 11946 raft_consensus.cc:606] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:50.169730 11946 raft_consensus.cc:614] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:50.015585 17389 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:50.045599 17295 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:50.132143 17379 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 12:11:50.147185 17384 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:11:50.162624 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:50.158529 17320 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.319s	user 0.009s	sys 0.022s
W20260709 12:11:50.142961 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 96757.5us
I20260709 12:11:50.025347 17296 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:50.166038 11871 rpcz_store.cc:276] 0709 12:11:49.041864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.051079 (+  9215us) service_pool.cc:224] Handling call
0709 12:11:49.067837 (+ 16758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.721848 (+654011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.721889 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.722475 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.763868 (+ 41393us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:49.764206 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.800398 (+ 36192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.800497 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.165382 (+364885us) raft_consensus.cc:1685] finished
0709 12:11:50.165402 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.165569 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":737695,"prepare.queue_time_us":546,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":852668,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":7310,"thread_start_us":41042,"threads_started":1,"wal-append.queue_time_us":171679}
I20260709 12:11:50.017205 17347 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:50.174608 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:50.189739 12603 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:50.167212 17367 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.035835 17167 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.144313 11873 rpcz_store.cc:276] 0709 12:11:49.017279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.017451 (+   172us) service_pool.cc:224] Handling call
0709 12:11:49.028739 (+ 11288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:49.029263 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.029305 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:49.030090 (+   785us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.222043 (+191953us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:49.226158 (+  4115us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.109384 (+883226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.109503 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.133281 (+ 23778us) raft_consensus.cc:1685] finished
0709 12:11:50.133300 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.133465 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1190954,"prepare.queue_time_us":4103,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":8450,"raft.queue_time_us":688012,"raft.run_cpu_time_us":908,"raft.run_wall_time_us":50151,"thread_start_us":537981,"threads_started":3,"wal-append.queue_time_us":352967}
W20260709 12:11:50.192917 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 152944us
W20260709 12:11:50.233774 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49118.8us
I20260709 12:11:50.175128 17234 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.141098 17266 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:50.135634 17279 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.166126 17270 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.243798 11939 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:50.228147 17347 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.260883 17299 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.261525 17392 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:50.262230 17234 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.262185 17392 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.262985 17234 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:50.263701 17378 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.376s	user 0.007s	sys 0.007s
I20260709 12:11:50.266460 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4755afb6a253477badd7f673bff77faa"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:50.267263 11946 raft_consensus.cc:606] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:50.267681 11946 raft_consensus.cc:614] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:50.271306 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:50.272009 11946 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:50.272403 11946 raft_consensus.cc:614] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:50.276444 17234 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.279255 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:50.282083 17401 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:50.282848 17287 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.283412 17287 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.257682 11939 pending_rounds.cc:85] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 7
I20260709 12:11:50.286067 11939 pending_rounds.cc:107] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:50.233253 17295 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:50.232265 17296 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:50.295622 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 162375us
I20260709 12:11:50.297377 11939 raft_consensus.cc:2889] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:50.253720 17379 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:50.303682 12603 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.306981 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:50.286852 11946 raft_consensus.cc:606] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:50.310166 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2253) took 2029 ms. Trace:
I20260709 12:11:50.294385 17298 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.312367 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:50.186201 17389 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:50.310959 17271 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:11:50.321681 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:50.322510 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:50.314216 11939 rpcz_store.cc:276] 0709 12:11:48.280334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.444463 (+164129us) service_pool.cc:224] Handling call
0709 12:11:48.444814 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.603301 (+158487us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b5400229aa0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b9aadc0 00007f1f1ba351c0 00007f1f1ba36231 00007f1f1ba32d8f 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c
0709 12:11:50.089932 (+1486631us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b580031bed0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b98f0aa 00007f1f1ba11447 00007f1f1ba29fe7 00007f1f1ba2b7de 00007f1f1ba35b49 00007f1f1ba36416 00007f1f1ba32d8f 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4
0709 12:11:50.308803 (+218871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.309744 (+   941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948182144}
I20260709 12:11:50.319427 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:50.308462 17376 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:50.331162 16228 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.334311 16228 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:50.332111 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.334867 16228 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.291182 17300 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.343616 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:50.344547 11839 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:50.345466 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:50.346791 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:50.298857 17334 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.353461 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2191) took 1318 ms. Trace:
I20260709 12:11:50.310285 17287 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.353911 11868 rpcz_store.cc:276] 0709 12:11:49.035342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.035499 (+   157us) service_pool.cc:224] Handling call
0709 12:11:49.082151 (+ 46652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.723919 (+641768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.723976 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.724663 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.764509 (+ 39846us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.805340 (+ 40831us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.809278 (+  3938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.809370 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.353215 (+543845us) raft_consensus.cc:1685] finished
0709 12:11:50.353239 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.353384 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":644920,"prepare.queue_time_us":41651,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":599,"raft.queue_time_us":804539,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":194,"thread_start_us":39383,"threads_started":1,"wal-append.queue_time_us":130494}
I20260709 12:11:50.365360 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:50.369168 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:50.371407 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:50.371773 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:50.381626 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:50.320221 17286 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.868s	user 0.018s	sys 0.001s
I20260709 12:11:50.383030 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1091) took 2096 ms. Trace:
I20260709 12:11:50.387266 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:50.388320 11873 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:50.326699 17299 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.326598 17298 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.391090 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:50.386188 12021 rpcz_store.cc:276] 0709 12:11:48.286542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.286740 (+   198us) service_pool.cc:224] Handling call
0709 12:11:48.336417 (+ 49677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.336763 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.336792 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.345897 (+  9105us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.599119 (+253222us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:48.599171 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.599251 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.087042 (+1487791us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:50.382733 (+295691us) raft_consensus.cc:1685] finished
0709 12:11:50.382756 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.382969 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":526,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":15255,"spinlock_wait_cycles":11798400,"thread_start_us":206830,"threads_started":1,"wal-append.queue_time_us":465761}
I20260709 12:11:50.396507 11947 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:50.399313 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 2081) took 1647 ms. Trace:
I20260709 12:11:50.401636 17406 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.402350 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2259) took 1709 ms. Trace:
I20260709 12:11:50.417052 11944 rpcz_store.cc:276] 0709 12:11:48.692839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.321142 (+628303us) service_pool.cc:224] Handling call
0709 12:11:49.321611 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.322081 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:49.482025 (+159944us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.740021 (+257996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.740663 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.740839 (+   176us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.740889 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.740995 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.260089 (+519094us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b1800085ba0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:50.390503 (+130414us) raft_consensus.cc:1685] finished
0709 12:11:50.402119 (+ 11616us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.402278 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170171,"prepare.queue_time_us":344116,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":116237,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":44666,"spinlock_wait_cycles":5021952,"thread_start_us":330043,"threads_started":2,"wal-append.queue_time_us":308974}
I20260709 12:11:50.419091 17343 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.419924 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.419984 17387 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 12:11:50.402400 16795 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.421343 17343 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:50.421746 17407 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.422247 17167 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.422251 17343 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.423110 17400 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.337101 17174 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:11:50.429675 17397 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:50.430253 17395 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:11:50.431218 17295 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.433938 16795 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.436681 16795 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.430315 17397 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.438244 17397 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:50.438953 17385 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.425s	user 0.003s	sys 0.000s
W20260709 12:11:50.440907 17297 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.993s	user 0.014s	sys 0.000s
I20260709 12:11:50.443792 17292 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.445161 17282 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.445688 17282 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.449525 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2202) took 1406 ms. Trace:
I20260709 12:11:50.450065 11870 rpcz_store.cc:276] 0709 12:11:49.042857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.143956 (+101099us) service_pool.cc:224] Handling call
0709 12:11:49.145502 (+  1546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.942957 (+797455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.942998 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.956995 (+ 13997us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.175217 (+218222us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:50.175275 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.175371 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.268198 (+ 92827us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4800080058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:11:50.449203 (+181005us) raft_consensus.cc:1685] finished
0709 12:11:50.449225 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.449443 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664920,"raft.queue_time_us":805853,"raft.run_cpu_time_us":3404,"raft.run_wall_time_us":311020,"spinlock_wait_cycles":7851392,"thread_start_us":350567,"threads_started":2,"wal-append.queue_time_us":432826}
I20260709 12:11:50.452786 17298 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.412946 11939 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:50.404939 11943 rpcz_store.cc:276] 0709 12:11:48.752367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.328756 (+576389us) service_pool.cc:224] Handling call
0709 12:11:49.329220 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:49.342550 (+ 13330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.342582 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:49.343370 (+   788us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.565934 (+222564us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.747311 (+181377us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.902610 (+155299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.902759 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.399020 (+496261us) raft_consensus.cc:1685] finished
0709 12:11:50.399051 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.399242 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66157,"prepare.queue_time_us":157486,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":68671,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"spinlock_wait_cycles":38528,"thread_start_us":402632,"threads_started":3,"wal-append.queue_time_us":386432}
I20260709 12:11:50.398015 16228 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.366636 17263 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:50.506350 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 267940us
I20260709 12:11:50.532207 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:50.386489 17399 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.400830 17300 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.502326 11869 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:50.505118 17389 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.403335 17334 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.571713 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.455873 17298 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.552726 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.595314 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.564863 16228 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.578912 11946 raft_consensus.cc:2410] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:11:50.550643 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.664s (SENT) [suppressed 20 similar messages]
I20260709 12:11:50.558818 17400 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:50.415915 17299 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.616228 17400 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.570689 17153 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.568753 17334 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.619091 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.395732 17286 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.569279 17215 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:11:50.583062 17394 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.568841 17263 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:50.641268 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.608505 17300 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.630143 17156 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.540879 17296 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.621199 17153 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.634220 17141 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.634606 17334 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.649236 11948 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:50.629402 17299 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.649737 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:50.658082 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 323231us
I20260709 12:11:50.667168 11944 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:50.669684 16228 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:50.660321 17153 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.662271 17400 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.643311 17394 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.695132 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.667644 17270 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:50.696254 11944 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:50.651424 17156 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.701851 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:50.704999 11944 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:50.650225 17300 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.712634 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:50.700709 17279 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.668603 17141 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.704577 17263 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:50.740396 12022 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
W20260709 12:11:50.720268 17323 consensus_meta.cc:287] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.006s	user 0.013s	sys 0.010s
I20260709 12:11:50.742805 11944 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:50.800832 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 250181us
I20260709 12:11:50.803262 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:50.742479 17409 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:50.733058 17279 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:50.732928 17263 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:50.821646 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:50.775007 17215 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.836575 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:50.855089 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:50.855968 11869 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:50.773162 17266 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:50.822722 17297 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:50.852589 17215 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:50.839697 17399 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.840687 17299 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.839600 17419 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:50.852658 17411 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:50.844209 17389 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.945052 17286 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:50.829308 17279 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.801646 17323 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:50.896938 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.195132 11869 raft_consensus.cc:2410] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:50.948652 17293 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:51.016566 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.019275 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:50.845124 17091 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:50.846239 17415 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:51.145013 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:50.862994 17408 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.155s
I20260709 12:11:51.174328 16228 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:51.174134 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 426697us
I20260709 12:11:50.991667 17226 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.018088 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:51.225131 16228 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.225885 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.196503 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:50.985778 17263 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:51.188844 17416 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.489s	user 0.000s	sys 0.007s
I20260709 12:11:51.183212 12021 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:51.226768 11869 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:51.279141 16228 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:51.279228 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.214258 17299 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.175529 17297 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.302196 16228 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.294675 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:51.182080 17399 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.231377 11945 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:51.326464 12021 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.327337 16228 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:51.328817 17424 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:11:51.330317 16228 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:51.330636 17423 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:51.290445 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.332832 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.333043 17141 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.333310 11942 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:51.333451 11870 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:51.333839 17442 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.334553 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.334463 17442 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:51.335098 17386 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.327s	user 0.007s	sys 0.005s
I20260709 12:11:51.338474 17235 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.341436 17421 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.375s	user 0.000s	sys 0.000s
I20260709 12:11:51.341876 17270 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.342778 17446 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:51.380568 17446 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:51.381413 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.383281 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:51.387115 17215 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:51.387933 17402 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:51.388525 17402 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:51.390259 17442 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.393998 17399 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.188374 17419 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.228089 17394 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.213992 17286 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.395454 17286 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.396533 17419 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.396615 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1072) took 2258 ms. Trace:
I20260709 12:11:51.230715 17415 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.198609 17411 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.371647 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.399106 17415 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.399302 17286 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.399216 17282 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:51.399734 17235 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.397280 11948 rpcz_store.cc:276] 0709 12:11:49.138063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.547755 (+409692us) service_pool.cc:224] Handling call
0709 12:11:49.548181 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.665023 (+1116842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.396277 (+731254us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002b3754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.396528 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531708288}
I20260709 12:11:51.274581 17226 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:51.374511 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:51.375190 17420 log.cc:927] Time spent T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:51.375305 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.376106 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.416950 12610 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:51.377451 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.377779 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.378705 17297 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.379498 17270 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.394265 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.351760 16228 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.419864 16228 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.227669 17091 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.439800 17279 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.440115 17091 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.421487 17263 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:51.443141 17347 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.445482 17156 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.445999 16969 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:51.446419 16969 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:51.447490 16969 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.449227 16969 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.570490 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:51.572925 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 680) took 1204 ms. Trace:
I20260709 12:11:51.597796 11868 rpcz_store.cc:276] 0709 12:11:50.368370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.368503 (+   133us) service_pool.cc:224] Handling call
0709 12:11:50.368821 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.650744 (+281923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.650774 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.652494 (+  1720us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.942937 (+290443us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:11:50.942980 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.943054 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.572079 (+629025us) raft_consensus.cc:1685] finished
0709 12:11:51.572163 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.572629 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51417,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":567886,"threads_started":2,"wal-append.queue_time_us":795139}
I20260709 12:11:51.313107 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.601399 12018 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:51.602232 12018 pending_rounds.cc:85] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:51.602468 11869 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.347648 11870 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:51.576525 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2204) took 2472 ms. Trace:
I20260709 12:11:51.605113 11867 rpcz_store.cc:276] 0709 12:11:49.104262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.133676 (+ 29414us) service_pool.cc:224] Handling call
0709 12:11:49.134118 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.729695 (+595577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.729732 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.739779 (+ 10047us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.815998 (+ 76219us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.816063 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.816177 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.334774 (+1518597us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b2400116ca8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f187cc9c4 00007f1f187caacb 00007f1f18985dc9 00007f1f18985a55 00007f1f1898509d 00007f1f1b5b710e 00007f1f1b5ce88c 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221
0709 12:11:51.575688 (+240914us) raft_consensus.cc:1685] finished
0709 12:11:51.575739 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.576267 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609580,"raft.queue_time_us":596783,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11757,"spinlock_wait_cycles":10224512,"thread_start_us":75820,"threads_started":1,"wal-append.queue_time_us":217306}
I20260709 12:11:51.607038 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.608173 11870 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:51.608222 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.608345 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2266) took 1596 ms. Trace:
W20260709 12:11:51.575394 11988 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.011s	sys 0.058s
I20260709 12:11:51.575446 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 690) took 1196 ms. Trace:
W20260709 12:11:51.610034 11988 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.012s	sys 0.059s
W20260709 12:11:51.610801 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 958569us
I20260709 12:11:51.610071 11866 rpcz_store.cc:276] 0709 12:11:50.378557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.378729 (+   172us) service_pool.cc:224] Handling call
0709 12:11:50.379100 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.379421 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:50.379459 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.380040 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.676413 (+296373us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.676456 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.677731 (+  1275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.574685 (+896954us) raft_consensus.cc:1685] finished
0709 12:11:51.574745 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.575181 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":296030,"threads_started":1,"wal-append.queue_time_us":451359}
I20260709 12:11:51.611718 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.612562 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.573977 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 688) took 1199 ms. Trace:
I20260709 12:11:51.582442 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:51.582633 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1076) took 1278 ms. Trace:
I20260709 12:11:51.578117 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 691) took 1199 ms. Trace:
I20260709 12:11:51.589184 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.590396 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.615057 17135 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:51.613771 11864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 2203) took 2553 ms (client timeout 2149 ms). Trace:
I20260709 12:11:51.615722 12019 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:51.599381 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:51.616104 11864 rpcz_store.cc:269] 0709 12:11:49.059662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.070711 (+ 11049us) service_pool.cc:224] Handling call
0709 12:11:51.613056 (+2542345us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400400954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:51.613276 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419273088}
I20260709 12:11:51.614279 11873 rpcz_store.cc:276] 0709 12:11:50.378963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.399745 (+ 20782us) service_pool.cc:224] Handling call
0709 12:11:50.400087 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.418106 (+ 18019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.418149 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.491324 (+ 73175us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.772987 (+281663us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:50.773052 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.773150 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.577275 (+804125us) raft_consensus.cc:1685] finished
0709 12:11:51.577340 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.577845 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20707,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":197982,"threads_started":1,"wal-append.queue_time_us":890769}
I20260709 12:11:51.613710 11865 rpcz_store.cc:276] 0709 12:11:50.374098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.374489 (+   391us) service_pool.cc:224] Handling call
0709 12:11:50.374848 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.645383 (+270535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.645414 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.648515 (+  3101us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.820867 (+172352us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.820899 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.820962 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.573310 (+752348us) raft_consensus.cc:1685] finished
0709 12:11:51.573364 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.573726 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45597,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"thread_start_us":438408,"threads_started":2,"wal-append.queue_time_us":843775}
I20260709 12:11:51.618757 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.587913 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:51.619887 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.614091 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.623600 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:51.626469 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:51.632690 11943 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:51.605104 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.635074 12013 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:51.325358 17299 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.429364 17226 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.710851 11865 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:51.711715 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2270) took 1650 ms. Trace:
I20260709 12:11:51.712644 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.399121 17411 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:51.402715 17235 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.641667 17264 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:51.221257 17293 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.718643 17293 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.642370 17389 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.720180 17389 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.643185 17300 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.664383 17347 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:51.517751 17392 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:51.409725 17397 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.971s	user 0.014s	sys 0.000s
I20260709 12:11:51.724864 11864 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:51.725174 17397 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.726368 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.726958 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 682) took 1357 ms. Trace:
I20260709 12:11:51.728402 17397 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.727546 11872 rpcz_store.cc:276] 0709 12:11:50.368949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.369361 (+   412us) service_pool.cc:224] Handling call
0709 12:11:50.369716 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.454743 (+ 85027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.454790 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.455549 (+   759us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.746519 (+290970us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:50.746579 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.726043 (+979464us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54000942d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.726131 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.726229 (+    98us) raft_consensus.cc:1685] finished
0709 12:11:51.726254 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.726706 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27701,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":25775,"spinlock_wait_cycles":194123392,"thread_start_us":290469,"threads_started":1,"wal-append.queue_time_us":418076}
I20260709 12:11:51.431078 17402 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.712378 11942 rpcz_store.cc:276] 0709 12:11:50.012961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.138545 (+125584us) service_pool.cc:224] Handling call
0709 12:11:50.175411 (+ 36866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.333727 (+1158316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.625136 (+291409us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002e5ed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.663074 (+ 37938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662094080}
I20260709 12:11:51.724472 17347 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.730770 17402 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.731815 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1081) took 1035 ms. Trace:
I20260709 12:11:51.732229 11948 rpcz_store.cc:276] 0709 12:11:50.696095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.583785 (+887690us) service_pool.cc:224] Handling call
0709 12:11:51.584819 (+  1034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.727573 (+142754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.727615 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.727720 (+   105us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.727768 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.731294 (+  3526us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003d5754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.731354 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.731547 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327258880}
I20260709 12:11:51.734571 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1103) took 1757 ms. Trace:
I20260709 12:11:51.734949 12020 rpcz_store.cc:276] 0709 12:11:49.977830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.981733 (+  3903us) service_pool.cc:224] Handling call
0709 12:11:49.982109 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.024691 (+ 42582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.024726 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.025236 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.184810 (+159574us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.184850 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.733816 (+1548966us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400268ed4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.733900 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.733982 (+    82us) raft_consensus.cc:1685] finished
0709 12:11:51.733995 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.734355 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90864,"raft.queue_time_us":1054,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6884,"spinlock_wait_cycles":96917376,"thread_start_us":159272,"threads_started":1,"wal-append.queue_time_us":393547,"wal-append.run_cpu_time_us":1460,"wal-append.run_wall_time_us":1006274}
I20260709 12:11:51.455179 17446 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.737427 17406 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.646883 17323 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:51.650337 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.592608 16228 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.614004 11940 rpcz_store.cc:276] 0709 12:11:50.303697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.303993 (+   296us) service_pool.cc:224] Handling call
0709 12:11:50.307307 (+  3314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:50.316797 (+  9490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.316838 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:50.328726 (+ 11888us) log.cc:844] Serialized 52 byte log entry
0709 12:11:50.715087 (+386361us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.717092 (+  2005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.717154 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.581811 (+864657us) raft_consensus.cc:1685] finished
0709 12:11:51.581871 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.582354 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3660,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5750,"thread_start_us":314368,"threads_started":1,"wal-append.queue_time_us":820953}
I20260709 12:11:51.602555 12018 pending_rounds.cc:107] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:51.609442 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.695322 11866 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:51.685323 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103485us
I20260709 12:11:51.609031 11947 rpcz_store.cc:276] 0709 12:11:50.011697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.011894 (+   197us) service_pool.cc:224] Handling call
0709 12:11:50.015217 (+  3323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.404785 (+389568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.607578 (+1202793us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54003d4854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.608111 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876430080}
I20260709 12:11:51.703510 11943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 2086) took 1298 ms. Trace:
I20260709 12:11:51.723062 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.723950 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.729666 17408 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:51.648502 17334 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.973s	user 0.014s	sys 0.001s
I20260709 12:11:51.753696 17334 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:51.756222 17153 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.061s	user 0.016s	sys 0.012s
I20260709 12:11:51.756445 12610 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.756731 11871 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:51.746565 12018 raft_consensus.cc:2889] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.749931 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.758267 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.758870 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.759145 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.759718 12018 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:51.760149 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:51.760761 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.749922 17446 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.750510 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.761873 11868 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:51.763006 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.764079 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1074) took 2101 ms. Trace:
I20260709 12:11:51.764282 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.764492 11945 rpcz_store.cc:276] 0709 12:11:49.662468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.725367 (+ 62899us) service_pool.cc:224] Handling call
0709 12:11:49.725707 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.326487 (+1600780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.763584 (+437097us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001c1954. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:51.763864 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3461960448}
I20260709 12:11:51.765079 11868 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:51.751286 12019 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.748128 11943 rpcz_store.cc:276] 0709 12:11:50.396808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.631121 (+1234313us) service_pool.cc:224] Handling call
0709 12:11:51.631839 (+   718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.677764 (+ 45925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.695057 (+ 17293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:51.769853 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.771646 17270 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.774295 17291 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.774271 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.776882 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.752655 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:51.773502 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 150096us
I20260709 12:11:51.739676 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.748739 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:51.760550 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.782380 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 2088) took 1247 ms. Trace:
I20260709 12:11:51.784302 11939 rpcz_store.cc:276] 0709 12:11:50.500321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.604367 (+1104046us) service_pool.cc:224] Handling call
0709 12:11:51.747843 (+143476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:51.788410 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.789633 11865 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:51.790906 11868 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.791594 11865 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:51.756863 17153 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:51.795053 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:51.745785 17389 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:51.823164 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:51.826203 11867 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:51.828043 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.836159 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.836654 12017 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:51.839048 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.856383 12019 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:51.859090 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.817821 17270 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:51.895932 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2226) took 1013 ms. Trace:
I20260709 12:11:51.903694 11865 rpcz_store.cc:276] 0709 12:11:50.848289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.792576 (+944287us) service_pool.cc:224] Handling call
0709 12:11:51.806422 (+ 13846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.855707 (+ 49285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.855757 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.861322 (+  5565us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:51.861366 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.861433 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.861598 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2850,"raft.queue_time_us":18514}
I20260709 12:11:51.906517 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:51.901054 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:51.923418 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:51.931481 11914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.013s	sys 0.021s
W20260709 12:11:51.931953 11914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.013s	sys 0.021s
I20260709 12:11:51.902630 17226 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:51.902812 17418 consensus_queue.cc:1175] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 9 last_received_current_leader { term: 15 index: 10 } }
I20260709 12:11:51.914335 17298 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.932237 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:51.948485 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 93707.5us
I20260709 12:11:51.949373 12018 raft_consensus.cc:2410] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:51.954542 12013 raft_consensus.cc:2410] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:51.959705 17153 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:51.960812 11872 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:51.961622 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.961690 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.962716 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.962924 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.964567 17286 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:51.964731 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.965394 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:51.957011 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:51.969681 11941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.018s
W20260709 12:11:51.970222 17296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.012s
W20260709 12:11:51.995780 17344 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.046s
W20260709 12:11:51.996106 17296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.012s
I20260709 12:11:51.972301 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2957) took 1104 ms. Trace:
W20260709 12:11:51.995857 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 74609us
I20260709 12:11:51.981105 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1111) took 1274 ms. Trace:
I20260709 12:11:51.969797 17427 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:51.970641 17329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.049s	sys 0.027s
W20260709 12:11:51.995838 11941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.018s
I20260709 12:11:52.005277 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2953) took 1162 ms. Trace:
I20260709 12:11:52.000924 11871 rpcz_store.cc:276] 0709 12:11:50.867767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.941592 (+1073825us) service_pool.cc:224] Handling call
0709 12:11:51.971449 (+ 29857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.971840 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.971878 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.971952 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.971991 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.972062 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.972195 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:52.008098 11873 rpcz_store.cc:276] 0709 12:11:50.835864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.804497 (+968633us) service_pool.cc:224] Handling call
0709 12:11:51.912782 (+108285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.985043 (+ 72261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.985102 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.997892 (+ 12790us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.997963 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.998069 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.998268 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492,"raft.queue_time_us":15406,"raft.run_wall_time_us":21973}
I20260709 12:11:51.943657 16969 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.013976 11869 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
W20260709 12:11:51.996404 17344 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.016s	sys 0.046s
I20260709 12:11:51.929524 17270 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:51.992511 17334 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.005056 17427 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.031021 11943 raft_consensus.cc:2410] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:52.032445 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 296127us
I20260709 12:11:52.033947 11837 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:52.036577 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2956) took 1175 ms. Trace:
I20260709 12:11:52.037578 17408 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:52.041623 11944 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.028s
W20260709 12:11:52.042153 11944 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.001s	sys 0.029s
I20260709 12:11:52.043927 17298 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.001362 12016 rpcz_store.cc:276] 0709 12:11:50.706218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.706328 (+   110us) service_pool.cc:224] Handling call
0709 12:11:50.706727 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.990547 (+283820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.990575 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.042155 (+ 51580us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.575838 (+533683us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.575981 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.576195 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.980616 (+404421us) raft_consensus.cc:1685] finished
0709 12:11:51.980639 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.980877 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5139,"raft.queue_time_us":96632,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4634,"thread_start_us":640214,"threads_started":2,"wal-append.queue_time_us":796178}
I20260709 12:11:52.037158 11865 rpcz_store.cc:276] 0709 12:11:50.861096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.912516 (+1051420us) service_pool.cc:224] Handling call
0709 12:11:51.985941 (+ 73425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.036028 (+ 50087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.036072 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.036149 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:52.036203 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.036297 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.036466 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:52.047937 11947 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:52.051558 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.026355 17329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.050s	sys 0.027s
I20260709 12:11:52.070927 17323 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:52.098846 17323 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.109385 17347 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.109797 16372 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.049808 17427 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:52.074023 11913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.010s	sys 0.019s
I20260709 12:11:52.110769 16372 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.067999 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2954) took 1200 ms. Trace:
W20260709 12:11:52.131678 11913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.011s	sys 0.020s
W20260709 12:11:52.133440 17393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.038s
I20260709 12:11:52.129958 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.131923 11869 rpcz_store.cc:276] 0709 12:11:50.858005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.312678 (+454673us) service_pool.cc:224] Handling call
0709 12:11:52.028691 (+716013us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:52.135869 17393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.012s	sys 0.038s
W20260709 12:11:52.135934 11838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.009s	sys 0.013s
W20260709 12:11:52.136438 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.009s	sys 0.013s
I20260709 12:11:52.136322 17323 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.072232 17226 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.136945 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103520us
W20260709 12:11:52.139173 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.094955 17299 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.149789 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.074198 17343 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.146355 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2276) took 1524 ms. Trace:
I20260709 12:11:52.137660 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:52.135306 17120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.059s	sys 0.041s
W20260709 12:11:52.169253 17120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.061s	sys 0.041s
I20260709 12:11:52.157508 11944 rpcz_store.cc:276] 0709 12:11:50.621605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.751828 (+130223us) service_pool.cc:224] Handling call
0709 12:11:50.809768 (+ 57940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.810186 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:50.844177 (+ 33991us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.042601 (+1198424us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.056943 (+ 14342us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.116551 (+ 59608us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.116619 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.130492 (+ 13873us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.138284 (+  7792us) raft_consensus.cc:1685] finished
0709 12:11:52.138302 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.146268 (+  7966us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33830,"prepare.run_cpu_time_us":9981,"prepare.run_wall_time_us":210678,"raft.queue_time_us":47961,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":11194,"thread_start_us":1069970,"threads_started":2,"wal-append.queue_time_us":601572}
I20260709 12:11:52.137643 17226 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.177863 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.130259 16969 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.179625 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2960) took 1310 ms. Trace:
I20260709 12:11:52.184229 11872 rpcz_store.cc:276] 0709 12:11:50.869106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.002494 (+1133388us) service_pool.cc:224] Handling call
0709 12:11:52.112552 (+110058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.174473 (+ 61921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.174518 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.179276 (+  4758us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:52.179332 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.179404 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.179553 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:52.085780 17286 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.198263 17179 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.163808 17347 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.202291 11869 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:52.203625 17445 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:11:52.198546 12576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.007s	sys 0.016s
I20260709 12:11:52.216648 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2963) took 1134 ms. Trace:
I20260709 12:11:52.220041 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.198508 17270 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.221263 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.221688 17444 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.222185 11870 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:52.222462 12020 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:52.223682 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68597.2us
I20260709 12:11:52.225952 17295 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:52.227126 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 274460us
I20260709 12:11:52.238612 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2277) took 1607 ms. Trace:
W20260709 12:11:52.240543 17263 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.009s
I20260709 12:11:52.241021 17464 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.244361 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.260095 17226 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.260965 17347 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.171324 17343 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.271593 16969 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.272217 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:52.220811 17400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.009s	sys 0.034s
I20260709 12:11:52.180336 17264 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.276600 11871 rpcz_store.cc:276] 0709 12:11:51.082369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.013775 (+931406us) service_pool.cc:224] Handling call
0709 12:11:52.144380 (+130605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.210083 (+ 65703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.210125 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.216236 (+  6111us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:52.216308 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.216384 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.216556 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:52.291150 12576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.008s	sys 0.016s
I20260709 12:11:52.198657 17455 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.276952 12016 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:52.277618 12020 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:52.305614 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 168148us
I20260709 12:11:52.285944 11873 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:52.315167 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.323364 12603 raft_consensus.cc:2410] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:52.334956 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.335642 17455 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.336767 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:52.338325 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.338625 12020 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.339768 12020 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.326674 16372 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.333066 11872 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:11:52.322175 17402 consensus_meta.cc:287] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.002s
I20260709 12:11:52.278471 11941 rpcz_store.cc:276] 0709 12:11:50.631249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.330801 (+699552us) service_pool.cc:224] Handling call
0709 12:11:51.331226 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.331518 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:51.331915 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.211664 (+879749us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.237791 (+ 26127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.237901 (+   110us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:52.238028 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.238194 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.238453 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94286,"prepare.queue_time_us":36268,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":16399,"raft.queue_time_us":78299,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":12954,"spinlock_wait_cycles":6478592,"thread_start_us":673304,"threads_started":1,"wal-append.queue_time_us":840619}
W20260709 12:11:52.352305 17400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.010s	sys 0.034s
I20260709 12:11:52.391006 17445 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.386273 17455 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.387485 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.392347 11869 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:11:52.394629 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.395714 11869 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:52.395804 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.396520 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.396703 12013 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:52.397763 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.397835 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.398787 12016 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:52.398976 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.399467 17343 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.399925 12013 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:52.399842 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.400431 16969 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.400835 12016 raft_consensus.cc:2410] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:52.401228 16969 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.403908 16969 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.404801 17286 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.405853 17347 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.406437 17270 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.406862 17270 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.407246 17270 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.412839 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.415709 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.417403 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.421887 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:52.422951 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53390.3us
W20260709 12:11:52.424600 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.425338 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:52.425753 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:52.426326 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.427008 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77354.7us
I20260709 12:11:52.429828 17298 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.431304 17298 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.432065 17298 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.435819 17447 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.436465 17447 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.438700 17298 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.388950 11864 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:52.440256 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2962) took 1358 ms. Trace:
I20260709 12:11:52.440687 11864 rpcz_store.cc:276] 0709 12:11:51.082040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.725857 (+643817us) service_pool.cc:224] Handling call
0709 12:11:52.440044 (+714187us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54001b6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:52.440186 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521749248}
I20260709 12:11:52.441926 17296 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:52.443470 12021 consensus_meta.cc:287] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.084s	user 0.018s	sys 0.005s
I20260709 12:11:52.443979 12021 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:52.443921 17296 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:52.444705 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 3018) took 1214 ms. Trace:
I20260709 12:11:52.444772 17296 consensus_queue.cc:1243] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:52.389664 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:52.303838 17444 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.438799 17447 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.447618 17444 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.304008 17464 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.456125 17464 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.456514 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.457439 12610 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
W20260709 12:11:52.458118 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76030.8us
I20260709 12:11:52.458381 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 2216) took 1612 ms. Trace:
I20260709 12:11:52.458809 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.459690 12603 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:52.460023 17120 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.460563 17120 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:52.461870 17120 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.463646 17120 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.465068 12014 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:11:52.375065 17295 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.464874 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:52.397913 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.387786 17264 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.458837 11870 rpcz_store.cc:276] 0709 12:11:50.845483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.752176 (+906693us) service_pool.cc:224] Handling call
0709 12:11:52.458143 (+705967us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54001b5154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:52.458318 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014844672}
I20260709 12:11:52.469198 11837 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:52.388893 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.445215 12021 rpcz_store.cc:276] 0709 12:11:51.230604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.231063 (+   459us) service_pool.cc:224] Handling call
0709 12:11:52.444604 (+1213541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:52.463955 17427 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:52.470984 11867 consensus_meta.cc:287] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.004s
I20260709 12:11:52.486008 11867 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:11:52.486501 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 2958) took 1618 ms. Trace:
I20260709 12:11:52.486711 11867 rpcz_store.cc:276] 0709 12:11:50.868486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.609502 (+741016us) service_pool.cc:224] Handling call
0709 12:11:52.486442 (+876940us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:52.468595 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44329.3us
I20260709 12:11:52.479164 17455 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.481014 17460 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.472213 17153 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.484345 17456 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.150s	user 0.000s	sys 0.005s
I20260709 12:11:52.490087 17295 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:52.492092 12020 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:11:52.494391 16969 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.498555 17444 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.499059 17347 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.491006 17455 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.472780 17445 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.496439 17460 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:52.501726 17264 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.502492 17293 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.503407 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:52.504236 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.505292 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.505894 17153 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.506407 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.509616 12020 pending_rounds.cc:85] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 9
I20260709 12:11:52.529101 12020 pending_rounds.cc:107] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:11:52.529551 12020 raft_consensus.cc:2889] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.516585 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.520574 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.514505 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:52.526651 11868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.030s
W20260709 12:11:52.528643 11866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.022s
I20260709 12:11:52.530421 12018 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:52.523370 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.519088 17455 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:52.533169 11868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.030s
I20260709 12:11:52.516511 17347 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.513846 17444 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.523775 17460 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.533203 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.513592 16969 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:52.533967 11866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.008s	sys 0.022s
I20260709 12:11:52.540318 12608 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:11:52.554347 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51137.9us
I20260709 12:11:52.554831 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.543673 17347 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.545948 17444 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.555262 12021 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:52.585942 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:52.588357 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:52.589553 16372 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:52.590500 16372 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.590895 16372 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.591256 16372 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.602602 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 3021) took 1016 ms. Trace:
I20260709 12:11:52.603223 12014 rpcz_store.cc:276] 0709 12:11:51.586594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.587039 (+   445us) service_pool.cc:224] Handling call
0709 12:11:52.602325 (+1015286us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540015c554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:52.602489 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350916992}
I20260709 12:11:52.612578 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2967) took 1390 ms. Trace:
I20260709 12:11:52.571973 17293 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.623560 17293 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.613982 17427 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:52.614478 12015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.094s	sys 0.130s
W20260709 12:11:52.624794 12015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.094s	sys 0.130s
I20260709 12:11:52.614708 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:52.625982 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51754.9us
I20260709 12:11:52.627245 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:52.629124 17447 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.615324 17408 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.630620 17408 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.631268 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:52.632579 17286 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.633065 17286 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.633417 17286 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.634003 17408 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.629158 17363 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.635221 17363 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:11:52.615763 17466 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.195s	user 0.003s	sys 0.001s
I20260709 12:11:52.615881 17334 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:52.620570 17153 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:52.638419 17363 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.648707 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.620098 11865 rpcz_store.cc:276] 0709 12:11:51.222012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.068424 (+846412us) service_pool.cc:224] Handling call
0709 12:11:52.081727 (+ 13303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.082341 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:52.082958 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.525871 (+442913us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.611931 (+ 86060us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800473440. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:11:52.612124 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.612180 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:52.612240 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.612306 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.612482 (+   176us) inbound_call.cc:177] Queueing success response
0709 12:11:52.618889 (+  6407us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800473440. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189142a6 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1
0709 12:11:52.619414 (+   525us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800473440. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
Metrics: {"mutex_wait_us":73835,"prepare.queue_time_us":38627,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":13229,"raft.queue_time_us":95791,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":10433,"spinlock_wait_cycles":33617408,"thread_start_us":435575,"threads_started":1}
I20260709 12:11:52.662700 16969 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.694540 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:52.697328 17323 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.698004 17323 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:52.699214 11947 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.699095 17323 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.648185 17270 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.702867 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:52.702647 17286 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.703523 17270 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.704638 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:52.705521 17286 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.705687 11945 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:52.708881 17226 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.709717 17226 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.712657 17226 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.690361 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:52.714959 12609 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:52.719394 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2951) took 1884 ms. Trace:
I20260709 12:11:52.720690 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.719897 11866 rpcz_store.cc:276] 0709 12:11:50.835162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.792814 (+957652us) service_pool.cc:224] Handling call
0709 12:11:51.793461 (+   647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.842638 (+ 49177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.842675 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.921155 (+ 78480us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.550811 (+629656us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:52.550852 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.550916 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.719098 (+168182us) raft_consensus.cc:1685] finished
0709 12:11:52.719121 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.719319 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15845,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":53983,"thread_start_us":541947,"threads_started":1,"wal-append.queue_time_us":772200}
I20260709 12:11:52.721437 12014 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:52.745330 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:52.745894 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.746369 11940 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:11:52.749336 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:52.756254 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
W20260709 12:11:52.762890 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.778033 17334 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:52.684867 17458 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:52.786628 16969 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:52.803285 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 2969) took 1237 ms. Trace:
I20260709 12:11:52.807487 16969 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.810032 16969 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:52.814111 17452 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:11:52.815411 17448 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:52.815837 17448 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:52.825150 16372 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.836427 16372 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.804105 11871 rpcz_store.cc:276] 0709 12:11:51.563434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.339518 (+776084us) service_pool.cc:224] Handling call
0709 12:11:52.339987 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.340365 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:52.340820 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.800101 (+459281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.800173 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.800245 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.800317 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.800465 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":7956,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13337,"thread_start_us":450798,"threads_started":1}
I20260709 12:11:52.813177 17460 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.845546 12608 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.846973 17460 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:52.818341 17455 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.855520 17455 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.816972 17448 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.858449 17448 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:52.864219 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.791616 17334 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:52.836149 17406 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:52.875164 17347 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:52.897085 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.869990 17455 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:11:52.930521 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3030) took 1115 ms. Trace:
I20260709 12:11:52.900238 17406 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.932777 17263 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:52.932106 17393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.032s	sys 0.023s
W20260709 12:11:52.961171 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.018s	sys 0.040s
W20260709 12:11:52.965821 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.019s	sys 0.040s
W20260709 12:11:52.966271 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 537858us
I20260709 12:11:52.971413 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2223) took 2118 ms. Trace:
I20260709 12:11:52.974462 11868 rpcz_store.cc:276] 0709 12:11:50.847456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.791782 (+944326us) service_pool.cc:224] Handling call
0709 12:11:51.792264 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:51.792942 (+   678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.792976 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:51.912002 (+119026us) log.cc:844] Serialized 52 byte log entry
0709 12:11:52.538448 (+626446us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:52.957323 (+418875us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.960023 (+  2700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.965695 (+  5672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.965777 (+    82us) raft_consensus.cc:1685] finished
0709 12:11:52.965796 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.966029 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81046,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":10078,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":54884,"thread_start_us":960114,"threads_started":2,"wal-append.queue_time_us":771082}
I20260709 12:11:52.959110 17444 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:52.992484 17334 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:52.993268 17340 consensus_queue.cc:1059] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:11:52.996021 17406 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:52.999083 17263 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.020766 17347 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.022804 17444 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:53.023808 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.027029 17458 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:53.027671 17458 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:53.029072 17468 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:52.970955 17393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.032s	sys 0.024s
I20260709 12:11:53.019138 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.044368 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:53.058614 16969 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:53.010447 17408 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.061030 17408 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.019403 17263 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.061703 11768 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 9, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 9 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:53.091900 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:53.093417 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 397235us
W20260709 12:11:53.097589 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 469034us
W20260709 12:11:53.096009 17457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.048s	sys 0.078s
W20260709 12:11:53.115428 17457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.048s	sys 0.078s
I20260709 12:11:53.109695 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.134971 17323 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.135720 17323 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.136565 17323 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.135583 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.140868 17235 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.140952 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.141360 17235 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.141755 17235 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.931264 12017 rpcz_store.cc:276] 0709 12:11:51.826989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.860366 (+ 33377us) service_pool.cc:224] Handling call
0709 12:11:51.941735 (+ 81369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.035093 (+ 93358us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:52.494650 (+459557us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.930031 (+435381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.930095 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.930151 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.930302 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.930444 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":301825,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":93,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":30945,"thread_start_us":843106,"threads_started":2}
I20260709 12:11:53.157946 17408 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.089274 17458 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.160050 17458 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:53.162061 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 278359us
I20260709 12:11:53.127158 17478 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.175484 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.169893 17478 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.171111 17487 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.186095 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.185793 17478 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.222364 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:53.226843 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44759.3us
W20260709 12:11:53.227794 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.192765 17488 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:53.248471 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48755.2us
W20260709 12:11:53.265843 17479 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:11:53.267092 17489 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:11:53.268464 17270 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.268937 17270 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:53.269358 17270 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.244460 17488 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.269935 17488 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.284237 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:53.288975 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.289960 11871 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:53.291178 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:53.294113 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50682.9us
I20260709 12:11:53.293730 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3028) took 1644 ms. Trace:
W20260709 12:11:53.298924 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51417.5us
I20260709 12:11:53.301270 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.302001 11868 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
W20260709 12:11:53.303061 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.281910 17490 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.305099 16372 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:53.297027 16969 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.311636 17120 raft_consensus.cc:3055] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.313975 17120 raft_consensus.cc:740] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:53.314999 17120 consensus_queue.cc:260] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.316098 17120 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.297005 12015 rpcz_store.cc:276] 0709 12:11:51.649517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.662577 (+ 13060us) service_pool.cc:224] Handling call
0709 12:11:51.793990 (+131413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.914088 (+120098us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:52.625221 (+711133us) log.cc:844] Serialized 14 byte log entry
0709 12:11:53.293297 (+668076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:53.293363 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:53.293413 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.293496 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.293666 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10167,"prepare.queue_time_us":409304,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":21259,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6512,"thread_start_us":1290015,"threads_started":3,"wal-append.queue_time_us":558089}
I20260709 12:11:53.303927 17344 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.305521 17490 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.330848 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:53.332948 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.339267 17408 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.339952 17408 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.320637 16969 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.342687 17408 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.342741 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:53.343495 17491 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:11:53.354374 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.321672 17344 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.347908 17488 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.329478 17490 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.404070 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.407866 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:53.413751 16372 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.414444 16372 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:53.414911 16372 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.363896 17408 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:53.374922 17344 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.423200 17457 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.383204 17347 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:53.429692 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:53.432842 11939 raft_consensus.cc:1240] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:11:53.465456 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.432842 17457 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.484170 12014 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:53.496011 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 176045us
I20260709 12:11:53.438637 17408 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.480496 17406 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:53.514818 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.488059 17457 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.438405 17235 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.520161 17235 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.488200 17494 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:53.523780 11770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 194) took 13634 ms (client timeout 15000 ms). Trace:
I20260709 12:11:53.452994 17347 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:53.528525 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103732us
I20260709 12:11:53.534585 17488 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:53.537839 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 142019us
I20260709 12:11:53.539021 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.539965 17494 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.541671 17494 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:53.543737 17408 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.545913 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.545667 17323 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.548122 17323 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.554579 16969 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:53.527405 17406 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.562314 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:53.572381 16372 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.575747 17408 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.576479 17408 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:53.579372 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49491.3us
I20260709 12:11:53.583316 16372 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.584731 11873 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:53.581082 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:53.579705 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.600230 16372 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:53.600977 16372 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:53.632668 11839 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.664s (SENT)
I20260709 12:11:53.633632 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:53.636986 17509 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.638283 17509 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.638989 17509 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.644326 17509 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.601720 17120 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.602389 17270 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.656376 17270 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.657068 17513 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.657765 17513 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.660889 17513 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.663666 17347 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.671080 17406 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:53.672508 17263 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.610s	user 0.004s	sys 0.011s
I20260709 12:11:53.673120 17263 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.678201 17406 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.679239 17406 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.680405 17347 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.681169 17347 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.683866 17347 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.684778 17153 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.684918 17406 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.685408 17153 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.688310 17153 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:53.699446 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:53.702708 17406 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.702733 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:11:53.712126 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.713193 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.718891 17478 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:53.524271 11770 rpcz_store.cc:269] 0709 12:11:39.888910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.889167 (+   257us) service_pool.cc:224] Handling call
0709 12:11:53.523534 (+13634367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:49.005093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:49.005767 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:49.005807 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:11:49.005825 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:49.007361 (+  1536us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:49.007427 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:49.007456 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:49.332765 (+325309us) tablet.cc:701] Row locks acquired
0709 12:11:49.332788 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:11:49.332988 (+   200us) write_op.cc:270] Start()
0709 12:11:49.333128 (+   140us) write_op.cc:276] Timestamp: P: 1783599109332931 usec, L: 0
0709 12:11:49.333153 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:11:49.333937 (+   784us) log.cc:844] Serialized 5950 byte log entry
0709 12:11:50.291359 (+957422us) op_driver.cc:464] REPLICATION: finished
0709 12:11:50.678664 (+387305us) write_op.cc:301] APPLY: starting
0709 12:11:50.682348 (+  3684us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:51.510651 (+828303us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:51.510808 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:52.045755 (+534947us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:52.046242 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:11:52.046313 (+    71us) write_op.cc:312] APPLY: finished
0709 12:11:52.046957 (+   644us) log.cc:844] Serialized 139 byte log entry
0709 12:11:52.556307 (+509350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:52.622470 (+ 66163us) write_op.cc:454] Released schema lock
0709 12:11:52.622595 (+   125us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:52.773373 (+150778us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:52.779589 (+  6216us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196937,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":368163,"apply.run_cpu_time_us":64014,"apply.run_wall_time_us":1981875,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":70891,"prepare.run_cpu_time_us":21717,"prepare.run_wall_time_us":394665,"raft.queue_time_us":422394,"raft.run_cpu_time_us":17701,"raft.run_wall_time_us":382824,"replication_time_us":903600,"thread_start_us":1086281,"threads_started":6,"wal-append.queue_time_us":880709,"wal-append.run_cpu_time_us":40455,"wal-append.run_wall_time_us":1489643}]]}
W20260709 12:11:53.728609 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 125625us
W20260709 12:11:53.735317 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 168096us
I20260709 12:11:53.737911 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:53.747062 17120 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:53.774192 17153 raft_consensus.cc:2764] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:11:53.764712 17458 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.604s	user 0.002s	sys 0.012s
I20260709 12:11:53.765561 17263 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:53.788396 11940 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:11:53.768402 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.769191 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.769888 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.853349 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.854130 11873 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:53.855340 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.855537 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.856186 11867 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.846010 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.853417 12015 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:53.854166 12018 raft_consensus.cc:2410] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:53.770781 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.693370 17490 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.864709 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.864975 17490 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.789494 16372 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.865492 11868 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.766412 17478 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:53.798802 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.866838 12610 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:53.800287 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.802732 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.869359 12608 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:53.816658 17344 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.819370 16969 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:53.792595 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54840.9us
I20260709 12:11:53.823293 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.874954 11865 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:53.824342 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.876286 12021 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:53.825079 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.877333 11866 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:53.823293 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.834194 17408 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:53.834880 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:53.745219 17457 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.844182 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.846061 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:53.888320 11869 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:53.888231 12022 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:53.846619 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.889667 12020 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:53.847426 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.890614 11871 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.849213 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.849850 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.850586 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:53.870081 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:53.809815 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:53.892063 12603 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:53.882452 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.846328 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.893225 11872 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.894754 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.899139 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:11:53.894409 11914 connection.cc:256] RPC call timeout handler was delayed by -1.4870453339999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 12:11:53.900331 11914 connection.cc:256] RPC call timeout handler was delayed by -1.3871453340000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 12:11:53.900637 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.900887 17347 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:11:53.901217 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.901680 17340 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:53.899634 17408 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.906337 12016 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:53.906986 17344 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:53.907212 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.907908 12017 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:11:53.910236 11914 connection.cc:256] RPC call timeout handler was delayed by -1.2359453340000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 12:11:53.910687 11914 connection.cc:256] RPC call timeout handler was delayed by -1.2044453339999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 12:11:53.911000 11914 connection.cc:256] RPC call timeout handler was delayed by -1.1900453339999331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 12:11:53.911309 11914 connection.cc:256] RPC call timeout handler was delayed by -1.1387453339998501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:11:53.911600 11914 connection.cc:256] RPC call timeout handler was delayed by -1.0379453339999145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 12:11:53.911902 11914 connection.cc:256] RPC call timeout handler was delayed by -1.0289453339999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 12:11:53.913928 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:53.915992 11867 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:11:53.907042 11868 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:53.919521 11872 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:53.922160 16372 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.922865 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.924513 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.924803 17393 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.925225 11866 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.927448 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.901628 17347 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.928359 17393 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.930517 17347 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.930621 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:53.931439 17393 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.933334 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:53.947702 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.948644 17393 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.949066 17393 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:53.947891 11872 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:53.949422 17393 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.950730 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.952181 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.952865 11872 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.957525 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:53.958256 11864 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.960726 17444 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:53.964068 17457 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.964092 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:53.964855 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:53.969218 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.971469 11872 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:11:53.973346 11871 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:53.974711 17393 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:53.976230 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.977193 17393 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:53.977767 17444 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.978798 17444 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:53.979193 17444 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.978075 17458 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.978415 11945 consensus_queue.cc:237] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:53.906344 17408 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:53.978200 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:53.985054 12017 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:54.007223 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.008690 16372 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.009111 16372 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.009445 16372 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.014011 17458 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.015959 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.020126 11865 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.016781 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:54.021709 12017 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.987673 17408 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.029031 11866 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:54.033396 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.033826 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.034351 11866 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.035991 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:54.036810 12020 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.042143 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.042948 11940 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.003775 17457 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.019762 17458 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.029858 17344 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.071014 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.079577 11942 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:54.080945 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 159590us
I20260709 12:11:54.097719 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.098748 11871 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.103943 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.105086 17286 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.105507 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.120545 11948 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:54.121256 17393 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.107223 17444 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.122270 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:54.116554 11768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 226) took 21336 ms (client timeout 15000 ms). Trace:
I20260709 12:11:54.118561 11941 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:11:54.118691 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.119447 11944 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.078517 17458 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.130722 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.131995 11943 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.134436 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.135175 11948 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:54.136303 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.137120 11944 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.119048 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.138185 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.137432 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.142792 17393 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.143600 17393 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:54.144629 17393 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.150928 17513 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:54.153527 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.159916 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:54.160975 17323 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.161638 17323 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:54.162194 17323 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:54.124055 11768 rpcz_store.cc:269] 0709 12:11:32.780597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.780839 (+   242us) service_pool.cc:224] Handling call
0709 12:11:54.116428 (+21335589us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:53.533963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:53.534742 (+   779us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:53.534813 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:11:53.534849 (+    36us) tablet.cc:662] Decoding operations
0709 12:11:53.535362 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:53.535458 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:53.535490 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:53.535807 (+   317us) tablet.cc:701] Row locks acquired
0709 12:11:53.535856 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:53.536077 (+   221us) write_op.cc:270] Start()
0709 12:11:53.536240 (+   163us) write_op.cc:276] Timestamp: P: 1783599113536002 usec, L: 0
0709 12:11:53.536266 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:11:53.560802 (+ 24536us) log.cc:844] Serialized 536 byte log entry
0709 12:11:53.795267 (+234465us) op_driver.cc:464] REPLICATION: finished
0709 12:11:53.835701 (+ 40434us) write_op.cc:301] APPLY: starting
0709 12:11:53.835823 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:53.837296 (+  1473us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:53.837456 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:53.860566 (+ 23110us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:53.860845 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:53.860893 (+    48us) write_op.cc:312] APPLY: finished
0709 12:11:53.861117 (+   224us) log.cc:844] Serialized 25 byte log entry
0709 12:11:53.871464 (+ 10347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.871597 (+   133us) write_op.cc:454] Released schema lock
0709 12:11:53.871673 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:53.885601 (+ 13928us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.885633 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223536,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":40060,"apply.run_cpu_time_us":4416,"apply.run_wall_time_us":49863,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":191448,"prepare.run_cpu_time_us":3779,"prepare.run_wall_time_us":62198,"replication_time_us":258796,"thread_start_us":144094,"threads_started":2}]]}
W20260709 12:11:54.185312 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.196627 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.196884 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.196627 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.197736 11867 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.198073 11868 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:11:54.198112 11939 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.202543 11940 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:54.204188 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.205569 11872 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:54.205296 11871 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:11:54.208963 11865 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:54.212993 16372 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.077919 11864 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:54.214349 11873 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:54.069697 12017 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:54.218657 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.219527 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.223948 16372 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:54.223555 11867 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:11:54.220137 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.060333 17457 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.238065 11940 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.238772 11866 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:11:54.252621 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.253654 16372 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:54.255853 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:54.234735 17369 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.268725 11942 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:11:54.088760 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:11:54.275628 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:54.277455 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 77050.6us
I20260709 12:11:54.278930 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:54.273723 17369 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.288686 17444 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:54.274202 17508 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.293890 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56416.3us
I20260709 12:11:54.295056 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:54.296114 17323 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.295181 17369 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.299062 17323 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:54.299857 17508 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.300709 17286 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:54.303943 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 253593us
I20260709 12:11:54.305286 16372 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.305817 16372 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:54.306157 16372 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.307593 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.309930 11866 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:11:54.311514 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.311779 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.312812 11864 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:11:54.313719 11939 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:11:54.315955 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.321090 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.332708 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.318332 17363 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.339187 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.340137 11769 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:54.341346 17458 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.342346 11769 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 12 to 13, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 13 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.344888 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.346544 17408 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.347803 11869 raft_consensus.cc:1240] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.349154 17408 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:54.335597 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.346899 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.352653 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.344321 11769 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.356684 16372 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.360735 17363 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:54.362107 17363 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.363739 17457 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:54.367292 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.371978 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:54.372314 11769 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.374509 16372 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:54.377007 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.377682 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:54.374395 17344 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:54.379132 17344 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.382306 11769 catalog_manager.cc:5697] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 12, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.385845 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.384274 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.388209 16372 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.390923 11869 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.391024 16372 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:54.391582 16372 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.390753 11769 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:54.388357 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:54.388998 11947 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.381912 17344 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.385915 17488 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.395613 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:54.397680 11769 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:54.400552 11869 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:11:54.401029 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:11:54.411952 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 141179us
W20260709 12:11:54.415709 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.416388 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:54.416401 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:54.416256 11769 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 9 to 12, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 12 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:54.417999 11873 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.418054 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:54.419124 12604 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:54.419610 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:54.392580 17478 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:54.431264 17528 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.425096 11873 pending_rounds.cc:85] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 8
I20260709 12:11:54.425053 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.433439 11873 pending_rounds.cc:107] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:11:54.434340 11873 raft_consensus.cc:2889] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.436156 17153 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:54.420773 17458 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:54.436782 17153 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.437484 17478 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.438364 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.439110 11947 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
I20260709 12:11:54.439222 17153 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:54.432626 17120 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:54.439875 17478 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.440201 17120 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:54.410041 17444 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.441560 17120 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.422670 17448 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:54.420215 17344 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:54.445562 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.446559 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:54.446944 11988 connection.cc:256] RPC call timeout handler was delayed by -2.1929686360001597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 12:11:54.447202 11867 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.448158 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.454607 11871 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 12:11:54.455103 11988 connection.cc:256] RPC call timeout handler was delayed by -2.00936863600009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:11:54.455685 11988 connection.cc:256] RPC call timeout handler was delayed by -1.790668635999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 12:11:54.456100 11988 connection.cc:256] RPC call timeout handler was delayed by -1.6664686359999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 12:11:54.458846 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.459884 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.462010 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.466616 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.468087 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.472680 11866 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:54.472672 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.453926 17458 raft_consensus.cc:2764] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:54.445639 17448 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:54.491703 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:54.462481 11988 connection.cc:256] RPC call timeout handler was delayed by -1.6583686359999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 12:11:54.475069 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.456622 17444 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.485209 11948 raft_consensus.cc:2368] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:54.489126 11939 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.476356 11947 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:54.492710 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:54.493901 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.493974 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.504745 11945 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:54.496948 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.499491 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.505950 11943 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.472829 17329 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.476593 17393 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.503114 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.518368 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:54.484248 11867 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:54.519817 11866 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:54.518205 11944 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:54.450691 17344 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.535851 16372 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.540414 16372 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:54.543419 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:54.520850 12608 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:54.548652 11870 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.500279 17444 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.501667 17340 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:54.556749 11944 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.566893 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:54.556018 17444 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.547483 17393 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:54.532094 17528 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:54.557251 17340 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.535440 17329 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.569160 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.579331 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:54.580461 11946 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.575670 17457 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.582156 17457 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.584738 17457 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.573949 17153 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.586513 17153 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:54.586937 17153 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.593127 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:54.597142 17179 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.597687 17179 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.598044 17179 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.604743 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.577426 17340 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:54.621876 17263 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.659832 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.660939 11940 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:54.625748 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46516.1us
I20260709 12:11:54.662489 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:54.664285 17263 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.627838 17344 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.632392 17179 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.667482 17179 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:54.669018 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.577070 17448 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.608278 17535 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:11:54.671749 17535 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.672247 17535 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:54.674970 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:54.675974 17344 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.676412 17344 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.676748 17344 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.653096 17393 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.679132 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.679554 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.680027 11939 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:54.681100 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.681924 11946 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.654772 11944 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.624552 17329 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:54.685990 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.689787 11948 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:54.700240 17263 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:54.727628 17535 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.729928 17535 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.747259 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.747726 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.776350 11948 raft_consensus.cc:2393] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:54.787850 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 189397us
I20260709 12:11:54.808480 17490 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:11:54.808960 17444 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.810463 11941 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.811691 17444 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:54.806710 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.819574 11948 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:54.822965 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 121679us
I20260709 12:11:54.827690 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.831965 11948 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:54.841049 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.845005 11941 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:54.846824 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.847674 11944 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:54.861999 17547 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.862762 17547 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:54.880116 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:54.887056 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.888666 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.887841 11944 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:54.889602 11864 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:54.891098 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.891788 11948 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.828433 17263 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:54.897840 11944 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.893524 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:54.899646 11866 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:54.826702 17340 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.905722 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:54.914026 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:54.915699 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 69080.2us
I20260709 12:11:54.863947 17547 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.916435 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.920423 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.921641 17538 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:11:54.923317 17490 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.923807 17490 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.946005 11839 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.595s (SENT)
W20260709 12:11:54.948132 11839 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.595s (SENT)
I20260709 12:11:54.948644 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:54.888391 17153 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:54.917023 17523 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.953886 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.957839 11939 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.892536 17344 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:54.954953 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.955250 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.955586 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.956107 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.960433 17451 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.960906 17547 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.932642 17490 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.949641 17508 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:54.984680 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:54.986392 12020 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.983551 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.991070 11944 raft_consensus.cc:2368] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:54.957309 17523 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.993952 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.995817 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:54.996140 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74232.1us
I20260709 12:11:54.996929 11943 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:11:54.997495 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.994225 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.002391 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.005043 11944 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:54.982074 17451 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:54.995608 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.009930 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.012553 11939 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:55.018340 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:54.995537 17523 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.981549 17120 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:55.019642 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.026944 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:55.029335 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79223.9us
I20260709 12:11:55.031530 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:54.995431 17263 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:55.033444 12020 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:55.037305 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.042174 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.042562 11944 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:55.000910 17545 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:55.044540 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.050669 11943 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.054441 17551 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.057163 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.058466 12608 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 6 to 8, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:55.068959 11944 raft_consensus.cc:2393] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:55.065828 11839 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.712s (SENT)
I20260709 12:11:55.073264 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.077605 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.077147 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.082864 17508 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.985476 17393 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 6 to 8, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:55.070844 17545 consensus_queue.cc:1243] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:55.065117 17551 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:55.084946 17554 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.086166 11944 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:11:55.086444 17543 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:11:55.087699 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 45627.9us
I20260709 12:11:55.153618 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.154788 17548 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.155812 11988 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.087903 17263 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.092842 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.100872 17448 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:55.179920 17448 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:55.181492 17448 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.183424 17448 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.119545 17153 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:55.186483 17153 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:55.125675 17551 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:55.190594 11839 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.819s (SENT)
I20260709 12:11:55.191293 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.193116 17508 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.102561 17542 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:11:55.113656 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.126080 17553 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.198472 17553 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:55.199725 17545 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.199894 17553 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.201028 17545 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:55.130524 17451 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:55.137838 17536 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.308s	user 0.004s	sys 0.002s
I20260709 12:11:55.118968 17344 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:55.119042 17340 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:55.134864 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59450 (request call id 0) took 1159 ms. Trace:
I20260709 12:11:55.178354 17263 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.201872 17553 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.231189 12020 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:55.203351 17451 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.227357 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.227666 11873 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.238363 11943 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.214586 17393 rpcz_store.cc:276] 0709 12:11:53.975573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.975752 (+   179us) service_pool.cc:224] Handling call
0709 12:11:54.005216 (+ 29464us) log.cc:844] Serialized 501 byte log entry
0709 12:11:55.134715 (+1129499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7545,"raft.queue_time_us":43565,"raft.run_cpu_time_us":1463,"raft.run_wall_time_us":4348,"thread_start_us":225995,"threads_started":2,"wal-append.queue_time_us":256335}
I20260709 12:11:55.218147 17545 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:11:55.240825 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.585s (SENT)
I20260709 12:11:55.240482 17545 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.241333 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbba5e6f295144a79461c5afc2e273ae with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:55.242190 17545 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:55.242687 11839 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.585s (SENT)
I20260709 12:11:55.243162 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.244313 17508 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.218252 17554 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:55.246547 17554 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.248662 17554 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.261914 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.262171 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:55.262890 12020 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.272541 12020 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:55.274899 11948 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:55.283447 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.284382 12022 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:55.284866 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:55.285182 11873 raft_consensus.cc:1275] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:55.289011 11873 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:11:55.289754 11839 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.935s (SENT)
I20260709 12:11:55.291040 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.293758 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:55.286398 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 253379us
I20260709 12:11:55.301190 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.315644 12018 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.299932 12015 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.294215 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.323020 12015 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:55.329182 11839 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.649s (SENT)
I20260709 12:11:55.330312 12019 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:11:55.331956 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:55.332823 17179 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.333325 17179 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:55.335343 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.336114 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.338472 11867 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.339442 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.340054 11943 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:55.342806 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:55.343669 11870 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.346467 11869 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:55.350545 11948 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:55.355559 11948 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:55.282723 17523 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.375944 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:55.376178 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.376732 12020 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.376979 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:55.378103 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:55.382848 17528 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.390426 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:55.392442 17508 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:55.393635 11867 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:55.383792 17528 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:55.407320 17523 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:55.413717 12020 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:55.417892 11870 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
W20260709 12:11:55.418066 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 262347us
I20260709 12:11:55.419589 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.421283 12018 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:55.373674 17551 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.423602 12018 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:55.334565 17179 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.429776 11943 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 20.
I20260709 12:11:55.431859 17548 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.431561 17120 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:11:55.439128 12020 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:55.448848 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:55.450878 12016 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:55.450368 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 72322.6us
I20260709 12:11:55.459985 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.465492 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.465159 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.467242 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.432835 17490 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.468642 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.471340 12021 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:55.483577 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.484462 11947 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.485519 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.486445 12013 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:55.487392 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.488123 12013 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:55.488919 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:55.489701 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.460433 17562 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:55.472029 17444 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.491411 17444 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:55.491798 17444 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.491910 11948 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:55.465646 17559 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:55.495785 17559 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.492913 17562 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:55.507220 12015 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.502434 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.506140 17565 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:55.521360 11947 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:55.509047 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:55.513957 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 131831us
I20260709 12:11:55.523262 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.523666 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.521384 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.525776 12017 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:55.526402 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55351.7us
I20260709 12:11:55.527618 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.527941 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:55.528409 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.529147 17568 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:55.530212 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.531566 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.529155 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:55.468266 17564 raft_consensus.cc:2764] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:55.540560 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.544195 12013 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.542287 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.543126 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.539759 17563 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:55.461047 17329 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:55.543133 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.551357 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.552469 12019 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.561967 12022 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.470289 17508 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:55.563381 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.568624 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.571681 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.522352 17565 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:55.574414 12017 raft_consensus.cc:2368] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:11:55.572261 12013 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:55.575314 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.578118 12019 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:55.575659 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.538900 17393 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.579607 12016 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:55.583132 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.585348 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.566623 17340 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:55.527874 17534 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:11:55.594235 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 62750.2us
I20260709 12:11:55.569098 17559 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:55.599534 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.600922 12014 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:55.594436 17564 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.587548 17574 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.594951 17340 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:55.595698 17393 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.592152 17451 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:55.614679 17393 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.625876 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.626358 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.626910 17153 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:55.627386 17153 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:55.628279 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.627308 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.625136 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.633039 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.638756 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:55.641714 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.640699 12021 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:55.646592 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.647667 12014 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:55.648639 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.651213 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.652019 12016 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:55.612548 17568 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.654649 12014 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.641350 17551 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:55.665874 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 142280us
I20260709 12:11:55.668133 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.669008 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.671314 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.673087 17568 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:55.677103 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.677968 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.679420 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.681521 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:55.682372 11948 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:55.682695 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.683909 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.681851 17444 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.685503 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.688815 12016 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:55.687309 17444 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:55.688035 12014 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:55.690925 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.692755 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.694132 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.691566 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.695442 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.696451 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.696662 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:55.697304 12019 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:55.697075 17490 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:55.697717 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.698200 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.698922 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.699496 12013 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 7.
I20260709 12:11:55.695442 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:55.700417 12016 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:55.699618 12019 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:11:55.705375 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.706372 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.707119 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:55.709169 17551 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.710716 17576 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:55.711426 17576 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.712430 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:55.731396 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.732772 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.735272 11944 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:55.738471 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.739200 11947 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.740870 11946 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:11:55.749584 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.756222 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:55.727993 17563 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:55.762741 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50393.7us
I20260709 12:11:55.750798 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.718675 17528 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:55.728979 17451 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:55.761340 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 93221.5us
I20260709 12:11:55.616595 17565 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.766394 11946 raft_consensus.cc:2368] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:55.612511 17562 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.755697 17545 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:55.767740 17554 consensus_meta.cc:287] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.010s
I20260709 12:11:55.728870 17329 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:55.666958 17153 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.783885 11988 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:11:55.779698 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.762647 17563 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:55.790885 12018 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:11:55.768101 17577 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.714340 17340 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.785310 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:55.794147 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 199139us
I20260709 12:11:55.799389 11943 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.795400 11947 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:11:55.793529 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.778242 17451 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:55.812258 11946 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.801174 12577 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:55.810319 17563 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.779874 17580 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.815943 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.817337 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:55.819521 11946 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.819870 11946 raft_consensus.cc:614] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:55.786593 17564 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.769063 17528 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:55.836005 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 58819.5us
I20260709 12:11:55.837586 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.792503 17577 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:55.846652 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:55.848798 11943 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:55.854859 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.856448 17592 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.857254 17592 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.856870 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.858763 17592 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:55.863622 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 70215.6us
I20260709 12:11:55.866205 11839 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.865450 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.868177 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.868939 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:55.871088 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.824331 17179 raft_consensus.cc:2804] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.835772 17554 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.881744 17547 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.884476 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.862702 17580 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.888306 17579 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:55.888985 17579 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.889367 17528 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:55.875759 17551 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:55.890328 17551 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.890069 17579 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.891381 17576 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:55.891772 17574 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.892256 17577 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:55.893739 17577 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.888388 17451 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.899797 17179 raft_consensus.cc:697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:55.889398 17444 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.890744 17551 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:55.816702 17578 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 12:11:55.924998 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68274.1us
I20260709 12:11:55.928551 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:55.919435 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.875149 17563 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.875229 17553 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.932636 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.935587 17576 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:55.936220 17576 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:55.935202 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:55.939798 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.926136 17554 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:55.924800 17444 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:55.968410 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 135130us
I20260709 12:11:55.973308 17588 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.978987 17478 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:55.982653 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.942054 17545 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:56.007534 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.941967 17580 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:55.987207 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:55.933771 17574 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.937772 17568 raft_consensus.cc:2764] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:56.014739 17553 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.939843 17508 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.937487 17576 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:56.019678 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 151538us
I20260709 12:11:55.942981 17547 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:11:56.042454 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:56.043233 11943 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:56.038497 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.668s (SENT) [suppressed 50 similar messages]
I20260709 12:11:56.007203 17478 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:56.038450 17568 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.036418 17554 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:11:56.071388 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.018213 17580 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:55.971246 17564 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.019687 17179 consensus_queue.cc:237] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.056329 17588 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:56.122633 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84165.7us
W20260709 12:11:56.128572 11839 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.087s (SENT)
I20260709 12:11:56.129387 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:56.056913 17546 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.246s
I20260709 12:11:56.133199 11946 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:11:56.138373 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.054935 17583 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.281s
W20260709 12:11:56.129913 17585 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:56.129390 17575 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.195886 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:56.196933 11945 raft_consensus.cc:606] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:56.083906 17568 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.131001 17574 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:56.160243 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:56.139994 17598 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:11:56.131568 17595 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:56.145439 17589 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:11:56.080585 17444 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.134785 17596 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:56.250479 17596 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.252323 17565 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.252942 17580 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:56.195951 17552 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:11:56.144623 17594 consensus_queue.cc:1059] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.219s
I20260709 12:11:56.236956 17153 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.243054 17568 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.227671 17574 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:56.244688 17587 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:11:56.247467 17593 raft_consensus.cc:993] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:11:56.272163 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 143612us
W20260709 12:11:56.284899 11839 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 2.103s (SENT)
I20260709 12:11:56.285394 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:56.144659 17591 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.243s
I20260709 12:11:56.253168 17596 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:56.301738 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 164279us
W20260709 12:11:56.308584 17602 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:11:56.314496 11839 leader_election.cc:336] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.825s (SENT)
I20260709 12:11:56.318429 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.291450 17580 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.327843 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:56.321214 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 316801us
I20260709 12:11:56.286043 17551 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.314333 17553 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.320400 17583 raft_consensus.cc:1081] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:11:56.321959 17563 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.321734 17561 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.328902 17595 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.363607 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.325465 17578 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:56.376181 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 363288us
I20260709 12:11:56.394002 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.372961 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:56.397487 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.358384 17120 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.356856 17553 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.406365 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.459704 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.459882 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.370714 17561 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.462430 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:56.460950 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54703.6us
I20260709 12:11:56.464426 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.474165 11948 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:56.474432 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.475267 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:56.475157 11872 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:56.475914 11870 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.478619 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.468184 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.469866 12015 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:56.470817 11868 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:56.393221 17562 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:56.466275 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.398119 17580 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:56.485795 17572 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:11:56.486609 12016 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 12:11:56.487950 17599 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:11:56.488098 17568 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:56.369474 17594 consensus_queue.cc:1048] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:11:56.490527 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.491657 12021 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:56.492965 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:56.471499 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 53864.4us
I20260709 12:11:56.494082 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.495285 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:56.497650 11866 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:56.480278 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.507862 11869 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:11:56.374905 17563 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.465747 17546 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.471261 17547 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.380574 17579 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:11:56.488621 17568 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:56.542641 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 133191us
I20260709 12:11:56.388422 17592 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 12:11:56.510123 17590 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:56.484644 17562 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.480269 17607 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.499280 17179 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.565732 17179 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.568197 17179 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:56.569069 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.559772 17601 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.190s
I20260709 12:11:56.560542 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:56.561685 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:56.564960 17551 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:56.523355 11870 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:56.472110 17120 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:56.637506 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84801.5us
W20260709 12:11:56.639556 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 276005us
I20260709 12:11:56.640645 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.653664 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.582581 17545 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:56.630065 17575 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:56.664640 17607 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:56.668311 17606 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:11:56.670231 17568 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.677477 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.581501 17590 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:56.629364 17478 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.639621 17547 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.652642 17595 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.678855 17578 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.660251 17580 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.662416 17574 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:56.555317 17553 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.665881 17608 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 12:11:56.715225 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.714982 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:56.758190 17577 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.711239 17562 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.761186 17562 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.743708 17553 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:56.775314 17614 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
W20260709 12:11:56.777578 17613 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:11:56.779628 17609 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:11:56.716231 17583 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:56.780951 17583 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.781572 17563 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.783982 17583 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.706610 17588 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:56.790791 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:56.800081 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84949.9us
I20260709 12:11:56.698205 17478 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:56.805212 17610 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:56.788190 17561 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:56.807464 17153 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.006s
I20260709 12:11:56.807564 17561 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.808569 12019 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:11:56.808982 12019 pending_rounds.cc:85] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 7
I20260709 12:11:56.809222 12019 pending_rounds.cc:107] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:11:56.809469 12019 raft_consensus.cc:2889] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:56.810667 17120 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.707095 17607 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.790393 17528 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.830668 17528 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:56.831756 17528 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.832964 17528 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.825165 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:11:56.833981 11943 raft_consensus.cc:606] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:56.834388 11943 raft_consensus.cc:614] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:56.835772 17508 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 12:11:56.829663 17547 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.811722 17575 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.841958 11868 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.842017 17554 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:56.843659 17554 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.836557 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:56.748042 17578 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.848256 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.848958 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:56.849933 11871 raft_consensus.cc:2410] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:56.846803 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.846131 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.854252 11868 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:56.857611 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:11:56.852600 17565 consensus_meta.cc:287] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.003s
I20260709 12:11:56.859227 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.860116 11872 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:11:56.859516 11871 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:56.862233 11865 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.857493 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:11:56.874917 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 394695us
I20260709 12:11:56.891490 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:56.891518 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:56.892860 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:56.894193 11944 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:56.896510 11946 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.897393 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:56.853070 17508 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:56.898984 11871 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:11:56.903106 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 263885us
I20260709 12:11:56.904934 11864 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:56.908934 11939 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:56.910389 11988 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:56.912045 11988 leader_election.cc:400] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:56.912335 11988 leader_election.cc:403] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:56.917661 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.892323 17565 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.925261 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2308) took 1191 ms. Trace:
I20260709 12:11:56.925866 11939 rpcz_store.cc:276] 0709 12:11:55.733500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.733661 (+   161us) service_pool.cc:224] Handling call
0709 12:11:55.755868 (+ 22207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.909401 (+1153533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.924963 (+ 15562us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002e54d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:56.925183 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651098368}
I20260709 12:11:56.926435 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:56.924726 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:56.930708 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.857417 17578 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.932610 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.932888 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:56.934019 17578 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.934733 17623 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:56.893744 17591 consensus_queue.cc:1059] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:56.942761 17624 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:56.943372 17624 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.944388 17624 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.945151 17579 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.921427 17546 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:56.798667 17590 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.948956 17578 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.949481 17578 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.900362 17153 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:56.912268 17583 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.903934 17594 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:56.963829 11943 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.924804 17545 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:56.964520 17153 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.965487 17616 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.965751 17545 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.966485 17545 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:56.967509 17545 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:56.968199 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:56.968822 11864 raft_consensus.cc:3060] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.946154 17579 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:56.704635 17595 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:56.959127 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.979702 12020 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
W20260709 12:11:56.959445 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.920368 17562 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.949345 17478 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:56.969897 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:56.989085 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.989655 11867 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:11:56.971853 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:56.972838 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.920245 17444 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.973945 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.974421 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.995734 12017 raft_consensus.cc:2468] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:56.976423 11868 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:56.977627 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.980182 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.997694 12021 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:11:56.981794 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.984239 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.965570 17578 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:56.954718 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:56.990903 11865 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:56.988328 11839 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.553s (SENT)
I20260709 12:11:57.001358 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:56.992864 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.001627 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:56.993258 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:56.997787 12022 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:11:56.982860 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 20.
I20260709 12:11:56.999370 12014 raft_consensus.cc:2410] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:11:57.000108 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:57.003336 11839 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Timed out: RequestConsensusVote RPC to 127.10.114.67:37161 timed out after 1.649s (SENT)
I20260709 12:11:57.004510 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.005308 12021 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:56.999847 17588 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.010510 17588 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.011679 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:57.012441 12013 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:11:57.012933 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.013901 11940 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:56.958053 17565 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.015000 17153 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:56.993816 17562 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:57.022068 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 67779.6us
I20260709 12:11:57.023031 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:57.023414 17562 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:57.025324 11944 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:57.026127 17590 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.029738 17580 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.032619 17554 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:57.033427 12018 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:57.034524 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:57.035264 12017 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:57.039502 11865 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:56.968834 17545 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.041116 11864 raft_consensus.cc:2468] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
W20260709 12:11:57.044019 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51259.7us
I20260709 12:11:56.981935 17508 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.061802 17508 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.064247 17508 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.046065 17616 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:57.066040 17616 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:57.067160 17616 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.046255 17583 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.990871 17624 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.073037 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:57.075181 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.083395 17588 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.034440 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:57.045334 17153 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:57.047549 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:57.048141 11947 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:56.959918 17564 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 12:11:57.048580 11940 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:11:57.089167 12015 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:57.053979 17630 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.056028 17595 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:57.057358 17575 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:57.058668 17605 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:57.084990 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50631.4us
I20260709 12:11:57.086467 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.124432 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.125098 11864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
W20260709 12:11:57.096195 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 92890.5us
I20260709 12:11:57.109954 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:57.127521 12608 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:57.128183 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:57.129591 11873 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:11:57.130066 17153 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.116406 17630 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:57.109817 17579 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.129419 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:57.114338 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:57.128633 11869 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:11:57.125881 11864 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:57.151636 11864 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.133909 12017 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:11:57.154358 12017 pending_rounds.cc:85] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:11:57.154711 12017 pending_rounds.cc:107] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:11:57.155010 12017 raft_consensus.cc:2889] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.134086 12014 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 12:11:57.156016 12014 pending_rounds.cc:85] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:57.156247 12014 pending_rounds.cc:107] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 12:11:57.156523 12014 raft_consensus.cc:2889] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.109450 17601 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.139962 12016 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:57.159291 12016 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:11:57.140455 12022 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:57.141512 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.143826 17153 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.089358 17594 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:57.165127 17153 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:57.166006 17153 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.165840 17594 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.165879 17478 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.169250 17478 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:57.169636 17478 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.112739 17588 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.172592 17588 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.172816 17561 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:57.173039 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.173846 17554 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.174247 17554 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:57.175546 17588 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.175134 17554 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.176743 17554 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:57.181435 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.148679 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:57.203094 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.204353 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:57.148263 17579 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.219274 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.218623 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.224264 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:57.224913 11945 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
W20260709 12:11:57.352125 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 225689us
W20260709 12:11:57.363638 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.226935 11864 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.217504 17579 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.365017 11868 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:57.366554 11869 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.368613 17640 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.187s
W20260709 12:11:57.370752 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 150286us
I20260709 12:11:57.444028 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:57.371860 17600 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:11:57.197992 17340 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:57.386412 17642 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:57.224042 17562 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:57.468581 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:57.457314 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.458536 11864 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.473369 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:57.446563 17587 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 12:11:57.488126 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.506037 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.510456 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.523811 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.421293 17595 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.439401 17565 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.461711 17588 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.438458 17604 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.386s
I20260709 12:11:57.528965 17607 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:57.533851 17601 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.469662 17508 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.530699 17563 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:57.546538 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.469151 17591 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.537647 17578 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.527683 17564 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:11:57.537774 17623 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.526684 17562 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:57.598948 11866 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:57.561517 17547 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.573002 17625 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.621582 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 100147us
W20260709 12:11:57.609128 17590 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
I20260709 12:11:57.584764 17607 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:57.543320 17595 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.563378 17626 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:11:57.598639 17591 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:57.611320 17565 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:57.597270 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 71735.2us
I20260709 12:11:57.607168 17578 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:57.697024 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.698640 11839 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:11:57.580273 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 369772us
I20260709 12:11:57.599474 17563 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:57.676573 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.599054 17508 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.567323 17588 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.702737 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:57.705051 17648 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:11:57.691431 17591 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.631053 17547 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.632977 17623 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.715003 11867 raft_consensus.cc:2955] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 6 to 8, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:11:57.711494 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:57.700882 17578 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.711205 17563 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.711009 17590 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:57.713824 17634 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:11:57.740957 11839 leader_election.cc:400] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:57.743954 11839 leader_election.cc:403] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.709642 17630 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.715142 17565 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.725096 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:11:57.726603 17624 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.005s
I20260709 12:11:57.646442 17625 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.698261 17594 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:11:57.754200 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.759419 17590 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:11:57.742481 17601 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:57.757578 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 116021us
I20260709 12:11:57.742491 17340 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.717979 17593 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:57.763842 17630 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:57.764568 17653 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:11:57.765311 17646 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:11:57.766311 17644 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
W20260709 12:11:57.770323 17638 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
W20260709 12:11:57.770560 17637 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 12:11:57.774999 17588 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:57.779203 17478 consensus_meta.cc:287] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.001s
I20260709 12:11:57.779932 17572 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:57.780500 17595 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:57.754391 17545 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.004s
I20260709 12:11:57.724702 17575 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:57.829572 17575 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:57.832456 17575 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:57.807829 17630 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.755582 17553 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.802165 12013 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:57.803453 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 157441us
I20260709 12:11:57.816171 12021 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:11:57.803630 17546 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.804716 17340 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.837275 12021 pending_rounds.cc:85] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:11:57.841806 12021 pending_rounds.cc:107] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:57.842180 12021 raft_consensus.cc:2889] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.760557 17607 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.809911 17661 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.789377 17604 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:11:57.842710 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101955us
I20260709 12:11:57.847425 12019 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 12:11:57.837054 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.850769 11986 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.828341 17572 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:57.836375 17630 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:57.870798 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.838992 17363 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:57.855360 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:57.854279 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.839035 17545 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:57.827148 17478 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.843461 17508 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.893834 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:57.900863 12019 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:57.845471 17340 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:57.853020 17153 consensus_meta.cc:287] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.001s
I20260709 12:11:57.841104 17553 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.844669 17546 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.870121 17667 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.975860 12015 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:57.894855 17363 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:57.850526 17562 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:57.938972 17663 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:57.939708 17662 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.943583 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:57.945447 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 74933.3us
W20260709 12:11:57.950577 17629 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.003s	user 0.010s	sys 0.056s
W20260709 12:11:57.959440 17643 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.573s	user 0.004s	sys 0.000s
I20260709 12:11:57.894393 17561 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.961887 17623 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:57.913267 17153 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.898695 17545 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:57.963142 17547 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:57.963323 17563 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.019343 17563 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:57.963711 17593 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:57.965757 17553 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:57.892022 17624 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.893777 17660 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:57.938405 17625 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:57.987613 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:57.995312 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:57.976322 17551 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:57.995035 12604 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:57.853657 17661 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.005851 17546 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:58.006946 17659 log.cc:927] Time spent T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:57.985634 17559 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:11:58.008788 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2321) took 1046 ms. Trace:
I20260709 12:11:57.975967 17579 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:58.011023 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.903405 17583 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:11:57.975448 17667 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:57.907675 17564 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:11:57.907977 17576 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
W20260709 12:11:58.011982 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 110309us
I20260709 12:11:57.987287 17329 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:11:58.031803 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.034849 12014 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.009213 17562 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.038058 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.047436 17546 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.048000 17625 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.015874 17662 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.138583 11939 rpcz_store.cc:276] 0709 12:11:56.961977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.962120 (+   143us) service_pool.cc:224] Handling call
0709 12:11:56.990189 (+ 28069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.995024 (+  4835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.995057 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.042587 (+ 47530us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.123260 (+ 80673us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:57.123330 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.123450 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.952774 (+829324us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:58.008469 (+ 55695us) raft_consensus.cc:1685] finished
0709 12:11:58.008492 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.008718 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35776,"raft.queue_time_us":13051,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":148439808,"thread_start_us":75281,"threads_started":1,"wal-append.queue_time_us":157024}
I20260709 12:11:58.154731 17562 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.091284 17363 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.157666 11945 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:58.050643 17551 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.162271 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:58.175812 17551 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.181986 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.183439 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.184170 11943 raft_consensus.cc:2410] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:58.184682 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.186838 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:11:58.190722 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 158995us
I20260709 12:11:58.191592 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.194104 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.194252 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.036787 17563 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:58.195212 11947 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:58.088944 17661 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.204026 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.206723 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:58.096324 17153 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.087046 17545 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:58.209082 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45128.9us
I20260709 12:11:58.165067 17562 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.141848 17667 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.206775 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.031199 17624 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.189813 17596 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:58.204043 17508 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:58.103879 17340 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.220717 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.157655 17546 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.035369 17660 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.173630 17625 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.209131 17663 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.210882 17478 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.231974 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:58.233592 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.221570 17596 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.234542 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.217132 17578 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.249598 17578 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.235167 11944 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:11:58.256364 17624 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.238785 17673 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.239764 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39778 (request call id 730) took 1348 ms. Trace:
I20260709 12:11:58.258170 17673 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:11:58.258230 11871 rpcz_store.cc:276] 0709 12:11:56.891034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.891155 (+   121us) service_pool.cc:224] Handling call
0709 12:11:58.239525 (+1348370us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b54001a7a54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:58.239654 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15189760}
I20260709 12:11:58.239842 11942 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:58.263547 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:58.245550 12017 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:58.245077 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.245970 17444 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:58.247133 17676 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:58.237082 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.245460 17594 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:58.267035 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:58.268685 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.258746 17673 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.270571 17662 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.271152 12016 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:58.269425 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:58.214936 17591 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.294730 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.300544 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:58.301409 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.233400 17508 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:58.237371 17596 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:58.237509 17592 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.302524 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:58.291337 17565 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:58.312325 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.313383 11869 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.314056 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.314640 11871 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:11:58.317651 11870 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:58.308068 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.319383 11870 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:58.319518 11867 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:11:58.290486 17578 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:58.320834 11865 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:58.321117 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.321390 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.322275 11868 raft_consensus.cc:2410] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:11:58.322979 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.323115 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.323637 11867 raft_consensus.cc:2376] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16. Re-sending same reply.
I20260709 12:11:58.323887 11871 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:58.325004 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.310132 17595 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.291038 17660 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.330325 12017 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:58.330163 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.326910 11871 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:58.325907 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.325295 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.333261 11945 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:58.333308 11867 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:58.328804 12021 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:58.334591 12021 pending_rounds.cc:85] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 6
I20260709 12:11:58.334677 11948 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.334884 12021 pending_rounds.cc:107] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:58.335018 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.335165 12021 raft_consensus.cc:2889] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.299211 17563 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.337215 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:58.339016 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.339879 11865 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:11:58.309461 17588 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:58.351768 17588 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.352402 17588 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.326632 17578 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.354926 17578 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.326579 17592 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.291514 17478 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:58.345063 17666 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.357321 17666 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.357810 17666 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.346782 17340 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.262727 17663 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.347656 17579 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.349339 17591 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.350965 17546 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.320518 17601 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.354463 17625 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:11:58.342702 17636 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.980s	user 0.004s	sys 0.000s
W20260709 12:11:58.362211 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 99018.9us
I20260709 12:11:58.363193 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.365324 12021 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:11:58.372807 11912 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:58.374465 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.373023 17568 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.367784 17601 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.378297 17601 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.361665 17593 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.366084 17562 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:58.379346 11865 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:58.383771 11867 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:11:58.386170 11867 pending_rounds.cc:85] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:11:58.386538 11867 pending_rounds.cc:107] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:58.386973 11867 raft_consensus.cc:2889] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.390815 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.392025 11864 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:58.394335 11872 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:58.387450 11867 pending_rounds.cc:107] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:58.396495 11867 raft_consensus.cc:2889] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.378341 17563 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.407315 17563 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.388000 17562 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.410022 17562 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.410120 17565 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.410923 17565 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.413178 11873 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:58.415984 11866 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:58.409801 17681 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.387231 17592 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.432075 17153 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.443392 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.425204 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:58.442238 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.445338 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.445854 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.446166 11866 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.448769 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.450071 11867 raft_consensus.cc:2410] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:58.451736 17538 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.452215 17538 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.452581 17538 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:58.463742 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.389973 17593 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.457751 17329 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:58.446463 17630 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.001s
I20260709 12:11:58.478396 17478 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.484859 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.488288 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.468417 17586 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.482427 17478 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.445276 17673 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.520951 17586 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.459857 17153 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.523963 17663 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.538399 11866 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:58.529311 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.488633 17563 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.477710 17588 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:58.524711 17687 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:11:58.477159 17680 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:58.546124 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.518949 17607 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.550230 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.518622 17676 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.556617 17676 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.557600 17673 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.557711 17588 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.558581 11865 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:58.558943 17676 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.560824 17607 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.561898 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.562592 11866 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:11:58.563495 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.563684 11943 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:11:58.564077 11866 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:11:58.553738 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.484516 17630 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.555224 11945 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:58.566747 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.567488 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.568518 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.569000 11866 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:11:58.568912 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:58.570494 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.571110 11942 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:58.571956 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.574441 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.579988 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.586784 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.587838 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.584787 17586 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.590248 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.599551 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:58.600699 11942 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.578145 17340 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:11:58.611058 17153 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.584846 17630 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.593945 17588 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.616235 17588 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.618598 17588 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.603180 17563 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.625308 17563 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.627562 17563 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.631130 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.631845 17563 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.635232 17672 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:58.631134 17607 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:58.635514 17563 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.639348 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.640281 11868 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:58.635721 17672 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:58.641448 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.643955 11868 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:11:58.645124 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:58.646562 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.647290 11868 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:58.628400 17679 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.630448 17595 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.628579 17153 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:58.662593 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.665059 11942 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:11:58.617422 17578 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.669994 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:58.671340 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 141509us
I20260709 12:11:58.672916 11873 raft_consensus.cc:2410] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:58.674762 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.675860 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.681682 11942 raft_consensus.cc:2368] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:11:58.675133 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:58.685598 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 81216.3us
I20260709 12:11:58.686932 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:58.686069 12019 raft_consensus.cc:2393] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 20: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:11:58.714370 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.740381 17672 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:58.754076 12021 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.663762 17444 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:58.662046 17679 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.660531 17588 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.751547 11867 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:58.755821 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:58.756269 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.755414 12022 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:58.781251 12019 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:58.668254 17593 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.781697 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.782505 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.783264 12022 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
W20260709 12:11:58.775950 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.778676 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:58.773506 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:58.752334 17670 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.755s	user 0.006s	sys 0.003s
I20260709 12:11:58.764834 17680 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.668385 17153 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.786604 11942 raft_consensus.cc:2410] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:11:58.784267 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:58.670109 17538 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.838893 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.832530 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:11:58.753434 17690 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:58.874519 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:11:58.875367 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.778149 17595 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.832000 17646 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:58.880986 12019 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:58.783411 17444 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.784965 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:58.831377 17545 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.832131 17625 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.844305 12608 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:11:58.899467 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:11:58.830596 17672 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:58.906796 11868 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:58.907420 11868 pending_rounds.cc:85] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 7
I20260709 12:11:58.907717 11868 pending_rounds.cc:107] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:58.908090 11868 raft_consensus.cc:2889] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.912329 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.913048 12019 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:58.838454 17680 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.916039 12021 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:11:58.918577 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.919368 12021 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:11:58.920511 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:58.919162 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:58.836796 17660 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 12:11:58.922868 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 90181.3us
W20260709 12:11:58.911034 17666 consensus_meta.cc:287] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.004s
I20260709 12:11:58.879616 17478 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:58.836535 17607 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:11:58.823159 17588 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:58.842027 17586 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:11:58.882212 17591 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:58.937341 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:58.910110 17625 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:58.836735 17618 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:11:58.947173 11869 raft_consensus.cc:1275] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:58.880327 17568 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:11:58.948421 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.922485 17676 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:58.933676 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 261802us
I20260709 12:11:59.013137 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.010216 12018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3102) took 1210 ms. Trace:
I20260709 12:11:58.929195 17546 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.000432 11868 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:11:58.932693 17662 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.936645 17563 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:59.017438 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69185.5us
I20260709 12:11:59.131222 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.131393 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.132572 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:58.921717 17595 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.015008 12018 rpcz_store.cc:276] 0709 12:11:57.799945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.801646 (+  1701us) service_pool.cc:224] Handling call
0709 12:11:57.813062 (+ 11416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.813595 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.813638 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.822732 (+  9094us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.989443 (+166711us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:57.989487 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.989597 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.740764 (+751167us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:58.950464 (+209700us) raft_consensus.cc:1685] finished
0709 12:11:58.950499 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.010110 (+ 59611us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3725,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":14480,"spinlock_wait_cycles":3024768,"thread_start_us":136670,"threads_started":1,"wal-append.queue_time_us":159292}
I20260709 12:11:59.022010 17478 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:59.138055 17704 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.028997 17703 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.031790 17565 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:59.034935 17669 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.959s	user 0.002s	sys 0.000s
I20260709 12:11:59.036711 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3104) took 1215 ms. Trace:
I20260709 12:11:59.079700 17701 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.139736 12015 rpcz_store.cc:276] 0709 12:11:57.821042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.821233 (+   191us) service_pool.cc:224] Handling call
0709 12:11:57.835328 (+ 14095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.976480 (+141152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.036359 (+1059879us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000aad54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.036631 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319372672}
I20260709 12:11:59.140427 17701 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.039932 17588 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.142792 17701 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.917681 17545 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.047621 12022 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:58.953428 17625 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.144635 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:59.145370 12016 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:11:59.145951 17679 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:59.146212 17699 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:11:58.949517 17578 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:59.055385 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 125924us
W20260709 12:11:59.058883 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.019145 17601 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.001s
I20260709 12:11:59.148567 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:59.148849 17601 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:59.135959 17562 consensus_meta.cc:287] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.725s	user 0.018s	sys 0.002s
I20260709 12:11:59.149991 17562 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.151059 17601 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:11:59.020406 17692 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:11:59.152180 17562 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:11:59.152884 17695 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:11:58.936730 17666 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.041450 17538 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:58.943864 17696 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:11:59.154217 17704 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.154803 17666 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.155910 11941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1147) took 2178 ms. Trace:
I20260709 12:11:59.156524 17704 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.157063 11865 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:59.156314 11941 rpcz_store.cc:276] 0709 12:11:56.977761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.977916 (+   155us) service_pool.cc:224] Handling call
0709 12:11:56.978275 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.986203 (+  7928us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:11:58.377839 (+1391636us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b180047c500. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1f42b3c7 00007f1f1ba3d9a7 00007f1f1ba4d0bf 00007f1f1ba4d038
0709 12:11:58.450280 (+ 72441us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.657759 (+207479us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.662777 (+  5018us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.662948 (+   171us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:58.662987 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.663073 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.155580 (+492507us) raft_consensus.cc:1685] finished
0709 12:11:59.155679 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.155822 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28545,"prepare.queue_time_us":909585,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":23032,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":11618,"spinlock_wait_cycles":55328128,"thread_start_us":230791,"threads_started":3,"wal-append.queue_time_us":178706}
I20260709 12:11:59.158980 17662 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:59.160077 17662 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.131583 17579 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.156561 17625 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.162401 17579 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.164419 17579 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.027659 17680 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.164419 17625 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.165244 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:59.136390 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:59.170413 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 157362us
I20260709 12:11:59.054980 17546 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.172011 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:59.135416 17667 consensus_meta.cc:287] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.009s
I20260709 12:11:59.182484 11864 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:11:59.183382 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:11:59.165298 17680 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.166682 17624 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.154251 17153 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.171201 17565 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.191839 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.196341 12016 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.180030 17701 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.178423 17703 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:59.191502 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 54202.2us
I20260709 12:11:59.180757 17705 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.209014 17705 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.204536 17624 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:11:59.212132 17624 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.213776 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.215785 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:59.216295 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.217264 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.202795 17565 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.218238 17618 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:59.219601 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.221673 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.222117 17563 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.222980 17563 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:59.223250 17668 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 1.138s	user 0.005s	sys 0.001s
I20260709 12:11:59.223403 17563 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.223850 17563 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.224359 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:59.224642 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3099) took 1426 ms. Trace:
I20260709 12:11:59.225085 17710 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:59.225749 17710 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:59.225059 12020 rpcz_store.cc:276] 0709 12:11:57.798771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.800213 (+  1442us) service_pool.cc:224] Handling call
0709 12:11:57.800660 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.805961 (+  5301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.806015 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.806742 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.895403 (+ 88661us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:57.895466 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.895570 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.222600 (+1327030us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:59.224271 (+  1671us) raft_consensus.cc:1685] finished
0709 12:11:59.224293 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.224571 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4669,"raft.queue_time_us":7029,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6288,"spinlock_wait_cycles":28129536,"thread_start_us":69754,"threads_started":1,"wal-append.queue_time_us":216733}
I20260709 12:11:59.227329 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:59.227046 17710 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.228412 17710 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.228457 17153 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:59.205055 17596 consensus_meta.cc:287] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.001s
I20260709 12:11:59.230657 17596 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.233073 17596 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.233732 11870 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:59.234115 17545 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.217875 17546 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.234753 17595 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.221773 17601 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.234596 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:59.186504 17667 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.236294 17601 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.236829 17601 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:59.209455 17705 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.237922 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.238801 11941 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.237838 17601 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.190742 17709 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:59.240727 12017 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.241070 17709 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.241514 17709 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.241511 11839 leader_election.cc:400] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:11:59.206409 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.243790 11839 leader_election.cc:403] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:59.230118 11986 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:59.247339 12016 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:59.191380 17680 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.254839 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.197018 17562 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.257676 12017 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:59.199244 17696 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.267877 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.237596 17565 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.237704 17667 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.274395 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.227063 17698 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:59.253942 17595 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
W20260709 12:11:59.280829 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56547.9us
I20260709 12:11:59.275604 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.254038 17704 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.268725 17680 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.272907 17703 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:59.269318 17564 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.272655 17696 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.280871 17546 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:59.290067 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.294829 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.285409 17704 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.336396 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.338312 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.285326 17698 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:11:59.288005 17703 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.297850 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:11:59.288900 17667 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.347620 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:11:59.354130 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56407.7us
I20260709 12:11:59.355346 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.360440 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.291530 17696 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.362862 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.293159 17546 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.349005 17478 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.345305 17545 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.299155 17562 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.377408 17625 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.390655 17625 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.391104 17625 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.334641 17662 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:11:59.406294 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.412040 17563 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.291756 17564 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.377507 17712 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.377636 17701 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.418834 17604 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:59.419224 17662 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:59.419481 17604 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:11:59.419687 17662 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:59.420621 17662 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.355643 17698 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.422554 17709 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.386421 17546 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.353318 17703 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.359323 17153 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.353525 17667 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.353605 17660 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:59.420522 17604 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.346506 17704 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.379415 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:59.439141 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59839.1us
I20260709 12:11:59.429494 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.440799 11873 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:11:59.440006 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.443169 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.430943 11866 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.430059 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2325) took 1396 ms. Trace:
I20260709 12:11:59.444288 11948 rpcz_store.cc:276] 0709 12:11:58.141220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.156253 (+ 15033us) service_pool.cc:224] Handling call
0709 12:11:58.156729 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.335115 (+178386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.429789 (+1094674us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540010fc54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.429992 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398994688}
I20260709 12:11:59.448361 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.450182 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.434016 11941 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:11:59.459522 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.389171 17595 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.460952 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.425524 17662 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:59.466315 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.439656 17478 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.438280 17667 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.480896 11873 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:59.481298 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:59.481482 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:59.478433 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.485317 12020 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:59.486522 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:11:59.480015 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.482168 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.458559 17565 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.466661 17153 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.460811 17596 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.513783 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.518263 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.466964 17660 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.457944 17712 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.479446 17666 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.541713 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.553619 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.554287 12016 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.554704 12020 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:59.549176 12015 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:11:59.515482 17490 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.520686 17709 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.563498 12016 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:11:59.579670 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.581141 17711 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.581702 17711 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.582063 17711 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.511863 17478 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.585747 17478 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.586416 12021 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:59.548794 17596 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.588457 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.587678 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.591341 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.592075 11871 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:59.593088 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.580089 17624 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.590668 17596 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.551973 17708 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.593911 12020 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
I20260709 12:11:59.512219 17696 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.551048 17712 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.596820 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.604110 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1187) took 1754 ms. Trace:
I20260709 12:11:59.604591 12013 rpcz_store.cc:276] 0709 12:11:57.850065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.850812 (+   747us) service_pool.cc:224] Handling call
0709 12:11:57.870240 (+ 19428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.259386 (+389146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.259421 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.259476 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.259508 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.603840 (+1344332us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400046ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.603898 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.604044 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894432640}
I20260709 12:11:59.586874 17490 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.606132 17545 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.607326 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.555074 17660 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.609712 11945 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.610852 17706 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:59.611902 17722 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:59.614099 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3100) took 1815 ms. Trace:
I20260709 12:11:59.649645 12014 rpcz_store.cc:276] 0709 12:11:57.799188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.799367 (+   179us) service_pool.cc:224] Handling call
0709 12:11:57.799843 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.140885 (+341042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.613798 (+1472913us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400028854. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.614029 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539911936}
I20260709 12:11:59.617914 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.650812 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:59.651019 11948 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.600693 17563 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.653105 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.656941 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:11:59.618413 17721 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:59.618415 17708 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.602842 11871 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:11:59.661739 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.619374 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3068) took 1113 ms. Trace:
I20260709 12:11:59.663229 11866 rpcz_store.cc:276] 0709 12:11:58.506466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.569831 (+ 63365us) service_pool.cc:224] Handling call
0709 12:11:59.430659 (+860828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.443976 (+ 13317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.619145 (+175169us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540006a9d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:59.619305 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979007360}
I20260709 12:11:59.619735 17624 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.621037 17701 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:59.521860 17705 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.623421 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.630128 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2343) took 1267 ms. Trace:
I20260709 12:11:59.629284 17711 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.549700 17153 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.639051 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.633369 17712 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.639942 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.685331 11873 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:11:59.640388 17725 consensus_queue.cc:1048] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:11:59.640518 17545 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.643507 17490 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:11:59.692096 17624 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.646576 11945 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:11:59.693388 17693 log.cc:927] Time spent T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.175s	user 0.005s	sys 0.000s
I20260709 12:11:59.693580 11945 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.694659 11945 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.694877 17660 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.694975 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3057) took 1299 ms. Trace:
I20260709 12:11:59.695477 11872 rpcz_store.cc:276] 0709 12:11:58.395560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.396047 (+   487us) service_pool.cc:224] Handling call
0709 12:11:58.426708 (+ 30661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.427524 (+   816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.427574 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.444386 (+ 16812us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.517276 (+ 72890us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:58.517342 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.517475 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.641474 (+1123999us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:11:59.694603 (+ 53129us) raft_consensus.cc:1685] finished
0709 12:11:59.694629 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.694898 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247,"raft.queue_time_us":1034,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7365,"spinlock_wait_cycles":3918592,"thread_start_us":33730,"threads_started":1,"wal-append.queue_time_us":48335}
I20260709 12:11:59.696727 17700 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.699431 17680 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:11:59.702020 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.703612 11945 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:59.704973 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.680403 11944 rpcz_store.cc:276] 0709 12:11:58.363109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.363234 (+   125us) service_pool.cc:224] Handling call
0709 12:11:58.364871 (+  1637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.518764 (+153893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.518803 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.519383 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.629165 (+109782us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:58.629208 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.629641 (+1000433us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000a0fd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.629697 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.629766 (+    69us) raft_consensus.cc:1685] finished
0709 12:11:59.629782 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.630039 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42759,"raft.queue_time_us":31459,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":8299,"spinlock_wait_cycles":289682304,"thread_start_us":109415,"threads_started":1,"wal-append.queue_time_us":141060}
I20260709 12:11:59.657994 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:59.654803 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:59.633155 17478 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:11:59.712297 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 57580.3us
I20260709 12:11:59.715083 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 2162) took 1153 ms. Trace:
I20260709 12:11:59.715564 11945 rpcz_store.cc:276] 0709 12:11:58.552479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.568601 (+ 16122us) service_pool.cc:224] Handling call
0709 12:11:59.609578 (+1040977us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b540004c2a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b9aadc0 00007f1f1ba36e18 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.705833 (+ 96255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20344192}
I20260709 12:11:59.679476 12022 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.608937 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3070) took 1042 ms. Trace:
I20260709 12:11:59.722965 11865 rpcz_store.cc:276] 0709 12:11:58.566866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.590319 (+ 23453us) service_pool.cc:224] Handling call
0709 12:11:58.605032 (+ 14713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.158460 (+553428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.608540 (+450080us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002d9e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.608867 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268909312}
I20260709 12:11:59.680891 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.680984 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.724880 11871 raft_consensus.cc:2376] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16. Re-sending same reply.
I20260709 12:11:59.691497 17545 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.660753 17578 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.746359 17578 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.746482 17705 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.746819 17578 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.750082 17478 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.754041 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:11:59.754468 17727 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:59.755549 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.756757 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.758348 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.759740 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.760957 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.762753 17625 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.767102 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 3079) took 1118 ms. Trace:
I20260709 12:11:59.767601 11864 rpcz_store.cc:276] 0709 12:11:58.648915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.778347 (+129432us) service_pool.cc:224] Handling call
0709 12:11:59.766877 (+988530us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54003043d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:11:59.767020 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710280448}
I20260709 12:11:59.769040 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.710765 12019 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.654433 17666 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.658896 17706 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:59.676482 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.716115 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.726017 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.730544 17624 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.778211 11872 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.778589 17624 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.780107 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 744) took 1142 ms. Trace:
W20260709 12:11:59.733615 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.729892 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.774168 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.782052 11871 raft_consensus.cc:2376] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13. Re-sending same reply.
I20260709 12:11:59.783145 17706 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.783666 17592 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.735673 17660 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.784550 11944 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.780480 11868 rpcz_store.cc:276] 0709 12:11:58.638025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.915702 (+277677us) service_pool.cc:224] Handling call
0709 12:11:58.916146 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.018850 (+102704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.779832 (+760982us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54001a7a54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.780040 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192585088}
I20260709 12:11:59.734042 11948 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:59.736362 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.736130 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.785883 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.786330 11864 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:11:59.786567 11868 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:11:59.736728 17642 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.737391 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.789728 11945 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.790148 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.791033 11873 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:59.710294 17700 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:59.741653 17153 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.796895 17563 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:59.797263 17700 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.797914 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.798578 12609 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:59.799430 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.799816 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.800117 12607 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:11:59.800150 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:11:59.609368 17698 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.743687 17708 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.745671 11866 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:11:59.779170 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3063) took 1363 ms. Trace:
I20260709 12:11:59.765362 17625 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:11:59.772599 17704 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:11:59.713639 17616 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:11:59.824971 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1156) took 1594 ms. Trace:
I20260709 12:11:59.783070 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.841944 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 753) took 1182 ms. Trace:
I20260709 12:11:59.783053 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.734992 11943 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:11:59.794478 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 750) took 1154 ms. Trace:
I20260709 12:11:59.795065 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.840384 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:11:59.801304 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.847913 11865 rpcz_store.cc:276] 0709 12:11:58.640561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.786051 (+1145490us) service_pool.cc:224] Handling call
0709 12:11:59.793924 (+  7873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.794119 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.794154 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.794200 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:59.794242 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.794300 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.794415 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:59.827555 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.849157 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.789479 17660 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.852361 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.807832 11945 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:59.809451 12022 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:11:59.812794 12019 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:11:59.753279 17478 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.780795 17712 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.816289 11867 rpcz_store.cc:276] 0709 12:11:58.415872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.459159 (+ 43287us) service_pool.cc:224] Handling call
0709 12:11:58.481317 (+ 22158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.780371 (+299054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.778895 (+998524us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002f6554. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.779095 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596654464}
I20260709 12:11:59.800863 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:59.855775 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.858989 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.859622 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:11:59.860314 11939 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.860045 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.830441 11872 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:59.820947 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 752) took 1179 ms. Trace:
I20260709 12:11:59.847159 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.789294 17642 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:11:59.819711 17563 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:11:59.802276 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:11:59.862577 11948 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:11:59.848959 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:11:59.847726 11871 raft_consensus.cc:1813] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:59.863409 11866 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:11:59.863745 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.846882 11873 rpcz_store.cc:276] 0709 12:11:58.659943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.802092 (+1142149us) service_pool.cc:224] Handling call
0709 12:11:59.840993 (+ 38901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.841298 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.841344 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.841418 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:59.841483 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.841668 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.841855 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:59.784745 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 126800us
I20260709 12:11:59.815369 17588 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.827490 17595 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.865926 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:11:59.863328 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.876842 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:11:59.864053 11868 rpcz_store.cc:276] 0709 12:11:58.643178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.787220 (+1144042us) service_pool.cc:224] Handling call
0709 12:11:59.820239 (+ 33019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.820443 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.820472 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.820520 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:59.820570 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.820648 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.820805 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:59.867264 11871 raft_consensus.cc:2410] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:59.845835 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 243694us
W20260709 12:11:59.872025 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 69847.7us
I20260709 12:11:59.872273 12021 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:11:59.855324 11946 rpcz_store.cc:276] 0709 12:11:58.230276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.230439 (+   163us) service_pool.cc:224] Handling call
0709 12:11:58.230924 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.379210 (+148286us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:58.387845 (+  8635us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.479164 (+ 91319us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.479376 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.479430 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.479473 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.559318 (+ 79845us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180037fea0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:58.559990 (+   672us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b180037fea0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:58.560889 (+   899us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b180037fea0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:11:59.824615 (+1263726us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400425254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:11:59.824686 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.824887 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88921,"prepare.queue_time_us":11478,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":49135,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":22237,"spinlock_wait_cycles":375257856,"thread_start_us":47634,"threads_started":1,"wal-append.queue_time_us":48118,"wal-append.run_cpu_time_us":2715,"wal-append.run_wall_time_us":1105183}
I20260709 12:11:59.862473 11865 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.880125 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.802279 17666 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.856789 17660 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.892033 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:11:59.998207 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:59.860025 17625 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:11:59.999428 12607 raft_consensus.cc:2368] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:11:59.859694 17705 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:11:59.985659 11873 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.930132 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.881556 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:11:59.992897 11939 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:11:59.793326 17572 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.873523 17624 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.011886 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3081) took 1271 ms. Trace:
I20260709 12:12:00.019879 11873 rpcz_store.cc:276] 0709 12:11:58.740619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.864714 (+1124095us) service_pool.cc:224] Handling call
0709 12:11:59.985428 (+120714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.011441 (+ 26013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.011756 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:59.856591 17546 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.012636 11939 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:00.028436 11948 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.882431 17595 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.871357 17478 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.880822 17709 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.801364 17592 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.858793 17605 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 12:11:59.931746 17701 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.926798 17708 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.024814 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.880997 17564 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.025514 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:11:59.930440 17583 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:00.094568 17674 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.094775 17583 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.095443 17674 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:11:59.859011 17710 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 12:11:59.860357 17626 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
I20260709 12:12:00.030588 11943 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:59.863507 17563 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.034241 17572 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.114454 11945 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:00.042703 17595 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.036670 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:11:59.865036 17681 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:12:00.009895 17568 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:00.052779 12017 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.017120 17625 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.075449 12013 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.035214 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.010125 17679 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:12:00.036897 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1154) took 1807 ms. Trace:
I20260709 12:11:59.882042 17588 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.064728 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:00.047175 17680 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.045338 17709 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.129993 12605 raft_consensus.cc:2368] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.023715 17705 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.139559 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 751) took 1498 ms. Trace:
I20260709 12:12:00.024853 17667 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.051460 17478 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:11:59.998634 17642 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.147753 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.179754 12020 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:00.132355 11947 rpcz_store.cc:276] 0709 12:11:58.229639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.238389 (+  8750us) service_pool.cc:224] Handling call
0709 12:11:58.238867 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.359362 (+120495us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:58.367680 (+  8318us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.618217 (+1250537us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b180040e1c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d323a 00007f1f1ba3da2a
0709 12:11:59.819508 (+201291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.819572 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:59.819628 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.036563 (+216935us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002e59d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:00.036645 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.036817 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8175,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":98,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":27179,"spinlock_wait_cycles":278694528,"thread_start_us":200964,"threads_started":1,"wal-append.queue_time_us":1728606}
I20260709 12:12:00.150859 11986 leader_election.cc:400] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.180770 11986 leader_election.cc:403] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:12:00.152666 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 409360us
I20260709 12:12:00.185811 17624 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.155560 11866 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:00.157205 11864 rpcz_store.cc:276] 0709 12:11:58.641420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.787083 (+1145663us) service_pool.cc:224] Handling call
0709 12:11:59.787418 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.020544 (+233126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.020580 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.020627 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:00.020661 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.139267 (+118606us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54002d8f54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:00.139322 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.139482 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535599488}
I20260709 12:12:00.190474 11864 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:12:00.214361 12013 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:00.196801 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.218119 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:00.054312 17596 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.241644 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.247238 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.249732 11943 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:00.175716 17662 consensus_meta.cc:287] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.693s	user 0.026s	sys 0.000s
I20260709 12:12:00.220371 17624 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:12:00.254932 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.156844 17709 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.098143 17708 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.250990 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.271363 12015 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:00.225178 11944 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:00.274323 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.214035 17601 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.143726 17568 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.219288 17674 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.242846 17711 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.274135 17583 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.274005 17508 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.287521 17704 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.314345 11941 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8.
W20260709 12:12:00.299908 17714 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.940s	user 0.004s	sys 0.000s
I20260709 12:12:00.287750 17698 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.329627 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:00.340416 17444 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:11:59.330789 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.309684 17153 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.299613 17601 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:12:00.355257 11769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 126) took 14085 ms (client timeout 15000 ms). Trace:
I20260709 12:12:00.319347 17711 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.318511 17712 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:00.360399 17565 consensus_meta.cc:287] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
I20260709 12:12:00.356122 17666 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.329687 17508 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:00.386775 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.389556 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:00.390587 11945 raft_consensus.cc:2368] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.392570 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:00.369720 17546 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.396116 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1163) took 1262 ms. Trace:
I20260709 12:12:00.401588 17666 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:00.397431 11942 rpcz_store.cc:276] 0709 12:11:59.133459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.133589 (+   130us) service_pool.cc:224] Handling call
0709 12:11:59.133920 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.157195 (+ 23275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.157228 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.157878 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.258685 (+100807us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:59.258745 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.258823 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.030519 (+771696us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:12:00.384936 (+354417us) raft_consensus.cc:1685] finished
0709 12:12:00.384971 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.396025 (+ 11054us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25100,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":9051392,"thread_start_us":100407,"threads_started":1,"wal-append.queue_time_us":129335}
W20260709 12:12:00.366900 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 490090us
I20260709 12:12:00.408924 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.377761 12015 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 7. Current term is 8. Ops: []
W20260709 12:12:00.366073 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.418270 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.380656 17565 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:00.367339 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 334224us
I20260709 12:12:00.424701 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:00.373327 17711 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.433753 17708 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.434238 17625 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.435447 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:00.356640 11769 rpcz_store.cc:269] 0709 12:11:46.259832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.260001 (+   169us) service_pool.cc:224] Handling call
0709 12:12:00.345480 (+14085479us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:54.858567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:54.859320 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:54.859363 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:11:54.859383 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:54.860450 (+  1067us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.860521 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.860553 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:11:54.861331 (+   778us) tablet.cc:701] Row locks acquired
0709 12:11:54.861347 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:11:54.865378 (+  4031us) write_op.cc:270] Start()
0709 12:11:54.884684 (+ 19306us) write_op.cc:276] Timestamp: P: 1783599114861470 usec, L: 0
0709 12:11:54.888976 (+  4292us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.960962 (+ 71986us) log.cc:844] Serialized 3281 byte log entry
0709 12:11:55.614358 (+653396us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.798897 (+184539us) write_op.cc:301] APPLY: starting
0709 12:11:55.812433 (+ 13536us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:56.249452 (+437019us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:56.263890 (+ 14438us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:56.768616 (+504726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:56.768901 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:11:56.768958 (+    57us) write_op.cc:312] APPLY: finished
0709 12:11:56.811648 (+ 42690us) log.cc:844] Serialized 81 byte log entry
0709 12:11:56.928545 (+116897us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:56.961637 (+ 33092us) write_op.cc:454] Released schema lock
0709 12:11:56.982022 (+ 20385us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:57.015857 (+ 33835us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.015913 (+    56us) write_op.cc:454] Released schema lock
0709 12:11:57.380375 (+364462us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18003ed700. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
Metrics: {"mutex_wait_us":210,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":164610,"apply.run_cpu_time_us":35812,"apply.run_wall_time_us":1211716,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":340134,"prepare.run_cpu_time_us":220554,"prepare.run_wall_time_us":489025,"raft.queue_time_us":118694,"raft.run_cpu_time_us":24634,"raft.run_wall_time_us":111499,"replication_time_us":722242,"spinlock_wait_cycles":50905472,"thread_start_us":964380,"threads_started":5,"wal-append.queue_time_us":660451,"wal-append.run_cpu_time_us":46444,"wal-append.run_wall_time_us":2514738}]]}
I20260709 12:12:00.404201 17592 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.450160 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:00.471457 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.479614 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:00.482841 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:00.485095 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:00.435596 17601 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.478911 11837 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.492252 11837 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.494335 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:00.443142 17705 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.415774 17666 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.498553 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.444389 17708 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.475689 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:00.448591 17667 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.465631 17565 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.490909 17478 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.496317 17679 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:00.499642 17594 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.496838 17592 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:00.491221 17596 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.477911 17575 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:12:00.536163 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60592.1us
I20260709 12:12:00.536923 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.583458 12015 raft_consensus.cc:2393] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:00.537178 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.531316 17605 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.530568 17674 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.536670 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.594744 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:00.541085 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:00.496110 17583 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:12:00.604005 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.603828 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.605995 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.607957 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.556993 17656 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:12:00.614286 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:00.599121 17706 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.001s
I20260709 12:12:00.539390 17444 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:00.550231 17594 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.549013 17679 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.539284 17568 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.562028 17478 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.551544 17592 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:00.606841 17739 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.628727 17656 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.598819 17565 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:00.539822 17708 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.628818 17711 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.630887 17594 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.630689 17596 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.610497 17674 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.606278 17605 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.630441 17575 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:00.622515 17742 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:00.631984 17679 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:00.649498 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 452759us
I20260709 12:12:00.635949 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:00.641804 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 47215.3us
I20260709 12:12:00.635998 17592 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.616786 17595 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.627419 17706 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.641434 17656 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:00.646332 17444 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:00.655645 17711 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.723587 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.685698 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:00.725826 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.644363 17737 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.754741 12015 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.666850 17575 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:00.764868 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.765573 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:00.640210 17478 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.763376 11867 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:00.763084 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:00.717732 17742 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:00.774382 17660 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.744s	user 0.017s	sys 0.000s
I20260709 12:12:00.716537 17596 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:00.654162 17565 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.749610 17666 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.768923 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:00.798381 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:00.642684 17739 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.762594 17667 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.779780 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:00.789077 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3088) took 1530 ms. Trace:
I20260709 12:12:00.770398 12015 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:00.772665 17624 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.719282 17626 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:12:00.829660 12015 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:00.781363 17705 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.678364 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:00.691766 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:00.803421 11988 leader_election.cc:400] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.832269 11988 leader_election.cc:403] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:12:00.832088 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 140462us
I20260709 12:12:00.802978 11871 rpcz_store.cc:276] 0709 12:11:59.259063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.928918 (+669855us) service_pool.cc:224] Handling call
0709 12:11:59.929269 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.929522 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:00.420839 (+491317us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.788526 (+367687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.788615 (+    89us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.788692 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.788798 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.788995 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":698234,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":770373,"threads_started":2}
I20260709 12:12:00.809237 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:00.821130 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.834239 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:00.778023 17750 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.836310 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:00.837009 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:00.850773 17743 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.851284 17743 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.851694 17743 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.851718 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:00.857858 17626 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.859211 17739 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.859866 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:00.860896 17706 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.861282 17583 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.810789 17596 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:00.863669 17596 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.865922 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:00.866896 17478 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.809482 17712 raft_consensus.cc:476] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:00.868216 17708 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.868140 17545 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.870811 17545 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.871333 17545 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.871968 17565 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:00.872253 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.865075 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:00.873490 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.874225 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3090) took 1613 ms. Trace:
I20260709 12:12:00.874639 11868 rpcz_store.cc:276] 0709 12:11:59.260843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.995475 (+734632us) service_pool.cc:224] Handling call
0709 12:12:00.019458 (+ 23983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.340568 (+321110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.340601 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.341263 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.774763 (+433500us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.793205 (+ 18442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.793307 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.874019 (+ 80712us) raft_consensus.cc:1685] finished
0709 12:12:00.874042 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.874163 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":350199,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5570,"thread_start_us":730319,"threads_started":2,"wal-append.queue_time_us":530784}
I20260709 12:12:00.876611 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:00.877049 17578 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.130s	user 0.014s	sys 0.000s
I20260709 12:12:00.874254 12014 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:00.878648 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:00.879734 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.880518 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.810113 17700 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:00.842842 11871 raft_consensus.cc:2393] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:12:00.881946 17703 consensus_meta.cc:287] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 1.436s	user 0.009s	sys 0.006s
I20260709 12:12:00.882247 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:00.792510 17660 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:00.844451 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1168) took 1706 ms. Trace:
W20260709 12:12:00.845252 17749 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:00.883582 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:00.883829 12018 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.829708 17546 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.843360 12015 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.875043 17605 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.884351 17546 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.884815 17660 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:00.884981 17546 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.885332 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:00.848732 17746 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.882422 17703 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.840276 17601 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:00.886159 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:00.880856 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:00.877305 11868 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 7.
I20260709 12:12:00.894431 17624 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.895140 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.895550 12015 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:00.895993 17626 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:00.900918 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2355) took 1096 ms. Trace:
I20260709 12:12:00.942796 11947 rpcz_store.cc:276] 0709 12:11:59.804621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.219164 (+414543us) service_pool.cc:224] Handling call
0709 12:12:00.232941 (+ 13777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.315398 (+ 82457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.315447 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.315511 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:00.315558 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.900532 (+584974us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b5400241154. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:00.900611 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.900829 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189006592}
I20260709 12:12:00.929066 12014 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:00.903785 17757 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.907864 17546 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.909965 17705 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:00.885491 17660 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:00.883275 11939 rpcz_store.cc:276] 0709 12:11:59.138348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.028326 (+889978us) service_pool.cc:224] Handling call
0709 12:12:00.028761 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:00.044204 (+ 15443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.044262 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:00.052908 (+  8646us) log.cc:844] Serialized 52 byte log entry
0709 12:12:00.467417 (+414509us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.801383 (+333966us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.804825 (+  3442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.804931 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.844145 (+ 39214us) raft_consensus.cc:1685] finished
0709 12:12:00.844176 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.844361 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5095,"prepare.queue_time_us":404263,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":69206,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":20193,"thread_start_us":607658,"threads_started":2,"wal-append.queue_time_us":615077}
I20260709 12:12:00.907553 17545 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.911044 17750 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:00.941416 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46366.7us
I20260709 12:12:00.984606 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.841933 17674 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:00.874261 17583 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.831399 17666 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:00.888264 17625 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15.
I20260709 12:12:00.991071 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:00.829427 17667 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.008553 12015 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:01.013157 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:00.889572 17578 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.011059 11768 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 7 to 13, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 13 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.021278 11768 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 13 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.983304 17563 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.027599 11768 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 17, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.006397 17700 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:00.966447 17710 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:00.990837 17624 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.032722 12016 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:01.041908 11873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.020s	sys 0.018s
W20260709 12:12:01.042285 11873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.020s	sys 0.018s
W20260709 12:12:01.042977 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 275921us
I20260709 12:12:01.007484 17746 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:01.044742 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:01.031073 17572 consensus_meta.cc:287] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.903s	user 0.015s	sys 0.000s
I20260709 12:12:01.021083 17666 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:01.030392 11768 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.036437 11870 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.037431 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:00.983662 17705 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:00.972313 17757 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.059806 11940 raft_consensus.cc:2410] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:01.026355 17756 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.061239 11868 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:01.033951 17700 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:01.066562 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.067122 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 754) took 2396 ms. Trace:
I20260709 12:12:01.059896 17764 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.084836 11865 rpcz_store.cc:276] 0709 12:11:58.670966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.848962 (+1177996us) service_pool.cc:224] Handling call
0709 12:11:59.862277 (+ 13315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.879996 (+ 17719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.066837 (+1186841us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54000942d0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:01.067042 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29856000}
I20260709 12:12:01.086373 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.087855 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.088676 11865 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:01.069140 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.091089 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.036170 17711 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:01.031138 17762 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.061903 17746 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:01.083648 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.055464 17738 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.053000 17696 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.075486 12016 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:01.055405 17565 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.063038 11768 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 16, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.096912 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:00.962291 17444 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.039692 17563 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.116647 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:01.090566 17663 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.119334 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:01.101344 17754 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:01.121156 17546 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.122990 17757 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.123978 17746 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.125020 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:01.148976 11868 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.127087 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3082) took 2303 ms. Trace:
I20260709 12:12:01.149999 11867 rpcz_store.cc:276] 0709 12:11:58.823648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.869981 (+1046333us) service_pool.cc:224] Handling call
0709 12:11:59.870407 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.774008 (+903601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.126812 (+352804us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400294ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:01.127020 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052932480}
I20260709 12:12:01.126775 17666 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.127990 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.204658 17704 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.205183 17704 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:01.206171 17704 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.207634 17704 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.128834 11939 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.128895 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.233172 11945 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 13: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:01.129503 17545 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.233780 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3119) took 1328 ms. Trace:
W20260709 12:12:01.129980 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 61005.8us
I20260709 12:12:01.234225 12021 rpcz_store.cc:276] 0709 12:11:59.905960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.906193 (+   233us) service_pool.cc:224] Handling call
0709 12:11:59.906726 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.650271 (+743545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.650314 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.650867 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.045456 (+394589us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:01.045507 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.230617 (+185110us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000465d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:01.230672 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.233437 (+  2765us) raft_consensus.cc:1685] finished
0709 12:12:01.233463 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.233709 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108012,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":5259,"spinlock_wait_cycles":806462336,"thread_start_us":717628,"threads_started":2,"wal-append.queue_time_us":468919}
I20260709 12:12:01.235689 11912 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.236573 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:01.236979 11912 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.237069 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.130705 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:01.130949 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:01.131531 17568 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:01.133010 17709 consensus_meta.cc:287] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.844s	user 0.013s	sys 0.001s
I20260709 12:12:01.127841 17593 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:01.134642 11865 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:01.136339 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.140955 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:01.108016 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:01.135433 11768 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:01.143761 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:01.165711 17703 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.170128 17742 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.174322 17667 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:01.175294 17768 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:12:01.176431 17578 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.119163 17625 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.177191 17711 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.099004 17764 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.180588 17705 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.181121 17750 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.104986 17762 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.182709 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.144582 17708 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.144894 17663 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.188377 17746 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.190070 17700 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.191843 17508 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.196818 17563 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.210263 17679 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:01.211191 11986 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.68:39553 timed out after 1.510s (SENT) [suppressed 13 similar messages]
I20260709 12:12:01.213953 17743 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.215111 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:01.215539 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.193519 17588 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.212787 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3116) took 1343 ms. Trace:
I20260709 12:12:01.219158 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3080) took 2551 ms. Trace:
I20260709 12:12:01.223083 17642 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:01.223860 12019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58674 (request call id 1204) took 2009 ms (client timeout 2197 ms). Trace:
I20260709 12:12:01.225127 12015 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:01.225521 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:01.201356 11941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 2178) took 1916 ms (client timeout 2105 ms). Trace:
I20260709 12:12:01.229722 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3086) took 1972 ms. Trace:
I20260709 12:12:01.237389 12021 raft_consensus.cc:2393] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:01.306388 11872 rpcz_store.cc:276] 0709 12:11:59.257644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.881431 (+623787us) service_pool.cc:224] Handling call
0709 12:12:00.004101 (+122670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.656878 (+652777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.656913 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.687433 (+ 30520us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.045040 (+357607us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:01.045097 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.229187 (+184090us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001a7f54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:01.229264 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.229328 (+    64us) raft_consensus.cc:1685] finished
0709 12:12:01.229344 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.229647 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175322,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":509430016,"thread_start_us":703424,"threads_started":2,"wal-append.queue_time_us":383754}
I20260709 12:12:01.308676 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:01.309175 17663 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.308837 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.309396 12013 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:01.239379 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:01.310581 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:01.327203 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 190984us
I20260709 12:12:01.327303 11872 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:01.328208 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.329566 17774 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.329993 11872 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:01.330909 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3095) took 2032 ms. Trace:
W20260709 12:12:01.311079 11941 rpcz_store.cc:269] 0709 12:11:59.285257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.756487 (+471230us) service_pool.cc:224] Handling call
0709 12:12:01.201120 (+1444633us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540013ddd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:01.201270 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179011456}
I20260709 12:12:01.283763 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:01.312915 12019 rpcz_store.cc:269] 0709 12:11:59.214283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.221357 (+  7074us) service_pool.cc:224] Handling call
0709 12:12:01.223651 (+2002294us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400298bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:01.223790 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122992000}
I20260709 12:12:01.294721 17738 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.313961 11873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3091) took 2049 ms. Trace:
I20260709 12:12:01.266085 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:01.314626 17679 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.239678 17572 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:01.247570 17594 consensus_meta.cc:287] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.005s
W20260709 12:12:01.282493 17732 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 1.008s	user 0.002s	sys 0.000s
I20260709 12:12:01.315472 17703 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:01.315611 11867 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:01.316188 12015 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
W20260709 12:12:01.316780 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 105813us
W20260709 12:12:01.239229 17772 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 12:12:01.233796 17656 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.318933 17625 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.270157 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1170) took 2130 ms. Trace:
I20260709 12:12:01.392419 11948 rpcz_store.cc:276] 0709 12:11:59.139760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.029564 (+889804us) service_pool.cc:224] Handling call
0709 12:12:00.372109 (+342545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.372388 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.372419 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.372482 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.372529 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.372607 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.269359 (+896752us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400241650. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba328ad 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:01.270048 (+   689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717193088}
I20260709 12:12:01.285236 17595 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:01.238796 17758 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.278s	user 0.001s	sys 0.002s
W20260709 12:12:01.320022 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 83120.1us
I20260709 12:12:01.320814 17744 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.267638 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:01.275511 11940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49986 (request call id 2337) took 3062 ms (client timeout 1549 ms). Trace:
W20260709 12:12:01.404666 11940 rpcz_store.cc:269] 0709 12:11:58.212996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.213747 (+   751us) service_pool.cc:224] Handling call
0709 12:12:01.275122 (+3061375us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54002b4b54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:01.275357 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6526973312}
I20260709 12:12:01.264835 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:01.259199 17770 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 12:12:01.312641 17708 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.323137 17762 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.312551 12017 rpcz_store.cc:276] 0709 12:11:59.869730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.871109 (+  1379us) service_pool.cc:224] Handling call
0709 12:11:59.986182 (+115073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.127175 (+140993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.212523 (+1085348us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b540015ca54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:01.212721 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152506624}
I20260709 12:12:01.323477 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 762) took 2049 ms. Trace:
I20260709 12:12:01.414819 11865 rpcz_store.cc:276] 0709 12:11:59.273942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.322607 (+2048665us) service_pool.cc:224] Handling call
0709 12:12:01.322943 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.323137 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.323167 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.323212 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.323248 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.323317 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.323419 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.307459 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:01.307416 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.418048 12021 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:01.312678 17764 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:01.310845 12013 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.324697 17709 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.271245 17575 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.326488 17593 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:01.326758 17592 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.006s
W20260709 12:12:01.239028 17771 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:12:01.312325 12016 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:01.422156 17592 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.328811 17701 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.311849 11870 rpcz_store.cc:276] 0709 12:11:58.667667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.820886 (+1153219us) service_pool.cc:224] Handling call
0709 12:11:59.821283 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.060702 (+1239419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.218849 (+158147us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002d00d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:01.219083 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793996672}
W20260709 12:12:01.425879 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 193565us
I20260709 12:12:01.333254 12022 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:01.312999 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 205081us
I20260709 12:12:01.427207 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.345763 12609 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.310901 11768 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 10 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.427912 11943 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.331444 11872 rpcz_store.cc:276] 0709 12:11:59.298334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.329297 (+2030963us) service_pool.cc:224] Handling call
0709 12:12:01.329729 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.330541 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.330830 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.351909 12020 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:01.344349 11868 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:01.351612 11873 rpcz_store.cc:276] 0709 12:11:59.264624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.020911 (+756287us) service_pool.cc:224] Handling call
0709 12:12:00.048036 (+ 27125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.497528 (+449492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.497589 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.498116 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.042680 (+544564us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:01.042725 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.042804 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.313741 (+270937us) raft_consensus.cc:1685] finished
0709 12:12:01.313774 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.313895 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":334805,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7476,"thread_start_us":951078,"threads_started":2,"wal-append.queue_time_us":572397}
I20260709 12:12:01.331395 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.428980 11768 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 16, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 16 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:12:01.430135 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 98804.6us
I20260709 12:12:01.430490 11768 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.322600 17743 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.359997 17738 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.364356 17703 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.356472 17508 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.351125 17774 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.395875 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3096) took 2095 ms. Trace:
I20260709 12:12:01.406288 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:01.399871 17625 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.426961 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:01.446056 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:01.457623 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.439065 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.462430 11867 rpcz_store.cc:276] 0709 12:11:59.300182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.363313 (+2063131us) service_pool.cc:224] Handling call
0709 12:12:01.395235 (+ 31922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.395476 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.395518 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.395578 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:01.395624 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.395680 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.395806 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.439482 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:01.464775 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 58619.1us
I20260709 12:12:01.403818 17656 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.447072 17764 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.472925 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.440704 11768 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 14, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 14 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.508226 11768 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 12, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 12 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.511495 11768 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
W20260709 12:12:01.470330 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.482568 17742 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:01.482671 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.484123 17592 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.466279 17701 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.504197 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:01.519115 17701 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.519646 11939 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:12:01.519529 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46750.3us
W20260709 12:12:01.504870 17732 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:12:01.520615 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:01.521358 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 746) took 2882 ms. Trace:
I20260709 12:12:01.521515 17596 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:01.522478 17596 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.523108 17596 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.523536 17596 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.524909 17737 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:01.531464 17701 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.532837 17625 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.533461 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.471683 17705 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:01.536139 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:01.536901 11947 raft_consensus.cc:606] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.537355 11947 raft_consensus.cc:614] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:01.537806 17545 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.502059 17774 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.538409 17545 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.539486 17625 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:01.540369 17774 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.541910 17700 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.490536 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:01.542793 17545 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:01.514282 11940 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:01.447981 17595 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.543560 17595 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.544094 17595 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.446409 17762 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.545020 17679 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.545913 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:01.545603 17762 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.546880 11872 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:01.548197 17762 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.518255 17742 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:01.414855 17708 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.549618 17742 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.521812 11869 rpcz_store.cc:276] 0709 12:11:58.638760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.955228 (+316468us) service_pool.cc:224] Handling call
0709 12:11:58.955647 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.620994 (+665347us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b180042a6c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba2bbfb 00007f1f1ba3664b
0709 12:11:59.621169 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.621201 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.621826 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.804539 (+182713us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:59.848423 (+ 43884us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.848730 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.848810 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.924587 (+1075777us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180042a6c0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:12:01.281647 (+357060us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:12:01.521109 (+239462us) raft_consensus.cc:1685] finished
0709 12:12:01.521134 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.521291 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100626,"prepare.queue_time_us":50767,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":218533,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":13704,"spinlock_wait_cycles":30528640,"thread_start_us":350132,"threads_started":2,"wal-append.queue_time_us":521437}
I20260709 12:12:01.549283 17738 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.502442 17508 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.554396 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:01.555259 11869 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:01.555902 17738 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.556241 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.556468 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3093) took 2290 ms. Trace:
I20260709 12:12:01.485626 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 761) took 2212 ms. Trace:
I20260709 12:12:01.557032 11866 rpcz_store.cc:276] 0709 12:11:59.266410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.188534 (+922124us) service_pool.cc:224] Handling call
0709 12:12:00.188884 (+   350us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:00.539921 (+351037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.539951 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:00.648252 (+108301us) log.cc:844] Serialized 78 byte log entry
0709 12:12:00.946841 (+298589us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:01.018693 (+ 71852us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.018971 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.019053 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.203802 (+184749us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b4800080058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2095caa1 00007f1f20953b37 00007f1f209539ca 00007f1f20a4b26f 00007f1f20a4af37 00007f1f20a5f55c 00007f1f20a5f508 00007f1f20a5f488 00007f1f20a5f443 00007f1f20a5e6ec 00007f1f1f988a96
0709 12:12:01.288613 (+ 84811us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18003f6160. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18946522 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:12:01.556179 (+267566us) raft_consensus.cc:1685] finished
0709 12:12:01.556203 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.556397 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117408,"prepare.queue_time_us":72184,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4404,"raft.queue_time_us":213966,"raft.run_cpu_time_us":2833,"raft.run_wall_time_us":180196,"spinlock_wait_cycles":23995520,"thread_start_us":550503,"threads_started":2,"wal-append.queue_time_us":412526}
I20260709 12:12:01.557888 11864 rpcz_store.cc:276] 0709 12:11:59.273633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.191330 (+917697us) service_pool.cc:224] Handling call
0709 12:12:00.191638 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.192059 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.192103 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.220555 (+ 28452us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.667936 (+447381us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.667995 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.668091 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.485305 (+817214us) raft_consensus.cc:1685] finished
0709 12:12:01.485335 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.485506 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208915,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":368386,"threads_started":1,"wal-append.queue_time_us":503486}
I20260709 12:12:01.560065 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:01.490401 17783 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:12:01.489569 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:01.560894 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.434118 17750 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.561913 17750 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.564759 17750 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.545650 17679 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.467505 17703 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:01.363296 17594 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.505160 17667 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:01.513700 11768 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 12 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.585736 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:01.585973 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.586500 11864 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.584461 11768 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 13, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 13 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.588337 11768 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.541625 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.548132 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:01.570775 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.591624 11872 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.591710 11869 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:12:01.593083 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:01.595126 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:01.605278 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.573679 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.471441 17744 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.536685 17705 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.576725 12609 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:01.579056 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.590390 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:01.636272 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 62753.2us
I20260709 12:12:01.638413 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.639319 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.641038 11768 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.555961 17508 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.643604 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:01.647138 11768 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 15 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:01.648025 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.652359 11768 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.656234 11872 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:01.584757 17750 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.667857 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:01.668617 11941 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:01.669061 11941 raft_consensus.cc:614] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:01.581107 17594 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.650843 17545 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.649510 17624 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.659080 17546 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.624140 17667 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.688287 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3098) took 2279 ms. Trace:
I20260709 12:12:01.668335 17744 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.658854 17625 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:01.693464 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3101) took 2171 ms. Trace:
I20260709 12:12:01.708330 11867 rpcz_store.cc:276] 0709 12:11:59.522427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.678122 (+2155695us) service_pool.cc:224] Handling call
0709 12:12:01.692879 (+ 14757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.693110 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.693141 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.693187 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.693218 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.693271 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.693398 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.709434 11864 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:01.710460 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2298) took 2082 ms. Trace:
I20260709 12:12:01.711185 11864 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:01.712109 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3104) took 1883 ms. Trace:
W20260709 12:12:01.696179 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 269349us
I20260709 12:12:01.714434 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:01.706809 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58844.6us
W20260709 12:12:01.715303 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.716204 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.718173 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.719465 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.713466 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3097) took 2356 ms. Trace:
I20260709 12:12:01.720647 17593 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.656037 11768 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 8 to 11, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 11 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.722100 17545 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.685644 17757 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.720811 11865 rpcz_store.cc:276] 0709 12:11:59.356860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.416084 (+2059224us) service_pool.cc:224] Handling call
0709 12:12:01.416563 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.416812 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:01.417185 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.713089 (+295904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.713151 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:01.713201 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.713281 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.713402 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1824,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2645,"raft.queue_time_us":300,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":295075,"threads_started":1}
I20260709 12:12:01.673488 17750 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.710878 11867 rpcz_store.cc:276] 0709 12:11:59.628051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.709464 (+2081413us) service_pool.cc:224] Handling call
0709 12:12:01.709916 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.710114 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.710139 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.710186 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:01.710218 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.710289 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.710400 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.689548 17546 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.722980 17744 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.734198 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:01.742702 12603 raft_consensus.cc:606] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:01.722975 17624 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.738718 11867 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.746188 17624 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:01.747884 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2306) took 1277 ms. Trace:
I20260709 12:12:01.747910 17624 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:01.697304 11870 rpcz_store.cc:276] 0709 12:11:59.409258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.425652 (+2016394us) service_pool.cc:224] Handling call
0709 12:12:01.426164 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.426453 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:01.483384 (+ 56931us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.687883 (+204499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.687946 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:01.687997 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.688071 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.688219 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65119,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":6622,"thread_start_us":199049,"threads_started":1}
I20260709 12:12:01.746693 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:01.741132 17744 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.749349 11943 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:01.750064 11943 raft_consensus.cc:614] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:01.726580 11768 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.752005 11768 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:01.748332 11867 rpcz_store.cc:276] 0709 12:12:00.470443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.738049 (+1267606us) service_pool.cc:224] Handling call
0709 12:12:01.738497 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.747567 (+  9070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.747813 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:01.758366 17704 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.550s	user 0.015s	sys 0.000s
I20260709 12:12:01.755425 17593 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:01.766891 11943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:01.759759 17705 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:01.779165 12014 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:01.776364 11768 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 7 to 11, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:01.792994 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.796236 11867 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.764139 17743 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.750857 17757 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:01.805675 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.729214 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2299) took 1260 ms. Trace:
I20260709 12:12:01.810990 11865 rpcz_store.cc:276] 0709 12:12:00.468357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.728018 (+1259661us) service_pool.cc:224] Handling call
0709 12:12:01.728662 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.728875 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.728901 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.728950 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.728980 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.729038 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.729149 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.720395 11864 rpcz_store.cc:276] 0709 12:11:59.829067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.710516 (+1881449us) service_pool.cc:224] Handling call
0709 12:12:01.710830 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.711854 (+  1024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.712051 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:01.823452 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 179053us
I20260709 12:12:01.807235 17679 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:01.832885 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 118560us
I20260709 12:12:01.818681 17790 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.807431 17743 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:01.835952 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 116587us
I20260709 12:12:01.828542 17642 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.807636 17708 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.839330 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:01.818907 17703 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.832842 17700 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.853312 17546 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.853371 17595 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.855545 17703 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:01.855808 17786 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:12:01.856331 17595 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.857997 17700 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.841296 17667 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:01.849202 17709 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.860976 17667 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:01.862403 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:01.861452 17667 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:01.870354 17667 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:01.875675 17624 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:01.876267 17624 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:01.878481 17750 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.880293 17667 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.880553 17757 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.842084 17642 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.884016 17642 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.886994 17667 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.890581 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:01.891906 17575 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:01.896497 17791 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:12:01.898012 17789 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:12:01.898130 17708 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.861256 17700 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:01.900034 17797 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.892961 17596 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.911643 17743 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:01.877353 17624 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:01.914628 17624 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.916061 17596 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:01.919409 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 83985.8us
I20260709 12:12:01.927300 17804 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:01.928826 17805 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:01.929961 17805 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:01.926666 17790 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:01.929708 17797 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:01.932111 17790 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.932312 17805 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.934465 17805 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.934403 17797 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:01.975569 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2290) took 2496 ms. Trace:
I20260709 12:12:01.976856 11866 rpcz_store.cc:276] 0709 12:11:59.478602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.640984 (+2162382us) service_pool.cc:224] Handling call
0709 12:12:01.641377 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.641848 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.641886 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.658613 (+ 16727us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.810541 (+151928us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.973227 (+162686us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.974170 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.974382 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.974561 (+   179us) raft_consensus.cc:1685] finished
0709 12:12:01.974611 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.975099 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2970,"prepare.queue_time_us":74936,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":106,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13239,"thread_start_us":271758,"threads_started":2,"wal-append.queue_time_us":177796}
I20260709 12:12:01.981752 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 764) took 1514 ms. Trace:
I20260709 12:12:01.981968 11869 raft_consensus.cc:1240] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.982574 11868 rpcz_store.cc:276] 0709 12:12:00.467578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.711818 (+1244240us) service_pool.cc:224] Handling call
0709 12:12:01.712150 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.712534 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.712562 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.713153 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.815935 (+102782us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:01.817239 (+  1304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.819771 (+  2532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.980976 (+161205us) raft_consensus.cc:1685] finished
0709 12:12:01.981036 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.981432 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":265,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":102344,"threads_started":1,"wal-append.queue_time_us":130325}
I20260709 12:12:01.987475 11942 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:12:01.989440 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 126948us
W20260709 12:12:01.990633 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.009732 11943 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:02.013347 11943 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:02.014914 11871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36526 (request call id 2301) took 1545 ms (client timeout 1752 ms). Trace:
I20260709 12:12:02.029203 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50002 (request call id 2184) took 1355 ms. Trace:
I20260709 12:12:02.041175 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:02.017371 11871 rpcz_store.cc:269] 0709 12:12:00.468949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.883338 (+414389us) service_pool.cc:224] Handling call
0709 12:12:02.014191 (+1130853us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54002954d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:02.014528 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593372032}
I20260709 12:12:02.033175 11942 rpcz_store.cc:276] 0709 12:12:00.673963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.677965 (+  4002us) service_pool.cc:224] Handling call
0709 12:12:02.028713 (+1350748us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400425c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:02.029058 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2655150848}
I20260709 12:12:02.042853 17568 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.047582 17568 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.048545 17578 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.049733 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:02.050151 17588 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.051139 12605 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:02.051333 17572 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.052151 17572 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.053565 17667 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.051059 17588 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.015005 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:02.042104 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.059757 12606 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:02.041198 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.059999 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.061971 17797 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:02.063934 17588 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.049477 17578 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.021395 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:02.068477 17578 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.055598 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3100) took 2624 ms. Trace:
I20260709 12:12:02.070894 11869 rpcz_store.cc:276] 0709 12:11:59.431530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.638431 (+2206901us) service_pool.cc:224] Handling call
0709 12:12:01.639066 (+   635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.982918 (+343852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.032757 (+ 49839us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400355cd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:02.055539 (+ 22782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786645888}
I20260709 12:12:02.076116 17709 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:02.076946 17709 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:02.077569 17709 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.078183 17667 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.060217 12606 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:02.079145 17787 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 12:12:02.083882 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69289.4us
I20260709 12:12:02.083984 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:01.977514 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:02.094924 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74104.8us
I20260709 12:12:02.098815 17807 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:02.099498 17807 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:02.104004 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:02.104828 17572 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.108821 17658 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.109339 17658 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:02.109917 17658 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:02.114876 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.115561 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:02.116780 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3108) took 1142 ms. Trace:
I20260709 12:12:02.116997 17572 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:02.117709 17572 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.104903 17568 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.105896 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:02.119069 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 142031us
I20260709 12:12:02.087544 17578 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.084020 12606 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.117393 11870 rpcz_store.cc:276] 0709 12:12:00.973869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.753776 (+779907us) service_pool.cc:224] Handling call
0709 12:12:01.754146 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.754546 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:01.983898 (+229352us) log.cc:844] Serialized 14 byte log entry
0709 12:12:02.102199 (+118301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:02.116069 (+ 13870us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:02.116184 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.116332 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.116568 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130712,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":11894,"thread_start_us":323249,"threads_started":2}
I20260709 12:12:02.128123 12606 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.125644 17588 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:02.119315 17572 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:02.140983 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:02.158839 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55912.6us
I20260709 12:12:02.161141 17588 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:02.182940 12604 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
W20260709 12:12:02.185699 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.185962 11988 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:02.187099 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.191138 17592 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.192131 17592 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.201792 17703 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.202824 17703 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.203274 11914 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:02.205349 17656 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:02.207058 17594 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:02.207345 17679 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.207744 17594 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:02.207875 17679 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:02.209322 17679 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.215677 17679 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:02.220000 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46518.4us
W20260709 12:12:02.223147 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 51713.1us
I20260709 12:12:02.211656 17757 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:02.255074 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 66830.6us
I20260709 12:12:02.171346 17568 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:12:02.200817 17578 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.184954 17807 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.274150 17546 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.274928 17546 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:02.276234 17546 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.265218 17703 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:02.209353 17594 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:02.287954 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.295274 12606 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:02.297915 11837 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:02.298368 17807 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.299521 17563 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.299980 17563 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.300448 17563 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.268127 17757 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:02.281502 17667 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.309669 17592 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.324476 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2292) took 2741 ms. Trace:
W20260709 12:12:02.310072 17797 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:12:02.334940 17709 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.336570 17593 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.337154 17593 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:02.338434 17593 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.339582 17578 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.340163 17593 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:02.351895 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51781.8us
I20260709 12:12:02.324898 11872 rpcz_store.cc:276] 0709 12:11:59.479158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.657243 (+2178085us) service_pool.cc:224] Handling call
0709 12:12:01.660404 (+  3161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.661671 (+  1267us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:01.674086 (+ 12415us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.885078 (+210992us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b180042a660. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:12:02.016739 (+131661us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b180042a660. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f18928e07 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b 00007f1f1b5d2d23 00007f1f1b5d323a 00007f1f1ba3da2a
0709 12:12:02.173295 (+156556us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.206559 (+ 33264us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.206825 (+   266us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:02.206878 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.206997 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.216682 (+  9685us) raft_consensus.cc:1685] finished
0709 12:12:02.216706 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.220808 (+  4102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1500,"prepare.queue_time_us":12582,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":5249,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":17997,"spinlock_wait_cycles":32758400,"thread_start_us":131869,"threads_started":1,"wal-append.queue_time_us":513170}
I20260709 12:12:02.367045 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.374293 17757 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.376170 17709 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.324244 17588 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:02.382701 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51915.2us
I20260709 12:12:02.386363 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:02.388790 17667 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.393908 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.396188 11872 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:12:02.407192 17820 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:02.407874 17578 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.409104 17578 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:02.414935 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 50616.3us
I20260709 12:12:02.417400 17744 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:02.417990 17798 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.418744 17798 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.423236 17798 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.461987 17798 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.464422 17798 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:02.498822 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.501660 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.505023 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.518807 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.494880 17572 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.538116 17572 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:02.542069 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 64221.6us
W20260709 12:12:02.548236 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 267853us
I20260709 12:12:02.552177 17578 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:02.565291 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.590893 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:02.595240 17575 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.595438 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:02.596154 17575 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.592916 17578 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.563524 17703 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.600896 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:02.595263 17823 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.606730 17750 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.607532 17750 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:02.613714 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.614719 17578 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.615403 17703 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.615741 17575 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.617726 17703 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:02.618432 17743 consensus_queue.cc:1059] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.618462 17592 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.619597 17743 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:02.619530 17823 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.620169 17743 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:02.614771 11939 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
W20260709 12:12:02.623214 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 143400us
I20260709 12:12:02.624718 17743 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.626159 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:02.626423 17743 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:02.628041 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.629036 17546 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.629812 17546 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.630983 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:02.631742 11948 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:02.631832 17823 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.632053 17546 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:02.632508 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:02.599629 17658 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.638057 11939 raft_consensus.cc:2410] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:02.638723 11942 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:02.632620 17546 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.617336 17578 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.617368 17750 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.647276 12013 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:02.648075 17750 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.648944 17750 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:02.647161 11948 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:02.646039 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.649773 17750 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.621348 17563 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.653623 11943 raft_consensus.cc:1240] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.639348 17823 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.656229 17823 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.656836 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:02.655615 17824 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:12:02.638839 17703 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.655629 17563 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.666982 17679 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.667691 17679 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.671095 17827 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.671789 17827 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.673993 17563 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.674716 17563 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.676815 17757 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.677134 17563 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.677840 17823 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.680662 11872 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:12:02.682963 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.683604 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.683936 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:02.684511 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:02.685730 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.673233 17798 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.686530 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:02.697561 17625 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:02.697852 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.698194 11870 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:02.698671 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.698791 17679 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.699609 11868 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:02.700990 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.701294 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:02.698395 17625 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.704214 17804 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.694932 17546 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.707087 17546 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:02.704734 17625 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:02.708752 17807 raft_consensus.cc:993] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:02.708400 17703 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.709293 17807 raft_consensus.cc:1081] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:02.699472 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.710829 11873 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:02.713346 12017 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:02.714637 17703 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.718271 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.675253 17827 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.718571 12020 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:12:02.721896 12609 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:02.728020 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.731746 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.733448 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.737221 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.738129 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.738956 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.737725 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.750025 12013 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.694092 17588 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.749423 11837 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:02.756013 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.757014 11872 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.761183 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.761771 17837 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:02.762481 17837 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:02.762619 11871 raft_consensus.cc:2393] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:02.678543 17757 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.777882 11869 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:02.778092 12017 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:02.763594 17837 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.754012 17588 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.792820 11873 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:02.795025 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.795125 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.766462 17625 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.785326 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.805938 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.806360 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.807327 11870 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
W20260709 12:12:02.807847 17829 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:12:02.805393 11871 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:02.795835 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.818799 11866 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:02.817274 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.824796 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.828541 12020 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:02.829845 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.831379 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.832198 12020 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.833031 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:02.833308 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 63385.8us
I20260709 12:12:02.836920 17787 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:02.839031 17757 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:02.839401 17835 log.cc:927] Time spent T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:02.829907 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:02.846297 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.850733 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.820488 17546 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.852550 17546 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.857934 11870 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.863296 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.864069 12021 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:02.864975 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.798434 17625 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:02.829380 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:02.865593 12021 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:02.884639 11868 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.845768 17658 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:02.848271 17563 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.882368 12018 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:12:02.889756 17798 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.891446 17546 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.895198 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.906008 12020 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.895871 11869 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:02.899556 12017 raft_consensus.cc:2393] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.904460 11872 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:02.910349 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.910538 17798 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.911736 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.912534 12018 raft_consensus.cc:2393] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 13: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.913879 17798 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.914194 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.914407 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.915041 12017 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.922878 12020 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:02.926182 12013 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.848059 17679 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:12:02.927677 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.879822 17578 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:02.913371 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.935181 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.935595 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.939167 17578 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.941825 12018 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.951046 12015 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:12:02.934155 11986 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Timed out: RequestConsensusVote RPC to 127.10.114.68:39553 timed out after 1.510s (SENT)
I20260709 12:12:02.965448 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:02.976595 11871 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
I20260709 12:12:02.934429 17703 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.978796 12021 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 8: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:02.980554 12017 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:02.978857 12020 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:12:02.979190 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:02.983469 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:02.984475 11872 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:02.991230 12016 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.982707 12015 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
W20260709 12:12:02.993664 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 164423us
I20260709 12:12:02.934883 17679 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:02.998956 12018 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
W20260709 12:12:03.004781 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.010452 17679 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:02.989022 17625 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.011969 12021 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:03.013144 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.014377 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.016273 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:03.019022 11866 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.020102 12020 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:03.000932 12018 pending_rounds.cc:85] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 9
I20260709 12:12:02.967658 17563 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.021629 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:03.024616 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 118797us
I20260709 12:12:03.028554 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:03.039762 12609 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:03.040170 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.046041 11870 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:03.047914 11873 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:03.027135 17852 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:03.050464 17852 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.022652 12018 pending_rounds.cc:107] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:03.053128 12018 raft_consensus.cc:2889] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:03.053452 17703 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.981824 17804 consensus_queue.cc:1059] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:12:03.054718 17703 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.055205 17703 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:03.055342 17804 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.055910 17804 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:03.056478 17703 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.039805 17563 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.026286 17578 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.064759 17743 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:03.068886 17804 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.070372 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.071334 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:03.071672 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:03.072026 11866 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:03.072378 12017 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:03.073168 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:03.073776 11868 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:03.075536 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:03.077234 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.077958 12018 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:03.078120 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:03.078851 11865 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:12:03.083546 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.085105 17703 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.088101 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:03.089581 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.090216 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.091205 12021 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:03.021509 17750 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:03.093685 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.094259 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.097265 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:03.105692 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.106784 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.112162 11868 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:03.112593 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.115903 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:03.123699 12017 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:03.126243 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:03.125599 12015 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:03.128822 12021 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:03.115886 17679 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.148744 17625 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.147486 17757 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.142781 17743 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.155894 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:03.166929 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51202.8us
I20260709 12:12:03.159754 17592 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:03.175631 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.189851 12014 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:03.166989 17625 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.151170 17594 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.180151 17588 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.223109 17588 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.223773 17588 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:03.225646 11986 leader_election.cc:336] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Timed out: RequestConsensusVote RPC to 127.10.114.68:39553 timed out after 1.533s (SENT)
I20260709 12:12:03.228602 17826 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:12:03.169342 17568 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.230026 17658 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.230751 17658 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.230629 17568 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.231952 17658 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.235359 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.156482 17679 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.233239 17568 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.255230 17799 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:03.190768 17804 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.189996 17642 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.237609 17625 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.174626 17757 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.266283 17851 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:03.237385 17743 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.272547 17851 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.274415 17743 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.274772 17852 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.274971 17851 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.250744 17594 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:03.280727 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.283583 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 132133us
I20260709 12:12:03.285223 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:03.180611 17592 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.265090 17799 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:03.252626 17827 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:03.288367 17658 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.291770 17799 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.308507 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.276000 17642 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.295658 17798 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:03.312734 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 43754.2us
W20260709 12:12:03.318382 17848 log.cc:927] Time spent T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:12:03.324294 12609 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:03.300647 17667 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.331909 17757 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.325261 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.302613 17743 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.333336 17743 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.334507 17743 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.336043 17743 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.304098 17588 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.340461 17568 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:03.341835 17568 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.342301 17568 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.343225 17594 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.343767 17568 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.345873 17679 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:03.357204 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.362049 17642 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.363265 17798 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.365314 17568 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.375243 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.386946 17757 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:03.387746 17757 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.388239 17757 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.398263 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:03.404490 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.341344 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:03.377005 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.423060 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.430176 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.429306 17679 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:03.449828 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.449219 17679 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.451164 17578 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.451351 17679 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.451762 17578 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.422827 17667 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.455615 17667 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:03.456125 17578 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.456205 17667 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.425063 17588 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:12:03.474151 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.477134 17592 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.490015 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.490963 12604 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
W20260709 12:12:03.486968 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 54410.9us
I20260709 12:12:03.421764 17852 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:03.494774 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:03.498999 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 157772us
I20260709 12:12:03.497643 12016 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:03.522073 12605 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:03.503326 17578 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.526732 17578 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.527249 17578 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.551203 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.551741 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 124717us
W20260709 12:12:03.579146 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.597154 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44136.2us
I20260709 12:12:03.523638 17703 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:12:03.550675 17798 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:03.608706 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.530563 17852 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.640079 17852 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:03.621170 17861 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.261s	user 0.002s	sys 0.001s
W20260709 12:12:03.604573 17860 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:03.623485 17798 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.624503 17625 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.626953 17799 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.634153 17588 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:03.641294 17868 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.646029 17798 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.655990 17868 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.662271 17799 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.663825 17868 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.664577 17868 consensus_queue.cc:1059] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:03.656133 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 51125.2us
W20260709 12:12:03.642195 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 331130us
I20260709 12:12:03.666476 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.668188 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.669157 17594 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.669720 17594 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.670061 17594 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.673105 11872 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:03.673772 17757 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.676225 17757 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.644188 17750 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.537237 17568 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:12:03.680998 17568 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.681509 17568 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.683669 17568 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.659389 17798 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.652734 17588 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.686848 17588 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.689347 17588 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.655201 17625 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.601883 17851 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:03.659950 17679 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.690313 17851 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.692410 17679 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:03.686223 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.681768 17823 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.693235 17851 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.694088 17823 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.694057 17568 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.695392 17823 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.696473 17823 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:03.694181 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.697978 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:03.698225 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.698937 11943 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:03.700062 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.701066 17743 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:03.645408 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.702786 17679 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.703264 17679 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.703549 12605 raft_consensus.cc:1240] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:03.703652 17679 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.707074 17827 consensus_queue.cc:1059] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:03.708791 17592 raft_consensus.cc:3055] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.709259 17592 raft_consensus.cc:740] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.710563 17592 consensus_queue.cc:260] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.712141 17592 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.715984 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.716347 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.718111 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.720638 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.721418 11948 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:12:03.721561 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.722661 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:03.722677 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.723624 11942 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:03.723703 17851 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:03.720975 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.725586 17851 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.725512 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.726459 11945 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:03.726946 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:03.726974 12016 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:12:03.655689 17859 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.324s	user 0.012s	sys 0.010s
W20260709 12:12:03.746088 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 46087.5us
I20260709 12:12:03.789256 12016 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:03.792683 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.794581 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.794520 11945 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:03.805945 12016 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:03.659003 17578 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.823333 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.824404 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.826030 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.827787 17743 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.832809 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.844067 17594 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.844889 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.833858 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.846567 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.847203 12610 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:03.848948 11939 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:03.849431 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.851392 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.852952 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.854874 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.856097 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.858309 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.860227 17568 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.860822 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.863281 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.863608 12019 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.865223 12019 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:03.865926 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.867029 12014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:03.867672 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:03.725627 17667 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.868706 12016 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:03.837392 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.869904 12611 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.870751 17667 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.871148 12015 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:03.834236 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 111748us
I20260709 12:12:03.836215 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.839016 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.840399 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.840445 11942 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.840914 17827 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:03.873613 12013 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:03.873826 17827 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.873915 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:03.874318 17827 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.874604 17568 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.874917 17588 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:03.875161 17568 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.837316 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:03.877719 17568 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.858346 11948 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:03.878010 11940 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:03.842511 17642 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:03.879212 17642 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.879628 17642 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.877794 17851 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.880647 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:03.881099 17851 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.881577 17851 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.881847 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.867798 12014 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:03.839500 17757 raft_consensus.cc:3055] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.883113 17854 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:03.883339 17757 raft_consensus.cc:740] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:03.883711 17854 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.884227 17854 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:03.884497 17757 consensus_queue.cc:260] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.883132 12014 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.841933 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:03.886469 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 44664.1us
I20260709 12:12:03.886569 17568 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:03.887302 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:03.887456 17568 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:03.888362 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:03.890377 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:03.906711 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.907555 17625 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.908183 17625 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.910887 17757 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.911062 17625 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:03.912335 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:03.913826 17658 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.914342 17658 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.914750 17658 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.915248 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:03.896525 17578 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.917992 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.918706 12604 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.921902 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.868682 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:03.930325 12611 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:03.942117 17594 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:03.888430 11839 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:03.889019 17823 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.888757 17568 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:03.950390 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.951442 12609 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 13.
I20260709 12:12:03.959705 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:03.968348 11837 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:03.949842 17823 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.972437 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.955054 17757 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:03.976779 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.956601 17798 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.982831 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:03.977172 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 88863.9us
I20260709 12:12:03.968367 12014 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:03.954227 17667 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:03.992245 12604 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:03.986483 17667 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:03.963022 17679 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.002439 17667 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:04.003510 11943 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:03.977082 17578 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:04.008247 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58782.9us
I20260709 12:12:04.008855 17578 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:04.009578 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.010069 17578 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.008057 11837 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.011310 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:03.985466 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.020146 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:03.979692 17588 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.983049 17703 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.001768 17757 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.013587 12014 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:03.976449 17823 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.011855 17798 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.023557 17679 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.030784 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:04.031095 12609 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.031467 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:04.058051 12609 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.031751 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:04.032385 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.032452 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:04.033887 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.033946 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.036733 17594 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.062093 12606 raft_consensus.cc:2368] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16.
I20260709 12:12:03.973891 17827 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.042295 17870 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:04.020917 17852 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.045217 12604 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:04.045900 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:04.057591 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46453.4us
I20260709 12:12:04.071872 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.064229 11940 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:04.044597 17642 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.059156 12609 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.047426 17588 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.077620 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:04.078994 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.082288 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.083302 12017 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.084952 12609 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.056785 17703 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:04.089932 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.064643 17868 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:12:04.098243 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.098388 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.041390 17658 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.100977 12017 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.066344 17870 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.103156 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.106176 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.106489 12013 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.107854 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.108804 12611 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.087059 17588 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.109210 12611 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.108793 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.095397 17703 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.066632 17594 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.111245 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:04.113835 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.091202 17872 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:04.130097 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.130602 11943 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:04.126255 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 208453us
I20260709 12:12:04.131105 12018 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.130147 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:04.138491 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.139262 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.139994 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.140493 12015 raft_consensus.cc:2393] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:04.110370 17868 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.118734 12611 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.163985 12014 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:04.164192 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.164204 11948 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:12:04.165645 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 180193us
I20260709 12:12:04.165830 12611 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.162283 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:04.167012 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 62911.4us
W20260709 12:12:04.141095 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 122646us
I20260709 12:12:04.169129 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:04.168715 11986 leader_election.cc:336] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Timed out: RequestConsensusVote RPC to 127.10.114.68:39553 timed out after 1.706s (SENT)
I20260709 12:12:04.170846 12015 raft_consensus.cc:2393] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:12:04.142468 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.182044 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.182953 12609 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.183647 17798 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:04.170251 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:04.173617 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:04.184223 17798 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.184741 12014 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:04.182458 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.158767 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.141990 11940 raft_consensus.cc:1240] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:04.174026 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.142048 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:04.187057 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.189291 12016 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:04.190791 11945 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:04.194805 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.164599 17872 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.197173 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:04.209640 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.216059 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.218844 11948 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.220356 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.221184 11945 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:04.173128 17862 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:12:04.186795 17804 consensus_queue.cc:1059] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:12:04.229679 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.230036 17804 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.230453 17804 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.220188 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.231395 17804 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.231997 17642 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.232630 17804 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.232895 17827 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.236057 17798 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:04.236460 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.203866 17881 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.238691 17658 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.206486 17625 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:04.223174 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49394.3us
I20260709 12:12:04.228659 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.221714 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.266543 11943 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.241783 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 73100.8us
I20260709 12:12:04.267576 12611 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
W20260709 12:12:04.255514 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.256315 11941 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
W20260709 12:12:04.272012 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101840us
I20260709 12:12:04.239486 17851 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.278157 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.282562 11941 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.172330 17870 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.262192 17625 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.261977 17862 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:04.270509 17798 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:04.290201 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.276185 17879 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.294879 17884 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:04.264858 17757 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:04.308779 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:04.296787 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 99674.4us
I20260709 12:12:04.292642 17625 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.268685 17868 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.314769 11945 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
W20260709 12:12:04.321122 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.322180 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.326647 11943 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:12:04.301708 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.328783 11944 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:04.329284 11947 raft_consensus.cc:2368] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:04.325879 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.291939 17862 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.311862 17879 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:04.333334 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.333022 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 65177.1us
I20260709 12:12:04.345772 17879 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.345816 17594 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.346627 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.301517 17885 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:04.299535 17798 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:04.350201 17798 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.352556 17667 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.353817 17886 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:04.354820 17851 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.354584 17886 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.360741 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.307668 17872 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.362417 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:04.342236 17876 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:12:04.330857 17870 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.369549 11941 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:04.366932 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.363490 11944 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.318928 17881 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:04.368780 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:04.366677 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 80151us
I20260709 12:12:04.377275 11945 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:04.370949 11943 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:04.371909 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:04.372416 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99194.8us
I20260709 12:12:04.374862 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.375254 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:04.381345 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.387449 11947 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.392282 11947 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:04.394374 11947 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:12:04.395663 11947 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:04.307276 17750 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:12:04.309155 17588 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.398669 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.399300 11941 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.402455 11942 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.410384 11948 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:04.414713 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.416800 11947 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:04.422271 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.422360 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.423787 11945 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:12:04.425122 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.427878 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.387738 17757 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.433818 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.443770 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.445190 17867 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:12:04.446939 17823 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.448491 17588 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.449963 17881 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.454950 17667 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.455816 17667 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:04.456177 17667 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.456487 17667 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.457609 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.458547 11942 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:04.342226 17862 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.458786 11943 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:04.459990 17862 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:04.460248 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.406234 17886 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:04.462190 17886 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.463229 17887 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:12:04.464093 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.464627 11946 raft_consensus.cc:2368] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:04.468941 17823 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.478355 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.479256 11948 raft_consensus.cc:2376] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 8. Re-sending same reply.
I20260709 12:12:04.385941 17889 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:12:04.386510 17891 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:12:04.377183 17703 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.484252 17703 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:04.483865 11770 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 15 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 18 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:04.485054 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.433303 17851 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.487254 17851 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:04.487669 17851 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.487954 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.488787 11946 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.488961 11943 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:12:04.489326 11943 pending_rounds.cc:85] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 6
I20260709 12:12:04.489635 11943 pending_rounds.cc:107] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:12:04.489960 11943 raft_consensus.cc:2889] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.490078 17799 consensus_queue.cc:1059] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:04.492601 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.493863 11945 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:04.496034 17667 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.497313 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.434931 17757 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:04.435323 17854 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.005s
I20260709 12:12:04.499595 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.566843 11946 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:04.499855 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.500608 17798 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.501715 11944 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.458891 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:04.504348 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 78354.7us
W20260709 12:12:04.539656 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.542537 11948 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.543093 11939 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:04.569067 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:04.543926 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.549787 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:04.570147 12610 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.567842 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.571089 11943 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:04.572746 17854 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.573360 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.573732 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.574198 11944 raft_consensus.cc:2393] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.575188 17854 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.575249 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.576207 11944 raft_consensus.cc:2368] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:04.576318 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.577471 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.578390 11947 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.579074 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.577519 11944 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:04.581089 17878 log.cc:927] Time spent T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.130s	user 0.001s	sys 0.002s
I20260709 12:12:04.581969 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.582576 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.579923 11939 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.584910 11943 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.588039 11942 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.591050 12610 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
W20260709 12:12:04.594058 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.594378 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.597337 11837 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.602447 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.573377 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.566689 17757 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.608631 11948 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:04.620285 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:04.614532 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 288877us
W20260709 12:12:04.615478 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 236243us
I20260709 12:12:04.596124 17588 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:04.607080 11770 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 7 to 10, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:04.591738 17867 raft_consensus.cc:3055] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:04.602571 17852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.020s	sys 0.000s
I20260709 12:12:04.621045 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.622632 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:04.624051 11942 raft_consensus.cc:2368] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:04.622264 11988 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.630358 17902 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.630764 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:04.631947 17902 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.632011 17799 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.632426 17902 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:04.632875 17902 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.632921 17799 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:04.634594 17804 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:04.636008 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.637377 17798 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.638092 17799 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:04.639019 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.640201 17892 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:04.640751 17892 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.641093 17904 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.641600 17904 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.642007 17904 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.641754 17892 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.642776 17667 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.643440 17667 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.643781 17667 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.644107 17667 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.605682 17854 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:04.645721 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.645911 17854 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:04.646937 17854 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.648051 17902 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.650197 17902 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.653265 17899 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.620263 17885 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.653882 17899 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.654331 17899 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.656594 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.660466 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 176) took 10280 ms. Trace:
I20260709 12:12:04.661904 17872 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.662488 17872 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.663555 17872 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.663967 17879 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.667457 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.667923 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.668258 11946 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.668954 17703 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.669124 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.669505 17703 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.669955 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.670181 17886 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:04.670737 17886 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.671375 17868 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.671308 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.672219 11943 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.671766 17886 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.672503 11939 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:04.672976 17868 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:04.670842 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 324312us
I20260709 12:12:04.673642 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.671793 17703 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:04.674324 11941 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:04.675243 17897 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:04.675396 17868 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.676422 17804 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:04.676801 17804 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.676828 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.677933 17804 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.678371 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:04.679338 17804 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.679703 17703 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.680241 17703 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:04.607125 17891 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.669028 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.654275 17885 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:04.690352 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.684816 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.702606 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.703521 11942 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.704607 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.706234 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.707551 11869 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.711139 17879 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.713250 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.714345 17798 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.698774 17885 raft_consensus.cc:3060] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.716405 11986 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.720221 17798 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.721858 11986 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:04.725986 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.726809 11942 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 8.
W20260709 12:12:04.728191 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.734915 11867 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:04.734794 11986 leader_election.cc:400] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16.
I20260709 12:12:04.735963 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.736891 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:04.737052 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.737725 11870 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:04.737846 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.738504 11948 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:04.738643 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.739043 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.739645 11943 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:04.741923 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.741956 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:04.743039 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.743484 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.743676 12013 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:04.683527 17852 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:04.744311 11941 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.744877 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.745307 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.745122 17852 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.746572 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.747357 11940 raft_consensus.cc:2368] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:04.682122 17867 raft_consensus.cc:740] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.748266 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.749044 11947 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:04.748799 17867 consensus_queue.cc:260] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.750226 17867 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.751430 12022 raft_consensus.cc:2468] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:04.752719 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.633051 17884 consensus_queue.cc:1059] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:12:04.753924 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.738438 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.759068 12610 raft_consensus.cc:3055] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:04.759460 12610 raft_consensus.cc:740] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:04.760272 12610 consensus_queue.cc:260] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.761958 11770 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:04.763937 11770 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:04.735515 11986 leader_election.cc:403] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:04.767931 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.768281 17870 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.769939 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.704809 17588 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.771760 11867 raft_consensus.cc:1275] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.772527 17588 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:04.681524 17703 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.765594 17625 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.779419 17625 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:04.783226 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:04.778704 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 51441.2us
I20260709 12:12:04.784641 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.785998 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.786252 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.787030 11864 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.787186 11871 raft_consensus.cc:2410] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:12:04.787724 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.772934 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.792641 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.803021 17625 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:04.789187 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.805843 11869 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.807011 11770 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:04.808704 11770 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 12 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 14 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:04.809981 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.811210 17851 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.811903 12610 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.812414 11866 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:04.814507 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.815502 11866 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.820657 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.821606 11873 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:04.822746 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.823791 11870 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 11: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.824707 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.825387 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.826295 11871 raft_consensus.cc:2410] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:04.829810 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 195645us
W20260709 12:12:04.833669 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.834241 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.837009 12610 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:04.837800 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.838440 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.842561 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.843694 12022 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 7. Current term is 8. Ops: []
W20260709 12:12:04.851060 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.825320 11870 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:04.810971 11770 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:04.859104 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.859942 11942 raft_consensus.cc:2368] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:12:04.862154 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.862990 12021 raft_consensus.cc:2393] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:04.859771 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.863750 11871 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:12:04.867216 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.870142 12018 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:04.870034 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.871068 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:04.871793 12022 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.874042 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.871480 12020 raft_consensus.cc:2410] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:04.875837 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.876513 11872 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:04.877439 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.860426 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:04.882684 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.871449 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.882822 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:04.885136 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.886633 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:04.833052 17891 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.898032 11869 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:04.895774 11942 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:04.856158 17625 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:04.903159 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.660872 11768 rpcz_store.cc:276] 0709 12:11:54.379708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.379863 (+   155us) service_pool.cc:224] Handling call
0709 12:12:04.660190 (+10280327us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:02.187749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:02.188834 (+  1085us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:02.188892 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:12:02.188929 (+    37us) tablet.cc:662] Decoding operations
0709 12:12:02.307473 (+118544us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:02.329486 (+ 22013us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:02.330657 (+  1171us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:12:02.346037 (+ 15380us) tablet.cc:701] Row locks acquired
0709 12:12:02.346095 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:12:02.346343 (+   248us) write_op.cc:270] Start()
0709 12:12:02.346584 (+   241us) write_op.cc:276] Timestamp: P: 1783599122346251 usec, L: 0
0709 12:12:02.346634 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:12:02.347586 (+   952us) log.cc:844] Serialized 9485 byte log entry
0709 12:12:02.626112 (+278526us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f189290ac 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b
0709 12:12:03.258673 (+632561us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.527833 (+269160us) write_op.cc:301] APPLY: starting
0709 12:12:03.527950 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.725190 (+197240us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.725241 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.885375 (+160134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.927723 (+ 42348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 12:12:03.927800 (+    77us) write_op.cc:312] APPLY: finished
0709 12:12:03.928432 (+   632us) log.cc:844] Serialized 212 byte log entry
0709 12:12:03.928684 (+   252us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.928958 (+   274us) write_op.cc:454] Released schema lock
0709 12:12:03.929060 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.929637 (+   577us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.929668 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":253752,"apply.run_cpu_time_us":35096,"apply.run_wall_time_us":401759,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104591,"num_ops":24,"prepare.queue_time_us":155288,"prepare.run_cpu_time_us":32298,"prepare.run_wall_time_us":483708,"raft.queue_time_us":425740,"raft.run_cpu_time_us":102266,"raft.run_wall_time_us":167788,"replication_time_us":911846,"spinlock_wait_cycles":22084864,"thread_start_us":889423,"threads_started":4,"wal-append.queue_time_us":418521}]]}
I20260709 12:12:04.857758 17870 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16.
I20260709 12:12:04.903391 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:04.909878 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.907765 11873 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:04.935376 11864 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:04.907275 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:04.909224 11947 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.910776 11770 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 13 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 14 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.855829 17862 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 12:12:04.919721 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.900283 17886 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.848831 17588 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:04.729969 17904 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.869696 17804 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:04.873517 17757 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:04.871034 17667 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.953099 17592 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.981979 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:04.989620 11870 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.896905 17899 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:04.991123 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.935551 17901 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.997107 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:05.000774 11871 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:04.984148 12022 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:05.002207 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.003050 11864 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:05.003430 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.907414 17625 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:04.965476 17872 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:04.978513 17823 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.003875 17898 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:05.015820 12021 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 18. Ops: []
I20260709 12:12:05.015810 17898 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.026003 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.026827 11871 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.020417 17898 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.035885 17667 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.038482 17757 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:05.043081 17904 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:05.046993 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.060328 11870 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:04.980656 17886 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.001053 17592 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:05.078454 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 170430us
I20260709 12:12:05.074334 11871 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
W20260709 12:12:05.090241 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.094378 12022 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:05.094805 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.100271 11770 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 14 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.103861 11873 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:12:05.104666 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.106403 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.001072 17907 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:05.108493 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.109287 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.110090 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.110941 12611 raft_consensus.cc:2410] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:05.110944 12609 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:05.114224 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.117815 12020 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 12:12:05.117866 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 221544us
I20260709 12:12:05.120754 12021 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:05.124436 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.124291 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:05.125272 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:05.125821 12610 raft_consensus.cc:2410] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:05.008728 17901 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.023118 17823 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.129144 11868 raft_consensus.cc:1240] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:05.128901 11770 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 14, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:05.145424 11873 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:05.107945 17904 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:05.155936 11871 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 12:12:05.066310 17872 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.157444 11870 raft_consensus.cc:1240] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:05.157585 11873 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:05.131669 17907 consensus_queue.cc:1243] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:05.139780 17870 consensus_queue.cc:1059] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:05.182308 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:05.154671 17885 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.183035 11870 raft_consensus.cc:1240] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:05.183218 11942 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:05.187463 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:05.190436 11867 raft_consensus.cc:1240] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:05.194007 17625 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.195631 17823 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:05.198469 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:05.204248 11873 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:05.213794 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:05.214550 11939 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.214919 11770 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 12, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 12 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.170440 17907 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:05.156639 17915 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:05.220291 17915 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.220803 17915 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.221230 17592 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:05.202440 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:05.214051 11871 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:05.223827 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:05.224234 11942 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.224728 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:05.229707 11939 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:05.233626 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.234185 11947 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:05.170923 17884 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:12:05.238117 11865 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:12:05.238143 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 89425.9us
I20260709 12:12:05.221833 17852 raft_consensus.cc:2764] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:12:05.241216 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:05.232976 17854 raft_consensus.cc:2764] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:05.241873 11940 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:05.235523 17910 log.cc:927] Time spent T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:12:05.248692 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.230957 17588 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:05.220396 17872 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:05.260346 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.235471 17899 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.262465 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.239099 17879 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:05.286574 17886 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:05.286945 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.263211 12017 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.237661 17862 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.262548 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:05.336251 17862 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.337255 17862 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.338251 11944 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:05.338590 17862 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.265010 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:05.265642 11839 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.634s (SENT)
I20260709 12:12:05.342152 12022 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
W20260709 12:12:05.342643 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 77050.6us
I20260709 12:12:05.343200 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:05.343815 12022 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
W20260709 12:12:05.344206 11839 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.983s (SENT)
I20260709 12:12:05.265934 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.344612 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.344946 12020 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.347101 17879 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:05.348747 11839 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.105s (SENT)
I20260709 12:12:05.267150 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.351722 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.353073 12013 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:05.354836 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.355816 12021 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.273725 17901 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.275120 17915 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:05.362195 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.362658 17915 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:05.277279 17867 consensus_meta.cc:287] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.006s
I20260709 12:12:05.363673 17867 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.364845 12603 raft_consensus.cc:3060] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.365824 17757 raft_consensus.cc:3055] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.366333 17757 raft_consensus.cc:740] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:05.367542 17757 consensus_queue.cc:260] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.369168 17757 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:05.323756 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.284888 17804 consensus_queue.cc:1059] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.332572 17920 consensus_queue.cc:1059] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.378829 17920 raft_consensus.cc:3055] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:05.379231 17920 raft_consensus.cc:740] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.380333 17920 consensus_queue.cc:260] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.258554 17798 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.382311 17851 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:05.383181 12016 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 15. Ops: []
I20260709 12:12:05.386758 17892 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:05.389976 12606 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:12:05.390373 12606 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.391170 12606 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.392676 12606 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:05.396725 11864 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:05.399912 11940 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:05.279313 17885 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:05.372575 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.399080 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.423435 17851 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:12:05.402657 12020 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:05.403427 12610 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:05.423938 17879 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:12:05.403474 17920 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:05.406544 12605 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:05.424430 17854 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:12:05.428473 17851 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:05.431294 17851 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:05.425194 17881 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:12:05.432709 17881 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.432428 17851 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.433149 17881 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:05.433861 17851 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.434121 17881 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.435537 17881 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.426414 12013 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.442565 11939 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:05.443145 12017 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:05.426744 12022 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.447300 17879 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.445182 17854 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.427059 11947 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:05.417419 12603 raft_consensus.cc:2468] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:05.463889 12602 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:12:05.466307 12575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.475835 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.487514 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.487398 12021 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:05.511025 12606 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:12:05.335273 11942 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
W20260709 12:12:05.518074 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 250980us
I20260709 12:12:05.519290 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.529037 12022 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
W20260709 12:12:05.531524 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.520735 17897 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:12:05.532595 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 248584us
I20260709 12:12:05.540288 12013 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:05.551092 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.520635 17899 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.548475 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.548277 11839 leader_election.cc:400] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:05.556365 11986 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:05.530460 17886 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.556973 12013 raft_consensus.cc:1240] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:05.556918 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.546368 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "005405ff7b534db6b4c6be122c445915"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:05.558676 11947 raft_consensus.cc:606] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.559147 11947 raft_consensus.cc:614] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.561244 12022 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:05.562537 17886 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.563462 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:05.553136 17881 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:12:05.564097 11947 raft_consensus.cc:606] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.564508 11947 raft_consensus.cc:614] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.566504 17892 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:05.567816 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:05.568503 11942 raft_consensus.cc:606] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.561739 17852 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.520541 17879 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:05.547535 17870 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:05.573526 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.574683 17879 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:05.554288 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 380281us
I20260709 12:12:05.542758 17588 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:12:05.532066 17885 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:12:05.581070 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:05.570298 12577 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.584338 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.588325 17592 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.590922 17898 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.591341 17918 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.593670 17757 raft_consensus.cc:2804] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.594225 17757 raft_consensus.cc:697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:05.595423 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47072.5us
I20260709 12:12:05.595243 17757 consensus_queue.cc:237] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.596246 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.597723 17899 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:05.598469 17870 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.598834 17854 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:05.598950 17870 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:05.599447 17854 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:05.599557 17870 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.600381 17854 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.604346 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.593047 17918 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:05.608915 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.609189 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.609790 17798 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.610047 17588 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.610211 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.610708 17932 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.611565 17798 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.612129 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.613050 17798 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.629659 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.631103 17798 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.631536 17798 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.631884 17798 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.632053 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:05.643062 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:05.645804 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61603us
I20260709 12:12:05.646487 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:05.646891 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:05.648506 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.648454 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.652205 17592 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.652750 17658 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:05.653426 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.653553 17904 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.651993 17879 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:05.654009 17904 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:05.654462 17904 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.657389 12014 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:05.657742 17868 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:05.657879 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.658191 17868 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:05.658706 12017 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:05.658604 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.659781 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.660588 12020 raft_consensus.cc:2410] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:05.658614 17868 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.662832 12021 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 12:12:05.665184 12018 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:05.667024 17588 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.676191 17904 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.644411 17872 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:05.607889 17901 consensus_queue.cc:1048] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:12:05.684108 17868 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.685850 17886 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.688938 12022 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:05.692008 12602 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:05.694581 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.695068 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.695547 12020 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:05.696023 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.696171 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:05.689597 17867 consensus_queue.cc:1059] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:12:05.695657 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:05.701696 12019 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:05.702342 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:05.701650 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 46616.6us
I20260709 12:12:05.705256 17862 raft_consensus.cc:3055] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:05.705762 17862 raft_consensus.cc:740] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:05.703007 17932 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:05.706964 17932 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:05.706758 17862 consensus_queue.cc:260] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.644809 17854 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.707958 12018 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:12:05.710021 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 63604.8us
I20260709 12:12:05.707499 17932 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.713493 17872 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.718637 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.699774 17899 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.722545 11988 leader_election.cc:400] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:12:05.723022 11988 leader_election.cc:403] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:12:05.724076 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75696.4us
W20260709 12:12:05.724913 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.725613 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:05.733137 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.732686 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.739104 12602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
W20260709 12:12:05.739987 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.739885 12602 raft_consensus.cc:606] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.740999 12602 raft_consensus.cc:614] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.741919 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:05.730020 17879 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.741708 17927 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.768879 17927 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.771672 17927 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.737258 17901 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:12:05.746713 17922 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:05.720592 17867 consensus_queue.cc:1175] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 12:12:05.735122 17862 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.772989 17922 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:05.774431 17922 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.734665 17918 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:05.731895 17658 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:05.760224 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.790445 12015 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
W20260709 12:12:05.799934 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 88819.4us
I20260709 12:12:05.807539 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:05.818634 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:05.758627 17886 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:05.831250 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.882947 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 144743us
I20260709 12:12:05.883513 11947 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:05.883939 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:12:05.896575 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.900938 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:05.904491 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.905369 17915 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.905896 17915 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.906291 17915 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.886142 17916 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.916970 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260709 12:12:05.918344 11839 leader_election.cc:400] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:05.896776 17879 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.924727 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:05.925451 11947 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:05.925879 11947 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.914449 17588 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.909759 17658 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.903472 17904 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.953819 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:05.901254 17868 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.956274 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.957273 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.967768 17658 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:05.968886 17899 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.961190 17932 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.935353 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.934999 17588 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.972532 17932 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:05.936034 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.937235 11868 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:12:05.973564 11869 raft_consensus.cc:2368] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:12:05.941424 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:05.974208 11866 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.941865 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:05.923913 17916 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.935393 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:05.978106 11871 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:05.978572 11864 raft_consensus.cc:2410] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:12:05.980230 17916 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:05.947711 17943 log.cc:927] Time spent T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:05.981573 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:05.982419 12606 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:12:05.949700 17918 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:05.983031 17918 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:05.969069 17658 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:05.980286 17798 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.991767 17798 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:05.993970 11866 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
W20260709 12:12:05.934074 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50247.7us
I20260709 12:12:05.997222 17918 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:05.999174 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:05.999507 17940 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:06.000053 17916 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.000397 17918 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.001994 17916 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:06.003451 17916 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:06.003906 17916 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.004083 17588 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:06.005976 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.007165 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:06.005061 17916 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:06.025285 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 292692us
W20260709 12:12:06.028415 11839 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.525s (SENT)
W20260709 12:12:06.018005 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 62257.6us
I20260709 12:12:06.029407 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.029358 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.008718 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.037949 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.040119 17922 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:06.009454 17945 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.015218 17916 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.041996 17798 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.042224 17852 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.045300 17592 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:06.053038 11839 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.545s (SENT)
I20260709 12:12:06.055670 11988 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:12:06.068122 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.076825 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:06.078146 11839 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.662s (SENT)
I20260709 12:12:06.078570 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.013797 17920 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.020212 17870 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.051937 17945 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.080551 11988 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
W20260709 12:12:06.090546 11839 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.740s (SENT)
I20260709 12:12:06.091051 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.090152 17879 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.020622 17915 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.099220 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:06.099243 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.104292 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.108605 11869 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:12:06.090484 17757 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.108605 11947 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:06.092209 17945 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.111351 11942 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:06.117658 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.119311 11864 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:06.095505 17854 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.122095 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:06.124591 17950 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:06.135874 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:06.136726 11871 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.150725 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.099887 17852 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:06.154886 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46761us
W20260709 12:12:06.156729 11839 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.945s (SENT)
I20260709 12:12:06.157176 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.106528 17932 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:06.166952 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.168270 17854 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:06.168181 11839 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.034s (SENT)
I20260709 12:12:06.169013 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.173863 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.174499 11869 raft_consensus.cc:1813] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Handling vote request from an unknown peer 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.175069 11869 raft_consensus.cc:2410] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:12:06.178238 17881 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.181815 17932 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.184547 17932 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:06.184948 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.154052 17757 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.186065 11864 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:12:06.186955 17757 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.188138 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.165061 11871 raft_consensus.cc:2468] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
W20260709 12:12:06.165968 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76651.5us
I20260709 12:12:06.109501 17868 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:06.109102 17798 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:06.190353 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.091248 17920 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.192821 11869 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:12:06.193382 11869 pending_rounds.cc:85] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 8
I20260709 12:12:06.193671 11869 pending_rounds.cc:107] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:12:06.193993 11869 raft_consensus.cc:2889] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.196394 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:06.196394 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.198215 11942 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.196434 11871 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:06.201581 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.202191 11947 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:06.202366 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:06.197160 12577 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.150698 17870 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.207922 11864 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:06.210376 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.211210 11866 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:06.217490 17798 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.218825 17798 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.221910 17868 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.222625 17658 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:06.223177 17658 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:06.223616 17658 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:06.223021 17868 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.207293 17892 raft_consensus.cc:2804] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.230296 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.231243 11939 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:12:06.234346 11942 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:06.242835 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:06.243789 11869 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.249441 17915 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.253458 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.266873 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:06.267647 11866 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:06.269125 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.269968 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67669us
I20260709 12:12:06.279408 11988 leader_election.cc:400] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18.
I20260709 12:12:06.276503 17946 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.281703 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.285238 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.285857 11942 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:06.285957 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.291177 11869 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:06.287751 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.293970 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.228375 17592 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:12:06.262224 17870 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.263504 17899 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.274302 17588 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.342787 11866 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 12.
I20260709 12:12:06.358304 12604 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:06.292802 17886 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.341480 17892 raft_consensus.cc:697] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:06.367827 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 101797us
I20260709 12:12:06.410156 17958 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:06.278378 17854 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:12:06.280567 17946 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.409129 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.443840 17588 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.340575 17918 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:06.283154 17872 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:12:06.357692 17870 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.284993 17851 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:12:06.277007 17922 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:12:06.303036 17898 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.296835 17904 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:06.292630 17901 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:06.451834 17920 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:06.425232 17886 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:06.430747 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.510653 11940 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:06.361847 17899 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.418437 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.435591 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.513962 11941 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:06.434666 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:06.459159 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 165318us
I20260709 12:12:06.515609 11944 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.463122 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:06.517027 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54042.3us
W20260709 12:12:06.469440 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 181773us
I20260709 12:12:06.516225 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:06.497771 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.505677 17954 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.522195 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.510206 17918 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.523222 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.527900 11940 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:06.529070 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.480739 17965 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.532359 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:06.532707 17968 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:06.484676 17904 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:06.434784 17892 consensus_queue.cc:237] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:06.541869 11839 leader_election.cc:336] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.514s (SENT)
I20260709 12:12:06.535375 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.542646 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:06.514029 17901 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.543314 12021 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:06.527402 17886 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:12:06.546326 17932 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.522277 17868 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.558609 11941 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 9.
I20260709 12:12:06.527410 17852 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.482717 17588 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.497457 17898 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.539637 17798 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:06.573366 17979 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:06.575021 17870 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:06.575824 17870 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:06.564134 17862 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.539129 17904 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.533655 17972 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.587239 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:06.588977 17970 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.589751 17970 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.590302 17970 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.615278 12606 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:06.572350 17854 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.578190 17798 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:06.621905 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 96058us
I20260709 12:12:06.533828 17954 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.631107 17973 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:06.583215 17922 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.563721 17932 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:06.643996 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 78600.1us
I20260709 12:12:06.641331 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:06.577349 17862 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.568145 17868 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.648841 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.631848 17973 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.657500 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:06.628789 17798 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:06.639328 17922 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:06.678722 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 146459us
I20260709 12:12:06.679750 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:06.684686 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:06.664800 17916 consensus_meta.cc:287] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260709 12:12:06.686728 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:06.681139 17927 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.688366 17975 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.688479 17872 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.688409 17961 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.698230 17973 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.714682 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.683425 17922 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.699993 17588 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:06.687109 17592 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 12:12:06.686714 12605 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:06.701954 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:06.701234 17898 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:06.709309 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.628496 17918 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.711822 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.728338 11869 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:06.712553 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.716511 17852 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:06.715461 12017 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:12:06.714840 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.730823 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:06.730667 17852 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.672173 17968 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:06.731832 17968 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.732316 17968 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.719388 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:06.699680 17966 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:12:06.720315 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:06.744045 12019 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.744083 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.745880 11868 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:12:06.720558 12022 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:06.720935 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.721725 12014 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:12:06.709671 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:06.748391 12014 pending_rounds.cc:85] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 10
I20260709 12:12:06.748667 12014 pending_rounds.cc:107] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:06.724339 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.748901 12014 raft_consensus.cc:2889] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.749243 11939 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:06.729769 12015 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:06.720098 12013 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:06.743235 12018 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.693077 17970 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.759106 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.752065 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:06.754451 11870 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:06.711340 17972 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:06.775879 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.743647 17965 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:06.786150 17658 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.562s	user 0.015s	sys 0.000s
I20260709 12:12:06.788439 17963 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:06.792505 17963 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:06.773936 17899 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.725597 17916 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:12:06.774842 17975 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.795560 17757 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:12:06.728082 17927 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.805639 17970 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:06.826238 17964 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:06.826839 17964 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.826632 17975 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.794332 17658 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.830551 11942 raft_consensus.cc:1240] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:06.841266 11944 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:06.844003 12019 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:06.795598 17972 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.834681 17904 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.862219 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.863139 11939 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:06.864562 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.867743 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.727322 17961 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:06.868681 11948 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.870431 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:06.872226 12021 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.870940 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.874323 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:06.872781 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 115018us
I20260709 12:12:06.877815 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.878089 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.878834 11941 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.879993 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.880914 11943 raft_consensus.cc:2368] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:06.877065 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.884047 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.884840 11944 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.885831 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.887301 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.888775 11939 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:06.890045 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.864534 17904 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.898066 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.899204 11943 raft_consensus.cc:2393] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.900131 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.900743 11945 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.901988 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.902101 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.903607 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.903781 11914 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.905108 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.905231 17986 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.914621 11939 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.921728 11914 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.930176 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.930444 17987 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.930648 17985 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.931238 11946 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:06.931495 17987 raft_consensus.cc:2804] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.931908 17982 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.932034 17987 raft_consensus.cc:697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.932327 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.932538 17982 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.933528 17946 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:06.930998 17972 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.935014 17982 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:06.933147 17987 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:06.937906 12604 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:12:06.947422 12604 pending_rounds.cc:85] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 10
I20260709 12:12:06.947736 12604 pending_rounds.cc:107] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:06.947973 12604 raft_consensus.cc:2889] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.933838 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.949123 11944 raft_consensus.cc:2393] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.913852 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:06.942818 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.938504 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:06.949849 11948 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.950204 11941 raft_consensus.cc:2393] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:12:06.950850 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 409007us
I20260709 12:12:06.954685 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:06.981033 11944 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:06.984059 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:06.990716 12606 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:12:06.993700 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.002108 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47564.1us
I20260709 12:12:07.002439 17977 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.012966 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:06.943841 17867 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.011571 11948 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:12:06.952358 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.022816 11943 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:06.891600 17899 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:12:06.942238 17986 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:07.017874 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 121155us
W20260709 12:12:06.955116 11839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.577s (SENT) [suppressed 54 similar messages]
I20260709 12:12:07.019374 11945 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:12:06.939908 17954 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:06.939467 17932 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:06.943884 17979 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.011605 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.038156 11941 raft_consensus.cc:2393] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:07.000881 17965 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:06.980026 17592 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.979121 17872 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:06.981462 17901 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:07.003307 17898 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.029349 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:07.031714 12021 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:12:07.034169 11948 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:06.981588 17946 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:12:07.046868 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:06.931339 17985 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.095387 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66853.5us
W20260709 12:12:07.097146 17989 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:12:06.890719 17963 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.101403 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:07.099833 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53058.6us
I20260709 12:12:07.124656 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:07.032627 17986 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.024355 17904 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:07.037758 17979 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:07.027611 17867 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.053164 17862 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:07.127308 17879 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 1.029s	user 0.010s	sys 0.005s
I20260709 12:12:07.185330 12602 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:07.214974 12602 pending_rounds.cc:85] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 11
I20260709 12:12:07.216027 12602 pending_rounds.cc:107] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:07.216511 12602 raft_consensus.cc:2889] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.053928 17976 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.123771 17901 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:07.095393 17997 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.182703 17927 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.184432 17961 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.134986 17872 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.202013 11946 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:07.127893 17973 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:07.210402 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 255304us
I20260709 12:12:07.101377 17898 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:07.196614 17945 consensus_meta.cc:287] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 1.022s	user 0.015s	sys 0.000s
I20260709 12:12:07.202476 17979 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.238286 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.252041 11942 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:07.238571 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:07.180976 17592 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.228278 17879 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.263594 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.264549 11864 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:07.228415 17963 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.260746 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.271627 11869 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.266593 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.268947 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.269819 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.279001 11864 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:07.279084 11942 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:07.279247 11873 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:07.280668 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.281558 11864 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:07.292491 12016 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:07.239105 17932 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:07.295207 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.297851 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:07.298206 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.299018 11867 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 21.
I20260709 12:12:07.254086 17867 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.253499 17901 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:07.301391 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.263037 17881 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.306849 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.313109 11946 raft_consensus.cc:2393] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:07.310464 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.313951 11870 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:07.307585 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.309283 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.227603 17965 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.315124 11868 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.293694 17592 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:07.232148 17976 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.306664 17975 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.328996 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.330472 11871 raft_consensus.cc:2410] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 22 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:12:07.318424 17988 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:12:07.459666 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.394135 11986 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:07.479750 11944 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
W20260709 12:12:07.480002 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 85980.4us
I20260709 12:12:07.480885 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.481614 11944 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:07.481650 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:07.482568 12021 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:07.483669 11944 raft_consensus.cc:3055] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.484045 11944 raft_consensus.cc:740] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:07.484076 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:07.345202 11946 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:07.362092 17592 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.371568 17922 consensus_meta.cc:287] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.003s
I20260709 12:12:07.320624 17881 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.381016 17972 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.363632 17901 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.372800 17898 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.386817 11941 raft_consensus.cc:1275] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:07.394763 17868 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:07.368526 17998 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:12:07.371824 17798 consensus_meta.cc:287] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.003s
W20260709 12:12:07.372189 18003 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:12:07.462354 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.526746 11942 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:07.462739 17981 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.460721 17920 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:07.527761 17981 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.378914 11868 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:07.430949 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.399847 17964 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.301786 17932 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.467957 17968 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.001s
I20260709 12:12:07.473762 17986 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.475179 17985 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:07.476699 17974 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.873s	user 0.005s	sys 0.000s
I20260709 12:12:07.449973 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:07.552524 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 102698us
I20260709 12:12:07.488734 17904 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.496618 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:07.499716 17658 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:07.484910 11944 consensus_queue.cc:260] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.561902 11944 raft_consensus.cc:3060] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.519429 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:07.504601 18006 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:12:07.523245 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.523981 17588 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:07.258698 17945 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.513595 17879 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.553475 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:07.529423 17851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.011s	sys 0.011s
W20260709 12:12:07.556113 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 423471us
I20260709 12:12:07.507058 17972 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:07.569831 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 50467.6us
I20260709 12:12:07.505107 17922 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.574935 11945 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:12:07.564320 17898 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:07.592624 11947 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:07.586650 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:07.522149 17852 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:12:07.557374 17904 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.526543 17798 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.597221 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:07.576081 17854 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:07.550915 17886 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.573606 17964 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.607360 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:07.577345 17879 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.564407 11948 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:07.528595 17920 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.594259 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:07.623579 12019 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
I20260709 12:12:07.619545 17867 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:07.625067 17867 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:07.586189 17851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.012s	sys 0.011s
I20260709 12:12:07.625903 17986 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.626178 17867 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.627569 17995 raft_consensus.cc:476] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:07.628239 18019 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.601670 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:07.631085 17892 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.631460 17892 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.631788 17892 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.589891 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:07.632601 17979 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.633489 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:07.635927 17972 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:07.636651 17980 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:07.637681 18002 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.541s	user 0.002s	sys 0.001s
I20260709 12:12:07.638446 17985 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.639040 17985 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:07.640003 17985 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.641706 18013 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
I20260709 12:12:07.641413 17892 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.603366 17918 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:07.620406 11940 raft_consensus.cc:2368] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:07.621505 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:07.605360 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.633000 17588 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.646155 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:07.592391 17991 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 12:12:07.637274 17980 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.648903 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.655470 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:07.592895 17898 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.554643 17968 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.659174 11871 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:07.661931 12017 raft_consensus.cc:2368] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
I20260709 12:12:07.646484 17916 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:07.600888 17904 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.653481 17980 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:07.687676 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 132166us
I20260709 12:12:07.673158 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.698616 11872 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:07.700054 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.703326 12604 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.611191 11944 raft_consensus.cc:1275] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 12:12:07.676244 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:07.704706 12019 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:07.679425 12022 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:07.684202 17997 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:07.685802 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:07.686591 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.666411 17965 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:07.684229 12020 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:07.689985 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:07.692471 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:07.717281 12015 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.671788 11871 pending_rounds.cc:85] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 9
I20260709 12:12:07.719635 11871 pending_rounds.cc:107] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:07.720050 11871 raft_consensus.cc:2889] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.707494 11944 pending_rounds.cc:85] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 13
I20260709 12:12:07.721201 11944 pending_rounds.cc:107] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 12:12:07.721621 11944 raft_consensus.cc:2889] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.710646 11943 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.644893 17892 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.657943 17658 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.744910 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:07.745860 11839 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.514s (SENT)
I20260709 12:12:07.668175 17898 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:07.752478 11872 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.758692 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:07.761305 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:07.624099 17886 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:07.776409 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.716642 17946 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.740439 17980 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.717247 17997 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:07.816324 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 55156.9us
I20260709 12:12:07.743266 17870 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.831472 11943 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
W20260709 12:12:07.786460 11839 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.805s (SENT)
I20260709 12:12:07.747509 17958 raft_consensus.cc:2764] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:07.817217 12015 raft_consensus.cc:2410] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:12:07.841166 18023 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:12:07.820768 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:07.743273 17965 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:07.857893 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:07.834224 17981 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:07.709576 17916 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:07.861200 12021 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:07.846743 12017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 2359) took 1125 ms. Trace:
I20260709 12:12:07.751754 17592 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:07.869750 17961 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:07.870548 17961 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.870968 17961 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.849958 11869 raft_consensus.cc:1240] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.862125 12017 rpcz_store.cc:276] 0709 12:12:06.720863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.730497 (+  9634us) service_pool.cc:224] Handling call
0709 12:12:07.846417 (+1115920us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540015ca54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:07.846619 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138941184}
I20260709 12:12:07.817970 17658 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.819878 17980 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.834316 11870 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:07.877889 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.853320 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 66915.1us
W20260709 12:12:07.856122 17984 log.cc:927] Time spent T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:12:07.826434 17997 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.890177 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:07.854889 17892 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.783119 17927 consensus_queue.cc:1059] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:12:07.897603 11870 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:07.856564 17881 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:07.905227 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:07.905999 11865 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.903641 17932 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.826143 17946 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.856849 17870 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.918080 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103332us
I20260709 12:12:07.898785 17892 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:07.923374 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:07.911758 17927 raft_consensus.cc:3055] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:07.938733 17980 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:07.933096 17798 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:07.941824 17946 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:07.943231 11865 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
I20260709 12:12:07.943694 17870 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:07.928347 17945 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.930466 17892 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.932360 17965 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.948323 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:07.948961 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:07.949821 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.950383 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.949824 11941 raft_consensus.cc:2393] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:07.950801 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.949254 11948 raft_consensus.cc:2393] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 12: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:07.951941 17976 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:07.952956 18032 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:12:07.926389 17922 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.960074 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:07.960837 12017 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.960707 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:07.962380 12020 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:07.934561 17927 raft_consensus.cc:740] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:07.967582 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:07.968698 11943 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:07.965739 17927 consensus_queue.cc:260] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:07.976531 17927 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:07.978509 18020 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:12:07.980304 17922 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.981081 17922 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.983657 17922 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.985700 17916 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:07.980432 18028 log.cc:927] Time spent T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:12:07.981590 18031 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:07.984256 17922 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:12:07.984268 17879 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:07.991899 17592 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:07.993341 17978 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:07.993786 17978 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:07.994748 17978 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:07.998445 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:08.007584 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 145193us
I20260709 12:12:08.022274 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:07.931972 17987 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:08.031239 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.032454 12021 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:08.032688 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.033758 12017 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:08.036314 12017 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.037850 17945 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:08.039098 17658 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:08.039548 17658 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:08.040560 17658 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:08.047587 11839 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.620s (SENT)
W20260709 12:12:08.048605 11839 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.635s (SENT)
I20260709 12:12:08.049039 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.049328 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.007815 17968 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.048691 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.007383 17922 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.050815 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.054049 18034 consensus_queue.cc:1048] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:08.055004 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.027408 17920 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.057067 11948 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:08.027824 17987 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:08.062179 11839 leader_election.cc:336] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.636s (SENT)
I20260709 12:12:08.062978 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:08.064575 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.068569 18035 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.069259 18035 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.069715 18035 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.074720 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:08.076135 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.076802 11867 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:12:08.082465 17886 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.087023 17658 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.064845 17987 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.091037 11866 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:08.092015 17983 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:08.092329 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:08.092983 11871 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.094841 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.095542 11865 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:08.096932 11864 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:08.104568 11939 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
W20260709 12:12:08.105662 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 43534us
W20260709 12:12:08.106729 11839 leader_election.cc:336] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 1.641s (SENT)
W20260709 12:12:08.108799 11839 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.408s (SENT)
I20260709 12:12:08.112018 12602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:08.112712 12602 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:08.084904 17892 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.109323 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.081009 17898 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.132383 17879 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.134897 17920 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:08.135576 17920 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.137454 17961 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:08.138152 11839 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Timed out: RequestConsensusVote RPC to 127.10.114.66:45949 timed out after 2.409s (SENT)
I20260709 12:12:08.145174 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.146649 17963 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.147141 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.148051 17963 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.148619 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:08.151616 17588 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.152096 17588 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:08.152554 17588 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.135975 17978 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.111821 17945 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.156117 17920 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.160034 12603 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:12:08.155640 17945 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.161168 17892 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.158183 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3200) took 1447 ms. Trace:
I20260709 12:12:08.162185 12016 rpcz_store.cc:276] 0709 12:12:06.710402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.710823 (+   421us) service_pool.cc:224] Handling call
0709 12:12:06.711226 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.293013 (+581787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.157820 (+864807us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54000b5254. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:08.158066 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336251136}
I20260709 12:12:08.163033 17898 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.073369 17904 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.165618 17997 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.166441 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2423) took 1957 ms. Trace:
I20260709 12:12:08.166813 17904 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.168639 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.166738 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.170089 12016 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:08.170758 17945 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.171041 17973 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:08.171775 17973 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:08.172989 17979 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.172821 17973 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.174064 17973 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.166898 11947 rpcz_store.cc:276] 0709 12:12:06.209197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.209479 (+   282us) service_pool.cc:224] Handling call
0709 12:12:06.209905 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.598335 (+1388430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.166145 (+567810us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400425c54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:08.166350 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3179374464}
I20260709 12:12:08.176090 17592 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.176654 17592 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.181672 11945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50002 (request call id 2274) took 1294 ms. Trace:
I20260709 12:12:08.182184 11945 rpcz_store.cc:276] 0709 12:12:06.887703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.034118 (+146415us) service_pool.cc:224] Handling call
0709 12:12:07.035019 (+   901us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:07.590920 (+555901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.181309 (+590389us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400388bd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:08.181598 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240711040}
I20260709 12:12:08.184996 11871 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:08.189337 11947 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:08.196134 18019 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.196764 18019 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.197960 17976 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:08.198964 17976 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:08.199324 17976 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:08.200214 17976 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.204873 11941 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:08.206562 11944 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:12:08.207736 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.208375 17997 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.211404 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:08.212275 12602 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.213905 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:08.235201 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 182781us
W20260709 12:12:08.236920 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54020.7us
I20260709 12:12:08.239274 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.239732 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.240351 11944 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.243083 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.245672 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.246353 11942 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.248265 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.248908 11941 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.249589 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.234647 17904 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.251791 11868 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:08.252362 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.256596 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.257202 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.257915 12017 raft_consensus.cc:3060] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.258159 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.153828 17961 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.261474 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.214986 17976 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:08.274132 11947 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:08.281584 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:08.277019 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:08.275105 17904 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.306999 18024 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:08.307370 17904 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.252101 17870 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.307577 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:08.307776 18024 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.308169 17870 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.308866 17991 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:08.309511 17991 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:08.311257 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:08.312469 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.251991 17879 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:08.277631 11940 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:08.337908 17991 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.341195 17592 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:08.369117 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.272830 11944 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:08.345891 11839 leader_election.cc:400] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:08.370296 11839 leader_election.cc:403] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:08.348448 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:08.354357 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.252288 17918 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.341005 17980 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.362498 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:08.364334 11942 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:08.366195 11941 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:12:08.251151 17979 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:08.367152 12017 raft_consensus.cc:2468] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:08.285704 17968 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.341461 17899 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:08.399878 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54164.5us
I20260709 12:12:08.285943 17898 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:08.385689 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:08.372383 11940 raft_consensus.cc:2410] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:08.285595 17985 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:12:08.395095 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:08.397964 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.398149 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.410301 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.411043 12609 raft_consensus.cc:2393] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 14: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:08.409209 11942 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:08.404214 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:08.393510 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.412102 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.302534 17963 consensus_queue.cc:1059] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:12:08.369328 17904 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:08.366209 17945 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.302279 17946 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:08.398926 17870 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.431818 11864 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:08.389838 17892 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:08.387029 17980 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.418215 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:08.399245 17881 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:08.400344 17899 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.407004 17592 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:08.430994 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.433121 11871 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:08.370265 17879 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.436811 12019 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:08.370082 18035 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.440347 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.442289 12017 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:08.446611 17965 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.446455 18033 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:12:08.447276 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.432286 17870 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:08.452198 18019 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.453843 17904 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:08.454357 11947 raft_consensus.cc:606] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:08.454468 17980 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.466854 18024 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.438525 17946 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.400796 17979 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.511379 18035 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.512320 12611 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:08.386833 17918 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.426540 17854 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.433121 17927 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:08.418606 17954 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:08.421697 18026 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.406239 17901 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.465986 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.531895 12013 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.411995 17898 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.466964 11948 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:08.470248 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:08.470904 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.533980 11865 raft_consensus.cc:3060] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.534042 12014 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:08.468431 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.406605 17968 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:08.541985 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 73720.7us
I20260709 12:12:08.483047 12018 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:08.482108 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.444346 17892 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.496516 11947 raft_consensus.cc:614] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:08.498656 17957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.007s	sys 0.028s
I20260709 12:12:08.501919 18033 consensus_queue.cc:1243] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:08.466892 17899 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:08.564373 12016 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:08.515295 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:08.472076 17592 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.425659 17945 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.482057 17983 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.537168 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:08.511379 17946 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.519944 17979 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.593307 11865 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:08.543794 12577 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:08.554090 17892 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.548873 17954 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:08.541446 17927 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:08.572443 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.577368 11940 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:08.577590 12602 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:08.579842 12013 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:08.491509 17965 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:08.553799 17957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.008s	sys 0.028s
W20260709 12:12:08.595652 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51992.8us
I20260709 12:12:08.527398 17987 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.552829 18039 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:08.599866 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.525406 17854 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.549201 17901 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:08.599288 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 197486us
I20260709 12:12:08.585556 17592 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.562475 17973 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
W20260709 12:12:08.610354 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 73363us
I20260709 12:12:08.613049 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:08.560441 17918 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.563047 17867 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:12:08.602807 18035 raft_consensus.cc:2804] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:08.621794 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 209127us
I20260709 12:12:08.541139 18026 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.629130 12013 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:08.586694 17975 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:08.707389 12015 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:08.654683 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:08.678267 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 277592us
I20260709 12:12:08.591923 17588 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.614391 18033 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:08.615095 17898 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.612291 17997 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:08.701277 11868 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:08.729475 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 74935.9us
I20260709 12:12:08.743029 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:08.743309 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:08.730751 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.744251 11940 raft_consensus.cc:606] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:08.744835 11940 raft_consensus.cc:614] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.736256 17945 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.737316 17968 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.703826 18039 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:08.766301 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.698482 17973 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.711494 18035 raft_consensus.cc:697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:08.617035 17904 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.754088 17954 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:08.792564 18041 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:12:08.741793 17978 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.749825 17870 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:08.771828 18019 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.796263 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:08.819752 11945 raft_consensus.cc:606] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:08.820225 11945 raft_consensus.cc:614] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.794210 18026 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:08.818238 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 115965us
W20260709 12:12:08.823596 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 210633us
I20260709 12:12:08.829270 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.784101 17879 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.783833 18039 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:08.831190 17976 consensus_meta.cc:287] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.001s
I20260709 12:12:08.853756 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:08.854722 12013 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.854904 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.855613 12017 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:08.855872 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.835695 17588 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.837265 17870 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.875540 11946 raft_consensus.cc:2410] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 for term 22 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
W20260709 12:12:08.839956 18046 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:08.821692 18019 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:08.784935 17922 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:12:08.850399 17965 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.856092 12013 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.835881 17973 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:08.856791 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.853585 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.769171 17997 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:08.838891 18044 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:12:08.878647 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.822067 17963 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.774327 17927 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.879875 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.886732 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.900632 12018 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:08.874962 17879 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:08.885511 18019 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.912576 12019 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
W20260709 12:12:08.882937 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49180.7us
I20260709 12:12:08.925308 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.925922 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.900116 17986 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.898346 17588 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:08.926734 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 160539us
I20260709 12:12:08.932581 11914 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:08.874043 17867 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:08.882236 18026 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:08.930184 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50410.2us
I20260709 12:12:08.940150 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.944931 12018 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:08.932492 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.948642 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:08.884353 18058 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:12:08.952193 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.966188 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:08.967694 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:08.968400 12018 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.908591 17976 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:08.962510 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.975132 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.976179 11871 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:08.980290 11866 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:12:08.980903 11866 pending_rounds.cc:85] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:12:08.981186 11866 pending_rounds.cc:107] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:12:08.924647 17963 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.981492 11866 raft_consensus.cc:2889] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.931697 17987 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.911934 18057 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:12:08.983022 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.937510 18061 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.936959 18050 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:08.983819 11865 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:08.925422 17980 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.961790 17968 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:08.994084 11864 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:08.971882 17978 raft_consensus.cc:2804] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:08.939694 17588 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.008682 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.021207 11872 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.913110 18035 consensus_queue.cc:237] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:08.939564 18033 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:08.971544 17901 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:08.971395 17854 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:08.951931 18026 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.936403 17986 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:08.985260 17981 consensus_queue.cc:1059] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:12:09.008334 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:08.985088 17918 consensus_queue.cc:1048] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:12:09.039853 18064 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.040832 18064 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.021680 17920 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:08.943430 18039 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.011765 17946 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:09.004220 18051 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:09.025756 17978 raft_consensus.cc:697] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:09.068892 17978 consensus_queue.cc:237] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.062109 17920 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.071132 17588 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.022912 18053 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:09.080508 12018 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:09.082998 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.085062 11872 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:09.030339 18057 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:12:09.119040 17899 consensus_meta.cc:287] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:12:09.119639 17899 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:09.120754 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 158377us
I20260709 12:12:09.014561 18050 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.122885 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:09.123996 18066 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:12:09.126861 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.132305 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 183705us
W20260709 12:12:09.127600 17932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.009s	sys 0.010s
I20260709 12:12:09.155447 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.156239 11943 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:09.158605 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 182297us
I20260709 12:12:09.159847 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.160482 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:09.162442 11940 raft_consensus.cc:606] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:09.137234 17997 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.173890 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:09.155112 17932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.009s	sys 0.011s
I20260709 12:12:09.175828 11988 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.178330 17870 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:09.181419 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:09.183784 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.195185 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.196455 17918 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:09.196973 17918 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.143826 17588 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:12:09.197979 17918 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.147872 17854 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:12:09.238713 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.251518 11947 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:09.239398 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.252645 11944 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:09.239805 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.243502 11943 raft_consensus.cc:2468] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
W20260709 12:12:09.194794 11839 connection.cc:256] RPC call timeout handler was delayed by -1.1484600869998758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260709 12:12:09.237149 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.198946 17904 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.261183 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.261443 11944 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:12:09.259793 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.214049 17979 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:09.246552 17899 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:09.270108 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 118897us
I20260709 12:12:09.234912 18033 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.276083 12611 raft_consensus.cc:1240] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.257895 17963 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.283109 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.283342 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.283849 11947 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.278113 12577 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:09.267856 17980 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.286338 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.342370 11940 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.266157 17920 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.270221 17932 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:09.269969 17979 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.267594 18065 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:09.360852 11947 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:09.329071 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.333436 18034 raft_consensus.cc:993] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
W20260709 12:12:09.337406 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 59559.6us
I20260709 12:12:09.366554 18034 raft_consensus.cc:1081] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:09.329218 17927 raft_consensus.cc:2804] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.341677 18026 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.279948 18033 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.344419 17986 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.396986 18057 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:09.397433 18057 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.397862 18057 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:09.401837 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72975us
I20260709 12:12:09.390492 18050 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.391469 18033 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.391810 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:09.406255 18024 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:09.406356 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:09.406953 18024 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:09.407922 18024 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.408985 17965 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:09.409257 17987 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:09.410609 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:09.394019 17922 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:09.412035 17922 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:09.412482 17922 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:09.413738 12014 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:09.413585 17922 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.392172 18019 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:09.403502 17592 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.004s
I20260709 12:12:09.409045 18024 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:09.409689 17965 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.393252 18069 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:09.411391 12016 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:09.424182 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.414881 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.426370 11940 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:09.343665 17973 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.395754 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.496471 12017 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 14: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:09.345842 17981 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:09.420236 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.415212 17922 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.417840 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.471324 18089 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.431128 11839 leader_election.cc:400] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13.
W20260709 12:12:09.513876 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82967.6us
W20260709 12:12:09.437316 18043 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.932s	user 0.006s	sys 0.007s
I20260709 12:12:09.422983 17592 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.428148 12014 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:09.449100 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.371867 18065 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.517446 17901 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:09.517704 11870 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:09.518353 17901 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.519414 18065 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.402164 17927 raft_consensus.cc:697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:09.519358 17901 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.520742 17927 consensus_queue.cc:237] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.516058 17945 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:09.524534 17945 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:09.363976 17932 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.525028 17592 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.362188 17979 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:09.439007 18085 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:12:09.508450 17973 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.526994 17932 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.444805 11946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43956 (request call id 1224) took 1195 ms. Trace:
I20260709 12:12:09.423245 17965 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.429864 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.421970 18026 consensus_queue.cc:1059] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:12:09.504701 17981 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:09.471032 18019 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.491832 17968 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.411396 18033 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:12:09.507426 18057 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.532009 11946 rpcz_store.cc:276] 0709 12:12:08.249124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.249290 (+   166us) service_pool.cc:224] Handling call
0709 12:12:09.444506 (+1195216us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54002b3754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:09.444713 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437223168}
I20260709 12:12:09.539294 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.539721 18057 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.527527 18089 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.541126 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.525444 17945 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.532567 18026 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.544250 18026 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.545080 18026 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:09.512508 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94737.6us
W20260709 12:12:09.516245 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.534003 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:09.505167 18068 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:09.488623 17892 consensus_meta.cc:287] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.874s	user 0.015s	sys 0.000s
I20260709 12:12:09.541512 18061 raft_consensus.cc:3055] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.551213 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.551738 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.552531 11869 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.571262 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.572096 11873 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:09.552929 12022 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.553200 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.573660 12019 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:09.542320 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.575868 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:09.511792 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 91648.8us
I20260709 12:12:09.579696 11947 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.566697 11870 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:09.580245 11870 pending_rounds.cc:85] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 10
I20260709 12:12:09.580487 11870 pending_rounds.cc:107] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:09.580714 11870 raft_consensus.cc:2889] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.580811 11944 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:12:09.565569 11864 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:09.583353 11947 raft_consensus.cc:1240] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:09.584638 12014 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:12:09.535611 18086 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:12:09.588449 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.590847 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.592062 11947 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.595841 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.546347 18026 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.596629 11946 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:09.532770 17981 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.597707 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:09.542192 18089 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.532249 17973 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.543059 18092 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.600864 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:09.534732 17968 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.612471 12019 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.600028 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.568148 17932 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.604260 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.584010 17985 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.603400 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:09.618453 12014 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:09.569136 18061 raft_consensus.cc:740] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.615998 11839 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:09.542579 18024 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:12:09.632278 11839 leader_election.cc:403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:12:09.622470 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.632918 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.564206 18033 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:12:09.600011 18054 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:09.610949 17991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.013s	sys 0.021s
I20260709 12:12:09.650417 11948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2443) took 1454 ms. Trace:
I20260709 12:12:09.652271 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.577193 17892 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.612136 17592 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.611954 18092 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.629663 17854 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.652599 11948 rpcz_store.cc:276] 0709 12:12:08.195888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.201726 (+  5838us) service_pool.cc:224] Handling call
0709 12:12:08.202157 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.533339 (+331182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.650068 (+1116729us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54003881d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:09.650331 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600859392}
I20260709 12:12:09.658488 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.598747 18065 consensus_queue.cc:1059] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:12:09.660262 12019 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:09.642164 11940 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.635218 17886 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.702328 12607 raft_consensus.cc:2393] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 12: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
W20260709 12:12:09.650715 17991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.014s	sys 0.021s
I20260709 12:12:09.699362 11940 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:09.637228 18089 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:09.608590 11947 raft_consensus.cc:2468] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:09.698005 11864 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:09.704172 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.705065 11940 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.742875 11940 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.629951 17932 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.735970 11870 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.653861 18051 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:12:09.747402 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.750202 11864 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.673285 17854 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:09.705055 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 52862.5us
I20260709 12:12:09.673738 18092 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.658267 18024 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 12:12:09.760476 18099 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:09.761703 12608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 701) took 1363 ms. Trace:
I20260709 12:12:09.762156 12608 rpcz_store.cc:276] 0709 12:12:08.398605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.403188 (+  4583us) service_pool.cc:224] Handling call
0709 12:12:09.761458 (+1358270us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540087fad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:09.761620 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677344000}
W20260709 12:12:09.762593 18097 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:12:09.673942 17592 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.666848 18064 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.759102 11870 raft_consensus.cc:2468] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 13.
I20260709 12:12:09.759181 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.755056 17854 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.771361 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.768911 11940 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:09.770533 11873 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:12:09.773413 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.773613 18001 consensus_queue.cc:1059] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 12:12:09.774502 18091 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:09.774585 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.775784 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.776410 11869 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:09.777308 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.778465 11864 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:09.779244 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.779778 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:09.782243 18100 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:12:09.784343 17932 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.785867 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.786270 17892 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.786496 11864 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 11.
I20260709 12:12:09.788736 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.789019 11869 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:09.789479 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3216) took 1363 ms. Trace:
I20260709 12:12:09.789819 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.789945 12021 rpcz_store.cc:276] 0709 12:12:08.426137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.426970 (+   833us) service_pool.cc:224] Handling call
0709 12:12:08.427365 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.514035 (+ 86670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.514068 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.514110 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:08.514141 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.789278 (+1275137us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b540035be54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:09.789320 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.789429 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198769536}
I20260709 12:12:09.790520 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:09.790904 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.791621 11864 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:09.773237 18076 consensus_queue.cc:1059] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 12:12:09.791837 17892 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.792326 17892 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:09.792507 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.792703 17892 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.793804 11939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2441) took 1607 ms. Trace:
I20260709 12:12:09.794991 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:09.788805 12607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41008 (request call id 700) took 1391 ms. Trace:
I20260709 12:12:09.789961 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:09.797811 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.747231 18089 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.799247 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.797188 12607 rpcz_store.cc:276] 0709 12:12:08.397863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.398278 (+   415us) service_pool.cc:224] Handling call
0709 12:12:09.788629 (+1390351us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000dcfd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:09.788750 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2965378944}
I20260709 12:12:09.800284 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.800896 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.801716 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.794147 11939 rpcz_store.cc:276] 0709 12:12:08.186270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.186447 (+   177us) service_pool.cc:224] Handling call
0709 12:12:08.187056 (+   609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.187602 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.187653 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.210412 (+ 22759us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.521780 (+311368us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:08.870999 (+349219us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.793249 (+922250us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b180002dd00. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287
0709 12:12:09.793384 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.793457 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.793502 (+    45us) raft_consensus.cc:1685] finished
0709 12:12:09.793612 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.793745 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12338,"prepare.queue_time_us":413591,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":41762,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":5451,"spinlock_wait_cycles":22129408,"thread_start_us":705211,"threads_started":3,"wal-append.queue_time_us":411059}
I20260709 12:12:09.802771 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.804301 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.804649 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.804896 11947 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:09.805168 11869 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.806705 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:09.807181 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.807601 11944 raft_consensus.cc:1240] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:12:09.807871 11941 raft_consensus.cc:2393] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:09.806811 11946 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.767875 17983 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:09.807911 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:09.809365 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.813184 11948 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:09.809736 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.814368 11947 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:09.812290 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.814886 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.815276 11870 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:09.803519 17898 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.818600 11947 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 16. Ops: [12.8-14.9]
I20260709 12:12:09.819329 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:09.803612 17916 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:09.820014 11940 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:09.813498 11944 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:09.794237 18068 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:09.824826 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.825562 11944 raft_consensus.cc:2393] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:09.821837 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.826224 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:09.819399 17983 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.829294 17983 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.829701 18098 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.830193 18098 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.832226 18098 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:09.835521 18101 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:12:09.839066 17592 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.813503 18033 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.845221 11869 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:09.856324 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:09.862241 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:09.864434 11869 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:12:09.868248 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:09.871093 18098 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:09.871443 18077 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.520s	user 0.003s	sys 0.000s
I20260709 12:12:09.871624 18098 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:09.872051 18098 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.856676 18033 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:09.873730 18081 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.601s	user 0.002s	sys 0.000s
I20260709 12:12:09.874547 18033 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:09.875336 18084 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.507s	user 0.000s	sys 0.002s
I20260709 12:12:09.875432 11942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1226) took 1454 ms. Trace:
I20260709 12:12:09.875937 11942 rpcz_store.cc:276] 0709 12:12:08.421526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.434237 (+ 12711us) service_pool.cc:224] Handling call
0709 12:12:08.434678 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.435252 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:08.750413 (+315161us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.087538 (+337125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.097610 (+ 10072us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.097896 (+   286us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:09.097955 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.098067 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.870872 (+772805us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:12:09.875098 (+  4226us) raft_consensus.cc:1685] finished
0709 12:12:09.875215 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.875379 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148,"prepare.queue_time_us":447332,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":606,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":38758,"spinlock_wait_cycles":39849344,"thread_start_us":600907,"threads_started":2,"wal-append.queue_time_us":504127}
I20260709 12:12:09.875273 18033 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:12:09.879446 18088 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.513s	user 0.000s	sys 0.002s
I20260709 12:12:09.881807 17987 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:12:09.884812 18075 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.556s	user 0.001s	sys 0.000s
I20260709 12:12:09.886329 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:09.886940 12611 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
I20260709 12:12:09.847950 18068 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.888906 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:09.890483 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:09.892616 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:09.900337 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:09.864349 18089 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.904193 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:09.890481 17975 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.923746 17854 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.903318 17965 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.905238 18042 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:09.919979 17981 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.934296 17981 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.906724 17973 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.934986 17973 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.935402 17973 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.911360 17979 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.940284 12016 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.941612 17979 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:09.926412 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.931571 18024 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:09.931845 18098 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.948189 17975 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.949076 17978 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.951329 18092 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.957511 11946 raft_consensus.cc:1240] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:09.929067 18033 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.952741 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:09.953472 18024 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.961292 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 2361) took 1109 ms. Trace:
W20260709 12:12:09.961441 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 328575us
W20260709 12:12:09.986742 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.927425 18082 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:09.962033 17904 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.989524 18024 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:09.947556 18042 raft_consensus.cc:2764] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:09.989737 17904 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.990247 17904 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.990367 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3217) took 1563 ms. Trace:
I20260709 12:12:09.986941 12020 rpcz_store.cc:276] 0709 12:12:08.852308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.852574 (+   266us) service_pool.cc:224] Handling call
0709 12:12:08.853010 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:08.874644 (+ 21634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.874797 (+   153us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:09.442167 (+567370us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:12:09.442936 (+   769us) log.cc:844] Serialized 52 byte log entry
0709 12:12:09.565455 (+122519us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:09.616518 (+ 51063us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.960742 (+344224us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b1800433a80. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:12:09.960940 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.961016 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.961065 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:09.961081 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.961220 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53969,"prepare.queue_time_us":36924,"raft.queue_time_us":367134,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":21381,"spinlock_wait_cycles":47687424,"thread_start_us":121972,"threads_started":1,"wal-append.queue_time_us":170709}
I20260709 12:12:09.990758 12015 rpcz_store.cc:276] 0709 12:12:08.426484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.427596 (+  1112us) service_pool.cc:224] Handling call
0709 12:12:08.427904 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.707906 (+280002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.990091 (+1282185us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002675d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:09.990303 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626902784}
I20260709 12:12:09.992503 17965 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:09.993224 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.962625 17886 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:09.993659 17975 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.994081 17975 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.994318 18098 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.994449 17975 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.994450 17886 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.963613 18001 raft_consensus.cc:3055] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.997720 18001 raft_consensus.cc:740] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:09.966320 18074 log.cc:927] Time spent T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.601s	user 0.004s	sys 0.000s
I20260709 12:12:09.998498 17854 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.999670 18027 raft_consensus.cc:3055] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.000062 18027 raft_consensus.cc:740] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:10.000798 18027 consensus_queue.cc:260] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:10.001611 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 48984.6us
I20260709 12:12:10.002398 11914 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:10.003521 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:10.005589 12013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 2373) took 1135 ms. Trace:
I20260709 12:12:10.005972 12013 rpcz_store.cc:276] 0709 12:12:08.870363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.928831 (+ 58468us) service_pool.cc:224] Handling call
0709 12:12:08.929165 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.937809 (+  8644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.937877 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.944297 (+  6420us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.185679 (+241382us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:09.235167 (+ 49488us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.240440 (+  5273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.240560 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.965746 (+725186us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:12:10.005263 (+ 39517us) raft_consensus.cc:1685] finished
0709 12:12:10.005365 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.005507 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19616,"prepare.queue_time_us":49259,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2207,"raft.queue_time_us":12497,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":13502,"spinlock_wait_cycles":11414784,"thread_start_us":190425,"threads_started":1,"wal-append.queue_time_us":388910}
I20260709 12:12:10.006395 17892 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:09.967641 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.009142 12602 raft_consensus.cc:1240] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.970916 17973 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.009423 11872 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:09.980008 18061 consensus_queue.cc:260] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:10.010443 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.010998 17973 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:09.981953 17968 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.013789 17968 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.014005 17975 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:09.985980 18092 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.041649 11939 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:10.018452 11872 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 22.
I20260709 12:12:10.027594 11837 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:10.042354 12610 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:10.029783 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.032248 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.046479 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.047341 11873 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.053231 12015 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:10.059443 11986 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:10.061314 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.063293 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:10.014134 18109 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.159s	user 0.001s	sys 0.003s
I20260709 12:12:10.079221 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.079260 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:10.081077 12021 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:10.094100 11941 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.083215 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.084784 12019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:10.084646 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.097764 12019 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:10.082018 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:10.098297 12019 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.989447 17879 raft_consensus.cc:3055] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.103565 11942 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:12:10.010896 18061 raft_consensus.cc:3060] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.103991 11942 pending_rounds.cc:85] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 8
I20260709 12:12:10.111804 11942 pending_rounds.cc:107] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:12:10.112104 11942 raft_consensus.cc:2889] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.113160 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:10.114837 11942 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:10.104517 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.104427 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:10.116729 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53548.9us
I20260709 12:12:10.114850 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.117740 11839 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.119793 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:10.114230 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.123256 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.044284 17892 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.127182 12015 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:10.127754 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.048992 18098 raft_consensus.cc:2804] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:10.049834 17991 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:10.049162 17973 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:10.169528 11948 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:10.155395 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.158633 11940 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:10.161873 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.171535 12021 raft_consensus.cc:3060] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.142175 12019 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.184147 17904 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.127406 18092 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.169374 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.118650 18027 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.103823 17879 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:10.127559 17881 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.213701 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.186730 18065 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:10.185875 17991 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:10.227537 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.231894 12021 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:10.235255 11865 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.998595 18001 consensus_queue.cc:260] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.237731 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:10.239163 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3189) took 1806 ms. Trace:
I20260709 12:12:10.241832 11868 rpcz_store.cc:276] 0709 12:12:08.426730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.426908 (+   178us) service_pool.cc:224] Handling call
0709 12:12:08.446517 (+ 19609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.741931 (+295414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.233223 (+1491292us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54003af054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:10.233408 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585382784}
I20260709 12:12:10.214718 18033 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:10.264797 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 85397.6us
I20260709 12:12:10.267172 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.265398 12019 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.273346 11865 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:10.251672 11941 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
W20260709 12:12:10.282656 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 81039.5us
W20260709 12:12:10.241962 17954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.439s	user 0.011s	sys 0.004s
I20260709 12:12:10.238490 17991 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:10.286262 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.288800 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.284165 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.289417 11872 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 12.
I20260709 12:12:10.240046 18098 raft_consensus.cc:697] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:10.344178 18019 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.344761 18019 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.281754 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:10.288583 17954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.013s	sys 0.004s
I20260709 12:12:10.292582 17658 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:10.292883 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.346607 11865 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:10.300961 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:10.347507 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46633.2us
I20260709 12:12:10.348441 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.277194 18001 raft_consensus.cc:3060] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.303069 18049 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:10.304243 18113 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:12:10.304750 17854 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.317209 18079 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:12:10.318454 18112 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:10.326043 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.335723 18060 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:10.276044 17932 consensus_queue.cc:1059] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 12:12:10.352723 18094 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:10.302343 18052 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.266286 18033 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.234748 18065 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:10.266064 17973 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:10.282975 17892 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:10.285100 18092 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.285506 17879 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.361872 18060 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.345264 18098 consensus_queue.cc:237] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.374415 18065 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.360496 18049 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.443310 11866 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:10.444406 18049 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:10.446280 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.358107 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.447135 11872 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.447587 11873 raft_consensus.cc:2468] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:10.338481 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.282137 17881 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:12:10.356745 17854 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.441443 17892 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:10.420037 17973 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.455189 11873 raft_consensus.cc:1275] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:12:10.378892 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.355260 17975 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.355572 17983 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:10.472152 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.372205 18033 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:10.428892 18113 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:10.474783 11866 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:10.482836 11866 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:10.435587 17904 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:10.434259 18019 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.473032 17982 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:10.455987 17854 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.363215 18079 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.474546 17922 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.458954 18091 consensus_queue.cc:1059] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:12:10.526912 11870 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:10.503679 11872 raft_consensus.cc:2468] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
W20260709 12:12:10.506345 12014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.025s
I20260709 12:12:10.510905 12015 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:12:10.540580 12015 pending_rounds.cc:85] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 11
I20260709 12:12:10.541013 12015 pending_rounds.cc:107] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:12:10.541280 12015 raft_consensus.cc:2889] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:10.540555 12014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.025s
W20260709 12:12:10.544103 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 424352us
I20260709 12:12:10.521209 17922 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:10.552749 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 383452us
I20260709 12:12:10.557498 11939 raft_consensus.cc:1275] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:10.559804 11988 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.026s	sys 0.051s
W20260709 12:12:10.561980 11988 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.027s	sys 0.051s
W20260709 12:12:10.562259 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 548538us
W20260709 12:12:10.562806 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.563221 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.565013 12019 raft_consensus.cc:1275] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:10.533154 17892 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.563517 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.570495 12017 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:10.554350 18057 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:10.578393 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.579669 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:10.579901 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:10.581969 12017 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:10.584213 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:10.585075 12019 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.588230 11939 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:10.596516 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:10.599741 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.602440 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.602823 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.604226 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.605230 12022 raft_consensus.cc:2410] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:12:10.608115 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.593717 17886 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:10.620055 18120 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:12:10.570988 18069 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:12:10.571583 17592 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:12:10.618913 18115 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:10.610247 17881 consensus_queue.cc:1059] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
W20260709 12:12:10.603588 18118 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:10.618456 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.605052 18019 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.602567 17901 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.576081 18073 consensus_queue.cc:1059] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:12:10.623802 12019 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:10.600452 17958 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:10.592932 17997 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:12:10.623036 18060 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.593571 18057 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.656041 18127 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.662053 17922 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.635529 18019 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:10.662990 18125 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:12:10.664587 18019 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.638571 17958 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:10.667265 18122 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:12:10.632824 17932 raft_consensus.cc:3055] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:10.664762 18092 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:10.664680 18117 log.cc:927] Time spent T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:12:10.662043 18121 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:10.656635 17658 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.669107 18069 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.668804 17958 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.671257 17932 raft_consensus.cc:740] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:10.673079 18131 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:10.714756 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 136423us
I20260709 12:12:10.716727 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.687450 18069 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.686331 17658 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.720109 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.728991 11988 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:10.741286 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.723794 17886 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.723635 18069 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.746372 12014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3239) took 1136 ms. Trace:
I20260709 12:12:10.722954 17658 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:10.747668 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 139663us
I20260709 12:12:10.742012 18073 raft_consensus.cc:2764] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:10.755529 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:10.722092 18131 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.787496 18131 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.801189 17982 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:10.801802 17982 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.758124 11947 raft_consensus.cc:1240] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:10.818691 18149 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:10.764806 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:10.820909 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56196.8us
I20260709 12:12:10.822851 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.767011 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.766342 12014 rpcz_store.cc:276] 0709 12:12:09.609598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.619302 (+  9704us) service_pool.cc:224] Handling call
0709 12:12:09.619618 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:09.961092 (+341474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:09.961126 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.961637 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.545399 (+583762us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:10.545455 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.545556 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.746046 (+200490us) raft_consensus.cc:1685] finished
0709 12:12:10.746090 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.746288 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341022,"raft.queue_time_us":341242,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":583385,"threads_started":1,"wal-append.queue_time_us":597285}
I20260709 12:12:10.823673 17954 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.824069 17954 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.824438 17954 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.825686 18057 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.769888 17898 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:10.827658 17898 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.828099 17898 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.828402 18061 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.828825 18061 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:10.829174 18061 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.763679 18053 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.831369 18053 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.765277 18150 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:12:10.754846 17932 consensus_queue.cc:260] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.757313 17970 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:12:10.775805 12577 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:10.776480 17991 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.778203 18068 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.779036 18144 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.781797 12016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 2376) took 1503 ms. Trace:
W20260709 12:12:10.825942 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.772214 18132 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:10.849416 12016 rpcz_store.cc:276] 0709 12:12:09.278608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.425136 (+146528us) service_pool.cc:224] Handling call
0709 12:12:09.425432 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.940695 (+515263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.781566 (+840871us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54003039d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:10.781735 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183524096}
W20260709 12:12:10.833621 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 66747.2us
I20260709 12:12:10.833987 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.834599 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.848204 18060 raft_consensus.cc:2804] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:10.873179 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.882550 18060 raft_consensus.cc:697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:10.839563 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 63831.7us
I20260709 12:12:10.883657 11868 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:10.883863 18060 consensus_queue.cc:237] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.885236 18131 consensus_queue.cc:1048] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.886052 18027 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:10.886420 11866 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:10.886837 18152 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:10.887387 18131 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.875790 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:10.878854 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.889680 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.873464 18091 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.891939 18091 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.892973 18146 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.893710 18146 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.894552 18091 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.895126 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:10.895721 11871 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 22.
I20260709 12:12:10.895821 18001 raft_consensus.cc:3055] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.896221 18001 raft_consensus.cc:740] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:10.896643 18146 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.898952 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.899255 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.861738 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:10.862531 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.885365 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:10.902882 12602 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.903313 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.832237 17954 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.907675 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.909026 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.903316 12602 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:10.904829 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:10.887493 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:10.912773 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 78861.2us
I20260709 12:12:10.914584 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:10.935535 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.940544 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:10.912227 12602 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.942032 12602 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.943090 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.942603 17968 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.878459 17854 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.945104 18131 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.946063 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:10.946652 17854 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:10.944525 17978 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:10.948932 17978 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:10.950045 17978 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.955292 11864 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.958243 11939 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:10.960238 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:10.963099 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.942618 12015 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.969947 11946 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:10.872116 17991 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:10.897022 18001 consensus_queue.cc:260] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:10.928495 18089 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:10.939648 18154 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:12:11.002578 12602 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
W20260709 12:12:10.974634 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56355us
I20260709 12:12:10.976454 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:11.003351 11941 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:12:10.937026 18057 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.862301 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:10.989786 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.992122 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.992401 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:10.876053 18092 consensus_queue.cc:1059] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:12:11.002316 11914 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:10.840891 18065 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.943840 18144 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.965991 18061 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:10.966856 17918 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.009332 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:10.938426 17970 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:12:10.938127 17997 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:12:10.977798 17968 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.999291 17973 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.037519 18152 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:10.943696 18033 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.040733 11986 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:11.012812 18082 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.045161 11867 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.998862 17904 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:12:11.082104 11944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2476) took 1006 ms. Trace:
I20260709 12:12:11.041210 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:11.030974 18001 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.004917 17916 consensus_queue.cc:1048] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:12:11.085285 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44156us
W20260709 12:12:11.087353 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51772.4us
I20260709 12:12:11.021762 17958 consensus_queue.cc:1059] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:12:11.122124 18153 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:12:11.122536 18151 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.289s	user 0.003s	sys 0.000s
I20260709 12:12:11.082666 11944 rpcz_store.cc:276] 0709 12:12:10.076109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.076669 (+   560us) service_pool.cc:224] Handling call
0709 12:12:10.077003 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:10.110711 (+ 33708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.110742 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:10.111350 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 12:12:10.558441 (+447091us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:10.655121 (+ 96680us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.669586 (+ 14465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.669675 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.081828 (+412153us) raft_consensus.cc:1685] finished
0709 12:12:11.081858 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.082031 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74019,"prepare.queue_time_us":103677,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":32930,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":66123,"thread_start_us":420108,"threads_started":2,"wal-append.queue_time_us":463873}
I20260709 12:12:11.043699 18146 raft_consensus.cc:2804] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:11.025029 17982 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.104532 11940 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:11.026535 17892 consensus_queue.cc:1048] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:11.031378 17978 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:12:11.152360 18065 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.153910 18061 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:11.099939 18144 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.042750 17968 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.081588 18082 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.159122 18150 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.155095 17886 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:11.127998 17658 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.171522 18144 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:11.228034 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 187393us
W20260709 12:12:11.242875 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.194162 18133 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.261133 11867 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
W20260709 12:12:11.261088 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 159957us
I20260709 12:12:11.219142 18150 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.239077 18144 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.276937 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:11.237412 17954 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.241145 17879 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.303690 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:11.268704 17916 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:11.309088 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:11.297827 17592 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:11.311815 17916 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.310611 18129 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.307988 17987 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.271878 18133 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:11.310050 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 271849us
I20260709 12:12:11.373492 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.375062 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.379077 12018 raft_consensus.cc:1240] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19. Ops: [18.9-18.9]
W20260709 12:12:11.378959 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65995.6us
I20260709 12:12:11.379990 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.331069 17965 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:11.383304 12021 raft_consensus.cc:1240] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:11.384083 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:11.335880 18159 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 12:12:11.384478 12021 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:11.381861 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:11.388500 18158 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:12:11.389878 18164 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:12:11.378263 18156 log.cc:927] Time spent T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:12:11.336031 18174 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:11.389956 18161 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:12:11.394678 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.382645 17982 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.411631 17968 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:11.335484 18146 raft_consensus.cc:697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:11.406276 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:11.408547 18169 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:12:11.413952 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:11.386631 17965 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.416625 11947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49986 (request call id 2480) took 1335 ms. Trace:
I20260709 12:12:11.385663 18092 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:11.419831 11947 rpcz_store.cc:276] 0709 12:12:10.080947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.113998 (+ 33051us) service_pool.cc:224] Handling call
0709 12:12:10.114355 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.817811 (+703456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.416391 (+598580us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540037ffd4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:11.416558 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480071040}
I20260709 12:12:11.420843 12014 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:11.429466 18173 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:12:11.430616 18162 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 12:12:11.435851 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.405997 18042 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.442994 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.443414 12014 raft_consensus.cc:1240] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 16. Ops: []
I20260709 12:12:11.415156 18174 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.452312 18174 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:11.452713 18146 consensus_queue.cc:237] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.441674 18092 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.455461 18092 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.456207 18133 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.456369 17916 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.392814 18150 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.449865 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.426247 17965 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:11.464862 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:11.465654 11947 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.467444 11941 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:11.444303 18179 raft_consensus.cc:3055] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:11.498670 11943 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:11.504799 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:11.506498 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 64414.9us
I20260709 12:12:11.453365 18082 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.522064 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.522691 12020 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:11.524360 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:11.524904 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.525490 11873 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:11.526399 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:11.526881 11873 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.528434 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:11.528723 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:11.530000 12013 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:11.531513 11942 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:11.531873 11947 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:11.532975 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:11.535164 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.537336 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:11.503557 18179 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:11.540712 11868 raft_consensus.cc:1275] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:11.540565 11870 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:11.542649 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:11.542963 11988 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:11.543870 12022 raft_consensus.cc:1240] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.543970 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.544512 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:11.543226 11869 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.545171 11873 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
W20260709 12:12:11.548017 17898 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 12:12:11.548470 17898 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.549710 18170 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:12:11.551633 18180 log.cc:927] Time spent T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:12:11.553972 12604 raft_consensus.cc:2368] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:11.530246 17975 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.557754 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:11.540863 18177 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:12:11.545223 18069 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.000s
I20260709 12:12:11.538592 17916 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.567734 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:11.567919 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:11.570709 17975 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.576896 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39778 (request call id 793) took 1537 ms. Trace:
I20260709 12:12:11.538350 17798 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:11.591188 11865 rpcz_store.cc:276] 0709 12:12:10.039588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.351990 (+312402us) service_pool.cc:224] Handling call
0709 12:12:10.352298 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.530078 (+177780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.530116 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.813058 (+282942us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c000014c8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:12:10.813475 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.006433 (+192958us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:11.006534 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.576469 (+569935us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001b6054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:11.576528 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.576581 (+    53us) raft_consensus.cc:1685] finished
0709 12:12:11.576597 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.576819 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412192384,"thread_start_us":189746,"threads_started":1,"wal-append.queue_time_us":229348}
I20260709 12:12:11.558965 18174 raft_consensus.cc:2804] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.565551 18052 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:12:11.587306 17918 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.589150 17968 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:10.855847 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.566576 18042 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:11.592937 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.599040 11870 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:11.592267 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:11.600173 11947 raft_consensus.cc:2393] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:11.554051 18179 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.598487 17975 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.596118 17798 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.597262 17968 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:11.586547 11869 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:11.600951 18179 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.598027 18042 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.596347 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:11.594909 17976 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.589521 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:11.591092 18069 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.564216 18170 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:11.625674 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.635733 11870 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:11.624604 11869 raft_consensus.cc:1240] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:11.631256 17798 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:11.628422 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:11.619999 17954 consensus_queue.cc:1175] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "46f08e8ff3774f25acad18252e5cd57d" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 18 index: 11 } }
W20260709 12:12:11.643428 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.643800 17945 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:12:11.647126 18168 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 12:12:11.672293 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:11.648099 17965 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.650477 17991 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:11.626590 18174 raft_consensus.cc:697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.653748 17976 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:11.655031 18186 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:11.655429 18098 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:11.702467 18098 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.704758 18174 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.655968 18019 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:11.657213 18042 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.639523 18176 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:11.649366 18144 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.593825 17916 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.694805 17976 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.726824 17898 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:11.726974 17976 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.728432 17916 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.621435 18068 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.729243 18068 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.731547 18068 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.622762 17968 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.680984 12014 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:11.686679 18146 consensus_queue.cc:1048] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:12:11.688305 18170 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:11.692613 17991 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:11.734054 18001 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:11.734781 17991 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.732748 17968 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.736027 17991 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.736673 17968 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.737396 18069 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.740284 18069 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:11.740811 18069 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.692552 17886 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:12:11.745112 11944 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:11.715651 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.692503 17965 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.746258 11872 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:11.762442 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:11.762638 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.763554 11869 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:11.763937 11872 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:11.753850 18069 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.752806 18061 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:11.787201 11869 raft_consensus.cc:2468] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 23.
I20260709 12:12:11.757697 17965 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:11.753152 18150 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:11.769342 18176 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.800940 18176 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.810386 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.814013 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:11.817510 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 103187us
I20260709 12:12:11.821097 11870 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.792725 18061 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:11.825225 11941 raft_consensus.cc:1240] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:12:11.826087 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:11.827023 11939 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:11.828272 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:11.829170 11939 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:11.797067 17965 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.838222 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:11.839021 11865 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:11.863492 11870 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:11.862587 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:11.846421 18098 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.863323 18198 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:11.872476 18193 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:12:11.884059 18198 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.895696 18198 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:11.898180 18196 log.cc:927] Time spent T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:12:11.872126 17886 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.901927 17886 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.902565 17886 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.866319 18144 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:11.903335 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.867403 18200 consensus_queue.cc:1059] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:12:11.904613 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.874503 18024 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:11.905375 18024 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:11.906417 18024 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.907553 18024 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.909127 17965 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.916451 18061 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.874737 17798 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:12:11.922502 17798 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:11.922973 17879 consensus_meta.cc:287] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
I20260709 12:12:11.923107 17798 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.924448 17658 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.924612 17798 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.925671 18091 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.926702 17798 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.926465 18091 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.928104 11869 raft_consensus.cc:2410] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:11.929437 18174 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:11.930033 18174 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:11.929908 18079 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:11.930981 18174 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:11.932392 18174 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.910969 17901 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:12:11.957187 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.948348 18201 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:12:11.984629 18091 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:11.991425 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2392) took 2210 ms. Trace:
I20260709 12:12:11.991945 11864 rpcz_store.cc:276] 0709 12:12:09.780963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.773947 (+992984us) service_pool.cc:224] Handling call
0709 12:12:10.774254 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.959086 (+184832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.991200 (+1032114us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003af054. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:11.991363 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415932288}
I20260709 12:12:11.995920 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.000834 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.002429 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.002656 18091 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:12.003197 18091 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.006129 18091 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:12.002468 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.007395 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.011118 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.012512 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.013152 12014 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:12.014541 17976 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.016832 17976 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:12.018970 11940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43956 (request call id 1243) took 1036 ms. Trace:
I20260709 12:12:12.019393 11940 rpcz_store.cc:276] 0709 12:12:10.982876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.983368 (+   492us) service_pool.cc:224] Handling call
0709 12:12:11.022331 (+ 38963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.129086 (+106755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.018692 (+889606us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002e59d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:12.018903 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188328192}
I20260709 12:12:12.020843 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 959) took 1118 ms. Trace:
I20260709 12:12:12.021232 12604 rpcz_store.cc:276] 0709 12:12:10.902530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.903132 (+   602us) service_pool.cc:224] Handling call
0709 12:12:12.020646 (+1117514us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54005c99d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:12.020778 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399242624}
I20260709 12:12:12.022943 12608 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.025293 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.027442 11837 leader_election.cc:400] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:12.027796 11837 leader_election.cc:403] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.028579 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.028553 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:12.029875 12014 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:12.030555 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.033722 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:12.034257 11864 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:12.031795 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.035909 12014 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:12.038116 12013 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:12.039156 11873 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:12.040373 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.042701 17991 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.043489 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.042711 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.044275 12605 raft_consensus.cc:2393] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 15: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:12.045126 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.045429 11871 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.045791 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.046065 11945 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.046619 12022 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:12.045440 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.049211 17932 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.050186 17991 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:12.051426 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.051705 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.057752 12014 raft_consensus.cc:2410] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:12.063832 17927 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:12.064810 18165 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 1.093s	user 0.000s	sys 0.005s
I20260709 12:12:12.060621 11837 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:12.069700 17879 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.065892 11869 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:12:12.070984 11869 pending_rounds.cc:85] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 6
I20260709 12:12:12.071316 11869 pending_rounds.cc:107] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:12:12.071615 11869 raft_consensus.cc:2889] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.075297 17886 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.113395 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.114421 11868 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:12.115183 12020 raft_consensus.cc:2410] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:12:12.123633 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.129132 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:12.129899 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.130085 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.131016 11945 raft_consensus.cc:3060] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:12.131624 11873 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 12:12:12.135705 11873 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.131693 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.132591 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.132862 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:12.139264 11870 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:12.137028 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.141662 11873 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:12.143133 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.145673 11873 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:12.147740 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.131834 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:12.154536 12608 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:12.154557 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:12.129817 12017 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:12.175297 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.185060 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:12.185973 12022 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:12.187256 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:12.189371 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:12.189571 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.190037 11941 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.195866 11945 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:12.208206 11870 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:12.212924 11868 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:12.170923 17965 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:12:12.223918 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.186779 18033 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:12.245366 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 3235) took 1371 ms. Trace:
I20260709 12:12:12.245950 11867 rpcz_store.cc:276] 0709 12:12:10.873926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.875461 (+  1535us) service_pool.cc:224] Handling call
0709 12:12:12.245131 (+1369670us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003552d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:12.245272 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359750016}
I20260709 12:12:12.156219 17968 consensus_queue.cc:1059] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:12:12.276033 11945 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:12.281059 12022 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:12.288995 11941 raft_consensus.cc:2468] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:12.202508 18057 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 12:12:12.303488 18198 raft_consensus.cc:3055] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.237200 17965 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.322950 18144 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.323732 18144 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.326625 18144 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:12.321261 18128 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.327953 18198 raft_consensus.cc:740] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:12.335700 18198 consensus_queue.cc:260] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.334631 18128 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:12.345441 18203 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
W20260709 12:12:12.383080 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.386626 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 249225us
W20260709 12:12:12.387487 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 174389us
I20260709 12:12:12.395232 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:12.398243 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 210314us
I20260709 12:12:12.400926 12015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58674 (request call id 1280) took 1438 ms. Trace:
I20260709 12:12:12.401674 12015 rpcz_store.cc:276] 0709 12:12:10.962599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.997824 (+ 35225us) service_pool.cc:224] Handling call
0709 12:12:10.998198 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.196279 (+198081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.196327 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:12.009874 (+813547us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:12:12.010331 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.292698 (+282367us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:12.292743 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.292817 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.399713 (+106896us) raft_consensus.cc:1685] finished
0709 12:12:12.399787 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.400501 (+   714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8916,"raft.queue_time_us":30873,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6263,"spinlock_wait_cycles":48918400,"thread_start_us":468530,"threads_started":2,"wal-append.queue_time_us":321964}
I20260709 12:12:12.423312 18213 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.425004 18215 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:12.434016 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.450784 18214 consensus_queue.cc:1059] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:12:12.455513 17901 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.456823 17901 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.458938 18128 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.460879 18128 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.424891 18213 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.486259 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 78592us
W20260709 12:12:12.490810 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.495744 17886 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:12.503859 18073 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:12.504204 18069 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.505679 18069 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:12.507423 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.510012 18068 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.511101 18068 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:12.512393 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.517984 17968 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.518612 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:12.519218 17968 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.523249 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.526232 18061 consensus_queue.cc:1059] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:12.529011 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.532764 18091 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.518612 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.534487 18092 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.535032 18033 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.535595 18033 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:12.536015 18033 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.535678 18092 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.536347 17798 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:12.548676 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:12.540501 18214 raft_consensus.cc:3055] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:12.554452 18214 raft_consensus.cc:740] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:12.542308 18069 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:12.543138 17965 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:12.546510 17901 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:12.549468 17798 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.504587 18073 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:12.541350 18068 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:12.554612 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:12.557001 18198 raft_consensus.cc:3060] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.558182 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:12.561117 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.565233 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:12.566798 17968 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:12.567780 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.533949 18091 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.583438 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.584546 18214 consensus_queue.cc:260] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.586495 11839 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:12.588043 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:12.592860 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.594165 17965 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.599639 11912 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:12.600642 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:12.608304 11948 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:12.609555 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:12.611081 18092 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:12.636256 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.637492 18092 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.639760 18069 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:12.640250 17991 consensus_meta.cc:287] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.014s
I20260709 12:12:12.640563 18069 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.640926 17991 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:12.641235 18069 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:12.649051 18213 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:12.652829 18091 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:12.625192 17965 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:12.653699 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.654817 17965 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.656133 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.657773 11942 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.661679 18133 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.662504 18133 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:12.662299 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.663255 18133 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.664219 18146 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:12.664690 18146 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:12.665083 18146 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.666967 17978 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:12.671690 11945 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:12.672674 11914 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:12.674177 17978 raft_consensus.cc:2804] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:12:12.674425 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 74994.7us
I20260709 12:12:12.674886 17978 raft_consensus.cc:697] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:12.678164 18073 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.680311 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.676254 17978 consensus_queue.cc:237] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.688403 11769 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 17 to 18, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 18 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.699174 11769 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 16, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 16 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.701901 18214 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.701133 11769 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.708346 17798 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:12.708060 11769 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 16 to 17, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.709313 11988 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:12.732164 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 145835us
I20260709 12:12:12.719621 18073 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.728088 11942 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
W20260709 12:12:12.753144 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 80586.9us
W20260709 12:12:12.769604 11912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.712309 18146 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.774168 17886 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:12:12.779526 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:12.780594 11942 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:12.773144 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:12.782111 11946 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:12.773492 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:12.785631 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.787443 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.787747 17997 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.788314 17997 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.774083 11943 raft_consensus.cc:1240] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.788735 17997 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:12.789088 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.797235 17592 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.798189 17592 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:12.799412 17592 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.805716 17932 consensus_meta.cc:287] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.019s
I20260709 12:12:12.719363 17798 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:12:12.814337 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.816517 17968 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.817605 17968 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.820075 18176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.010s	sys 0.027s
W20260709 12:12:12.820616 18176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.010s	sys 0.027s
I20260709 12:12:12.822952 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:12.825605 18199 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.828116 17968 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:12.811721 18215 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.831823 18215 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.836818 11945 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:12.797199 11770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 227) took 18976 ms (client timeout 15000 ms). Trace:
I20260709 12:12:12.838723 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.785316 11769 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.772838 18061 consensus_queue.cc:1243] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:12.848126 17932 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:12.859894 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48669.4us
I20260709 12:12:12.865918 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.882623 11941 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:12.894304 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:12.895679 17965 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:12.896570 17965 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:12.898416 17965 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:12.902745 17898 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.903540 17898 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:12.893065 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 70359us
W20260709 12:12:12.914808 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 44892.9us
I20260709 12:12:12.909512 18033 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:12.921801 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 55997us
W20260709 12:12:12.922524 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.911108 18146 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:12.923535 17968 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.918156 17978 consensus_queue.cc:1059] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:12:12.926746 18061 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.936147 18198 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.944865 18200 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:12.944464 18198 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.945396 18200 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:12.945950 11939 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:12.949736 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.959089 18174 raft_consensus.cc:3055] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:12.963141 17968 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:12.841665 11770 rpcz_store.cc:269] 0709 12:11:53.820860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.821118 (+   258us) service_pool.cc:224] Handling call
0709 12:11:53.879094 (+ 57976us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99d090 00007f1f1ba3bf3a 00007f1f217f1e9c 00007f1f218f004e 00007f1f1fdb12a4 00007f1f1fdb1232 00007f1f1fdb1161 00007f1f1fdb10dc 00007f1f1fdb0392 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:12.796861 (+18917767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:05.541861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:05.575171 (+ 33310us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:05.575229 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:12:05.575259 (+    30us) tablet.cc:662] Decoding operations
0709 12:12:05.576739 (+  1480us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:05.576863 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:05.576907 (+    44us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:12:05.660516 (+ 83609us) tablet.cc:701] Row locks acquired
0709 12:12:05.660540 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:12:05.660717 (+   177us) write_op.cc:270] Start()
0709 12:12:05.660858 (+   141us) write_op.cc:276] Timestamp: P: 1783599125660667 usec, L: 0
0709 12:12:05.660883 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:05.703674 (+ 42791us) log.cc:844] Serialized 4393 byte log entry
0709 12:12:06.177161 (+473487us) op_driver.cc:464] REPLICATION: finished
0709 12:12:06.427318 (+250157us) write_op.cc:301] APPLY: starting
0709 12:12:06.429678 (+  2360us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:06.448511 (+ 18833us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b54003c4e54. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba3032a 00007f1f1b9b5f14 00007f1f1b9b5ec3 00007f1f1b9b5e38 00007f1f1b9b5df3 00007f1f1b9b50dc 00007f1f1b9dee16 00007f1f1b9c6cbb 00007f1f1b9b139d 00007f1f1b9b4d75
0709 12:12:06.939048 (+490537us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:06.945010 (+  5962us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:07.368311 (+423301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:07.463998 (+ 95687us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:12:07.464049 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:07.513875 (+ 49826us) log.cc:844] Serialized 105 byte log entry
0709 12:12:08.182146 (+668271us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f189290ac 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18945c02 00007f1f1b5cd20b
0709 12:12:08.622584 (+440438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.699202 (+ 76618us) write_op.cc:454] Released schema lock
0709 12:12:08.700893 (+  1691us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:08.734564 (+ 33671us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.734599 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":448798,"reported_tablets":51,"spinlock_wait_cycles":51888896,"child_traces":[["op",{"apply.queue_time_us":209997,"apply.run_cpu_time_us":66357,"apply.run_wall_time_us":2329601,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":273096,"prepare.run_cpu_time_us":23708,"prepare.run_wall_time_us":259916,"raft.queue_time_us":133215,"raft.run_cpu_time_us":52586,"raft.run_wall_time_us":327724,"replication_time_us":516044,"spinlock_wait_cycles":11873792,"thread_start_us":1594230,"threads_started":5,"wal-append.queue_time_us":1020868,"wal-append.run_cpu_time_us":25035,"wal-append.run_wall_time_us":2295721}]]}
I20260709 12:12:12.967332 18057 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:12.968936 18150 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.932643 11769 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 15, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.972973 18199 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:12.975768 18231 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:12.952946 18220 consensus_queue.cc:1059] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:12.986507 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 63287.3us
I20260709 12:12:12.984906 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:12.973937 18061 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:12.980245 11944 raft_consensus.cc:1217] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Deduplicated request from leader. Original: 16.7->[18.8-18.8]   Dedup: 18.8->[]
I20260709 12:12:12.997303 18199 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:12.990878 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.002372 11945 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:13.003243 11944 raft_consensus.cc:1240] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 12:12:12.978724 18200 raft_consensus.cc:3060] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.978926 18174 raft_consensus.cc:740] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.013101 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:12.978999 17898 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:13.017307 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 88797.1us
I20260709 12:12:12.995739 18033 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.018680 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.006012 11769 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:13.034313 18182 raft_consensus.cc:3055] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:13.033988 18061 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.034865 18182 raft_consensus.cc:740] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:13.036610 18229 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:12:13.006033 18199 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.019910 17932 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.036300 18182 consensus_queue.cc:260] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.043756 18214 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.018181 18057 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:13.066692 18235 log.cc:927] Time spent T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 12:12:13.066855 18227 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.064044 17997 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.068885 18233 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
I20260709 12:12:13.070196 18198 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.071074 17973 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:13.072044 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59101.7us
I20260709 12:12:13.073724 18215 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.079561 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:13.080564 18174 consensus_queue.cc:260] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.084672 17904 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.099542 11769 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:13.086374 18236 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260709 12:12:13.050053 18150 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.088210 18239 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 12:12:13.089047 18146 raft_consensus.cc:3055] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.089213 17991 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:13.122944 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 57444.3us
I20260709 12:12:13.124446 17658 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.125110 17658 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:13.125615 17658 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.127229 18146 raft_consensus.cc:740] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:13.092857 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.093497 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:13.096056 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.124507 12577 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.137475 12577 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:13.138521 17997 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.139890 18144 raft_consensus.cc:2804] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:13.140702 18144 raft_consensus.cc:697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:13.142088 17927 consensus_queue.cc:1059] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:13.143038 17927 consensus_queue.cc:1243] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 21.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:12:13.142267 18144 consensus_queue.cc:237] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.143692 17927 raft_consensus.cc:2804] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.109831 17904 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.144304 18220 raft_consensus.cc:3055] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:13.145267 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.146195 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.150954 18220 raft_consensus.cc:740] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:13.104956 18069 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.139887 17968 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:13.162371 12577 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.704s (SENT) [suppressed 6 similar messages]
I20260709 12:12:13.120980 17991 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.160782 11769 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 16, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 16 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.167162 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.170536 17904 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.149374 18198 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:13.187318 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 107915us
I20260709 12:12:13.189872 18220 consensus_queue.cc:260] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.191265 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.188118 18228 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:13.193730 18230 log.cc:927] Time spent T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.004s
W20260709 12:12:13.216267 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.156899 18073 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:13.201886 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:13.193779 17968 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.163625 17927 raft_consensus.cc:697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:13.182235 17798 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.128988 18146 consensus_queue.cc:260] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.166203 18174 raft_consensus.cc:3060] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.148749 18227 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.223099 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.224922 11988 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.598s (SENT)
I20260709 12:12:13.224154 11940 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:13.206169 18198 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:13.235150 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:13.233144 18244 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:12:13.248417 18246 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:12:13.235292 18198 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.256193 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:13.244903 11769 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 11, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.240885 18182 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.238224 18176 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.243657 18215 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.219223 18228 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.274029 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 69245.1us
I20260709 12:12:13.274528 18227 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.277487 17927 consensus_queue.cc:237] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.277776 11769 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 12 to 13, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.282217 18069 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.282406 17901 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.235555 17798 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.283933 17991 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.284631 18057 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.284937 17798 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.287001 18228 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:13.287773 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 86016.7us
W20260709 12:12:13.282246 18133 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.618s	user 0.016s	sys 0.001s
I20260709 12:12:13.290027 18133 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.291297 11947 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.292322 18133 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.236066 17968 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.294665 17968 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.295384 17932 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.295929 17932 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.299660 18220 raft_consensus.cc:3060] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:13.279889 11769 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 13 to 14, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:13.308487 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.269706 18176 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.309508 12019 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
W20260709 12:12:13.325371 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.328722 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53897.1us
I20260709 12:12:13.342487 18176 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.344025 18176 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.323781 18150 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.347888 18200 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.332327 11914 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:13.309471 18228 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.305130 17658 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.370087 17904 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.371799 17658 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.333740 18146 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.380573 11769 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:13.390842 11939 raft_consensus.cc:1240] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.395718 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.399644 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.400667 11944 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
W20260709 12:12:13.406556 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 79485.6us
I20260709 12:12:13.396481 17658 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:13.409924 18183 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.410390 17658 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.412922 17658 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.382630 17932 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.415307 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.419642 11944 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.419803 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:13.422132 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 132949us
I20260709 12:12:13.427373 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:13.430053 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Timed out: RequestConsensusVote RPC to 127.10.114.65:39113 timed out after 1.706s (SENT)
I20260709 12:12:13.432170 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:13.388085 18228 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.439486 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.442436 18150 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.444959 18198 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:13.463826 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 45039.8us
I20260709 12:12:13.457263 11769 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.473665 18200 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.453105 18133 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:13.479902 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 317520us
I20260709 12:12:13.488083 18231 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.490123 17901 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:13.490614 17901 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.491768 17901 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.493260 12608 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:13.495887 17932 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.496567 17932 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.497956 18228 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.498749 17932 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.498696 18200 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.499122 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.499753 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:13.500583 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:13.500732 18144 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.501206 18144 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.501623 18144 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.501725 18150 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.502168 18150 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.502502 18150 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.499825 18183 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.507974 18183 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.499958 17798 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.509747 17798 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.510847 17798 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.512583 17798 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.513038 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:13.515640 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.517742 18228 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.518275 18228 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:13.518714 18228 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.522028 17901 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:13.515264 18255 log.cc:927] Time spent T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 12:12:13.481233 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:13.530402 11986 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:13.529345 11769 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 13 to 15, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:13.537811 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60419.5us
I20260709 12:12:13.544970 17968 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.545634 17968 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.548023 17968 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.550181 18057 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.550859 18057 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.553547 18221 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:13.554461 18057 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.543152 18073 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.554222 18221 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.533732 17658 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:13.557622 18221 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.495981 18198 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.558326 11944 raft_consensus.cc:2468] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:13.549144 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:13.561097 11946 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:13.561580 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.566964 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.537181 18200 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.579298 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:13.581413 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.601990 18200 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.603129 18069 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.604703 18200 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.605795 17932 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:13.606633 17932 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.558367 18144 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.607860 18228 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.580699 11769 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:13.593588 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.600579 18183 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:13.601450 11839 leader_election.cc:400] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:13.611307 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.615218 11839 leader_election.cc:403] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.617797 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
W20260709 12:12:13.618600 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.626945 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.624321 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89448.1us
I20260709 12:12:13.610704 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.611545 17932 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.615263 11769 catalog_manager.cc:5697] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 6 to 8, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 10 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.622728 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.616459 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:13.611404 11988 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.618682 11944 raft_consensus.cc:1217] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 12:12:13.634264 11944 raft_consensus.cc:1240] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:12:13.619966 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:13.637225 11946 raft_consensus.cc:2468] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:13.637437 11948 raft_consensus.cc:2393] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 13: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:13.621953 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.640380 11947 raft_consensus.cc:2393] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:13.610455 18057 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.644654 11988 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.645799 11939 raft_consensus.cc:2393] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:13.646746 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:13.647434 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.648707 18221 consensus_queue.cc:1059] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:13.648010 11769 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 15, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.652094 17932 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.653359 18252 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 15.
I20260709 12:12:13.620337 18150 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.676239 18221 raft_consensus.cc:3055] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.676653 18221 raft_consensus.cc:740] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:13.677574 18221 consensus_queue.cc:260] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.678298 18150 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.678977 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.679338 17904 raft_consensus.cc:2804] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.679359 17932 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.679994 11946 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:12:13.682426 11868 raft_consensus.cc:1275] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:13.683302 17904 raft_consensus.cc:697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.684996 11948 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:13.686194 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.688040 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.688548 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.689190 11873 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:12:13.689998 18176 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.656834 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.690562 18176 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.653666 18174 raft_consensus.cc:2804] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:13.692090 18174 raft_consensus.cc:697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.609476 18144 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:13.659690 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.670063 18057 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.694859 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:13.695765 18057 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.673938 11867 raft_consensus.cc:1240] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:13.670179 18215 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:13.705057 18215 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:13.692974 18176 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.706260 18215 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.688694 12019 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.711719 18221 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.716678 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.716986 18228 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.717679 18144 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.718106 18144 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:13.718508 18144 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.693096 18174 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.659196 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.696731 18200 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:13.724881 12014 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:13.672814 11866 raft_consensus.cc:1240] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:13.699331 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.684826 17904 consensus_queue.cc:237] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.702054 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.703234 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:13.730670 11947 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.732265 17991 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.732846 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.733706 11869 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:12:13.733340 18144 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:13.734730 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.734956 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.736936 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.755015 11870 raft_consensus.cc:2468] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:13.764925 11873 raft_consensus.cc:1275] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:13.760823 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:13.762228 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.769127 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.769850 11870 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:12:13.771610 12605 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16.
I20260709 12:12:13.772482 12015 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:13.734758 18200 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.764515 11986 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:13.785794 12019 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:13.782765 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.791471 12577 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:13.786482 17798 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.792949 17927 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:13.794303 12014 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:13.793767 18245 raft_consensus.cc:2804] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.795373 18245 raft_consensus.cc:697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:13.796336 18245 consensus_queue.cc:237] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.800207 11837 leader_election.cc:400] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16.
I20260709 12:12:13.800590 11837 leader_election.cc:403] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.800691 11948 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:13.801748 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:13.802367 11865 raft_consensus.cc:3060] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.787228 11769 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 12 to 13, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.821368 11947 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:13.823449 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:13.732896 17991 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:13.827284 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.834013 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.834435 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:13.837993 11873 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:13.836511 17968 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.839082 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.839088 17968 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.840466 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:13.841014 11871 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.841935 17968 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.842411 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:13.843675 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:13.844220 11866 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.846691 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:13.847501 11870 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:12:13.847556 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.854048 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:13.854300 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.833570 18200 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.860251 18200 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:13.870982 12015 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:13.824618 17798 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:13.818710 17932 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.880441 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.891497 12019 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 15: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:13.895048 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:13.882398 18237 log.cc:927] Time spent T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:13.903793 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:13.827296 17927 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:12:13.894968 17965 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.893435 17798 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:13.928800 11871 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:13.929986 11867 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:13.941129 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.912916 17932 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:13.916376 17658 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.945010 11871 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:13.950172 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:13.956374 12019 raft_consensus.cc:2410] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:13.972733 11868 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:13.974036 18176 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.974157 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.982096 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:13.974802 17658 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:13.985149 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46594.6us
I20260709 12:12:13.986964 12020 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:13.987159 17658 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:13.987959 17658 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:13.988845 18176 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:13.999002 11866 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:13.975644 12017 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:14.002416 11865 raft_consensus.cc:2468] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 16.
I20260709 12:12:14.003163 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.003093 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:14.003957 11873 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.005239 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:14.014449 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.972208 18144 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:14.052796 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.017817 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.056351 11868 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.959635 17932 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:13.954133 17965 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.005357 18228 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16.
I20260709 12:12:14.065169 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.083254 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.085083 12020 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:14.092965 12017 raft_consensus.cc:2410] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:14.097097 11947 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:14.098415 12021 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:14.104038 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.098856 12021 pending_rounds.cc:85] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:12:14.084527 18133 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.093009 18276 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.106611 12021 pending_rounds.cc:107] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:14.131143 12021 raft_consensus.cc:2889] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.064319 17798 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.145974 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:14.146292 18273 log.cc:927] Time spent T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:12:14.147759 18270 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:12:14.157858 11868 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
W20260709 12:12:14.175127 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.167222 18265 log.cc:927] Time spent T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:12:14.121809 18133 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:14.192392 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.210121 18274 log.cc:927] Time spent T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:12:14.151749 18276 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.238423 17991 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:14.238474 12016 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:14.262985 11866 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:14.228699 17901 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.272035 17932 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:14.276988 18174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.020s	sys 0.022s
I20260709 12:12:14.270673 17901 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:14.290233 18283 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:12:14.292268 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.294003 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.303056 17965 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:14.329505 18268 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:12:14.331028 18133 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:14.286602 18174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.020s	sys 0.022s
I20260709 12:12:14.336406 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.340761 12015 raft_consensus.cc:1240] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.343273 11873 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:14.342427 12016 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 15.
I20260709 12:12:14.347326 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.350123 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:14.350270 12014 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:14.357995 12605 raft_consensus.cc:2410] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 12:12:14.360980 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:14.362392 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.318624 18276 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.369899 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.349865 17965 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.370683 12014 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
W20260709 12:12:14.377517 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 415188us
I20260709 12:12:14.379292 12017 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 21.
I20260709 12:12:14.378435 17965 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.384332 17965 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.386317 17901 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:14.390110 18245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.031s
I20260709 12:12:14.396646 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.398568 12015 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:14.398420 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.395112 18228 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:14.401312 18133 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.401490 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.401959 18133 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:14.397908 18245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.010s	sys 0.031s
I20260709 12:12:14.406137 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:14.425984 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.429818 17658 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.435858 18285 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:14.436447 18285 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:14.445676 18290 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.428014 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.452199 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.399111 17965 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:12:14.450096 17991 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.453876 17658 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:14.455404 18290 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.467911 18183 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:14.468544 18290 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.401772 18228 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.471208 18228 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.471980 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:14.473105 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.419077 18252 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.474059 18252 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.474818 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:14.475544 12017 raft_consensus.cc:2368] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16.
I20260709 12:12:14.476286 18231 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:14.429981 18276 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.465821 11864 raft_consensus.cc:3060] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.473042 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.434661 18284 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.459393 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:14.478821 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.482681 17973 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:14.484129 17658 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:14.484818 18133 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.485212 17658 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.489287 12605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:14.490091 12605 raft_consensus.cc:606] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:14.490954 18285 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:14.478142 17991 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.493799 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:14.494458 17991 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.480984 18276 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.497854 18276 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.481048 17927 consensus_queue.cc:1048] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:12:14.500957 11873 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.502255 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:14.502884 11947 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:14.507221 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.507915 11947 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:14.507987 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.509073 11946 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:14.509783 18278 log.cc:927] Time spent T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.286s	user 0.002s	sys 0.002s
I20260709 12:12:14.511859 18284 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:14.512965 18284 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:14.516287 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.518586 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.519431 12022 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:14.476184 18252 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.527238 12605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:14.532788 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.533206 12605 raft_consensus.cc:606] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:14.533725 12605 raft_consensus.cc:614] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:14.534013 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.528910 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.532150 11873 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:14.536113 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.536866 11869 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:14.527288 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.538130 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.539014 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.539619 12017 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:14.539531 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.540380 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.537732 11867 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:14.544437 11865 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:14.546211 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.557874 12605 raft_consensus.cc:1275] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:14.558549 12016 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
W20260709 12:12:14.564232 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 104934us
I20260709 12:12:14.531601 18185 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.561398 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.568210 17901 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:14.570129 18176 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:14.545740 17904 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.579149 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.594784 11947 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.578436 17901 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.597096 17901 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.597453 12605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:14.598234 12605 raft_consensus.cc:606] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:14.598580 12605 raft_consensus.cc:614] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:14.594784 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.603618 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.604350 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.604799 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.605115 11871 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:14.605723 11872 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:14.605923 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.606149 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.570866 18133 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:12:14.607038 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.571012 18061 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:14.606585 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.607823 18061 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.608203 11872 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:14.608724 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.608812 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:14.608302 18061 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.609563 11947 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:14.610041 11947 raft_consensus.cc:614] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:14.608305 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.607103 18133 consensus_queue.cc:1243] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 22.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:12:14.607395 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.610121 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.612651 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.614596 11865 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:14.616384 11864 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:14.614179 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:12:14.618556 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.620704 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.621265 11868 raft_consensus.cc:2376] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18. Re-sending same reply.
I20260709 12:12:14.622053 11864 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:14.619921 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:14.628176 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:14.630743 18185 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:14.631211 18185 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:14.631775 18185 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:14.611393 17904 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.625741 18057 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:12:14.635792 17904 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:14.635854 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.636548 12604 pending_rounds.cc:85] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Aborting all ops after (but not including) 17
I20260709 12:12:14.636695 11869 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:14.636904 12604 pending_rounds.cc:107] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 12:12:14.637297 12604 raft_consensus.cc:2889] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.655567 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.656467 11864 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:14.631130 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.660462 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.662354 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.667126 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.668288 11868 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:14.677891 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:14.678954 11941 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.696369 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.700506 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.700917 11943 raft_consensus.cc:1275] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:14.702466 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.704388 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.708611 11864 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 14.
I20260709 12:12:14.718792 11868 raft_consensus.cc:2393] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 15: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:14.721935 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.726069 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.722383 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.722630 11869 raft_consensus.cc:2376] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18. Re-sending same reply.
I20260709 12:12:14.734247 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.734774 18289 raft_consensus.cc:993] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:14.735117 11942 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:14.736178 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.737397 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.735354 18289 raft_consensus.cc:1081] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:14.743158 12016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:14.743851 12016 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.744199 12016 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.721342 18069 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:14.746524 18069 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:14.748736 18069 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:14.756542 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.761862 11868 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:12:14.769146 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.785097 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.745108 18061 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.769748 12016 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:14.798722 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:14.809834 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.817384 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:14.818132 18061 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:14.819392 18182 consensus_queue.cc:1048] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:12:14.820017 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:14.820719 12016 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:14.822921 12605 raft_consensus.cc:3055] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:14.823334 12605 raft_consensus.cc:740] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:14.824177 12605 consensus_queue.cc:260] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:14.825232 18303 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:14.825433 12605 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:14.831523 12576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.788543 18174 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.861694 11869 raft_consensus.cc:3055] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:14.862154 11869 raft_consensus.cc:740] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:14.865571 11869 consensus_queue.cc:260] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.868536 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:14.868664 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:14.869383 11944 raft_consensus.cc:3060] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.869649 11943 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.809232 17901 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.873718 11864 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.876922 11869 raft_consensus.cc:3060] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.902766 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.903146 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.903649 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.903957 11873 raft_consensus.cc:2393] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:14.902814 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.904901 11867 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:14.904887 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:14.905654 11866 raft_consensus.cc:3060] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.876103 18185 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:14.920360 12611 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:14.920051 18185 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.871204 17904 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.913465 11941 raft_consensus.cc:2468] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:14.913825 11866 raft_consensus.cc:2410] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:14.864666 18174 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.934484 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:14.938545 11864 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:14.934512 11944 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:14.940032 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.940892 12605 raft_consensus.cc:2468] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:14.942468 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.943089 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.943878 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.945189 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.945523 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.946273 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.946452 12022 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:14.955549 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:14.954603 12017 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:14.958627 11943 raft_consensus.cc:2468] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:14.960501 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:14.961377 12021 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:14.965341 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.968207 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:14.969022 11946 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.970829 17968 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:14.987622 18276 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.988466 18276 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:14.993480 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:14.994833 18276 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:14.923563 17901 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:15.001591 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46159.5us
I20260709 12:12:15.002372 11986 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:15.007938 18231 raft_consensus.cc:2804] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:15.008523 18231 raft_consensus.cc:697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:15.008641 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:15.009502 18231 consensus_queue.cc:237] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.011543 18057 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:15.013491 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:15.035933 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 93188.6us
I20260709 12:12:15.044255 12577 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:14.936671 17904 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.052140 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.055390 17968 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.062677 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.052266 18220 raft_consensus.cc:2804] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:15.076424 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:15.089639 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.095709 11869 raft_consensus.cc:1275] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:15.098565 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.079893 18245 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.110646 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:15.111883 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 49313us
I20260709 12:12:15.112885 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.109016 17968 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.144264 11868 raft_consensus.cc:1275] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:15.154315 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:15.152357 11946 raft_consensus.cc:2468] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:15.162855 11942 raft_consensus.cc:1240] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:15.155443 11839 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:15.168727 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:15.179636 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.130493 18245 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:15.186319 18313 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:12:15.186730 18231 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.187868 18245 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:15.188277 18308 log.cc:927] Time spent T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:12:15.176661 18220 raft_consensus.cc:697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:15.179121 18174 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:15.240309 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.218806 18285 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:15.243528 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.243721 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:15.248476 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 135660us
I20260709 12:12:15.249398 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.254521 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.262784 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.266894 18325 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.271127 18150 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.271658 18150 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.272709 18150 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.265837 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.276271 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.254500 17904 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:15.281919 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.283110 17973 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.283156 18174 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:15.283977 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.284293 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:15.291973 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 144236us
W20260709 12:12:15.273825 18314 log.cc:927] Time spent T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:12:15.293972 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.296378 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.299237 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.299594 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
W20260709 12:12:15.291378 18322 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:12:15.300942 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.279646 18183 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.304039 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.304283 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.310825 18323 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.310997 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.297894 18220 consensus_queue.cc:237] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.312562 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.291016 17968 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:15.301163 18069 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.301425 18332 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.306428 18331 raft_consensus.cc:2764] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:15.316051 18331 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:15.316412 18331 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.316746 18331 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.308048 18326 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.302523 18285 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:15.301397 17904 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.314617 18332 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.319952 17973 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:15.324874 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.294309 18133 consensus_queue.cc:1048] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:12:15.312839 18336 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:15.329998 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.327764 18332 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.341281 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:15.342092 12017 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
I20260709 12:12:15.343071 12605 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:15.326741 17904 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.326714 18285 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.326721 18061 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:15.333892 18336 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.377626 18338 consensus_queue.cc:1048] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:15.384558 18321 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 12:12:15.347965 17904 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.372488 18285 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.371220 18326 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:15.398257 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68405.2us
I20260709 12:12:15.385973 18336 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:15.371753 18228 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.411414 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:15.409221 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 96727.6us
I20260709 12:12:15.415082 11839 leader_election.cc:400] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 15. Current term is 16.
I20260709 12:12:15.416314 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:15.420073 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.389086 18335 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:12:15.447793 17901 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:15.448561 17901 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:15.451287 18340 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:15.434587 17968 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.458259 17968 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.459019 17968 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.459506 17968 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:15.460326 18322 log.cc:927] Time spent T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:12:15.410732 18333 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.470345 17968 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:15.473920 18333 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.408865 18150 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.478778 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:15.479555 18150 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:15.479782 12605 raft_consensus.cc:2410] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:15.407928 18061 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 12:12:15.494697 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 120365us
I20260709 12:12:15.420065 18174 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:12:15.499769 11914 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.477327 18333 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:15.427541 18228 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.500521 18343 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:15.505072 18069 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:15.501159 17973 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 12:12:15.557948 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 137921us
W20260709 12:12:15.560747 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53962.6us
W20260709 12:12:15.562655 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 146407us
I20260709 12:12:15.556797 18144 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.568910 18331 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.576633 18342 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:12:15.598297 18336 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:15.601658 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.588958 18174 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:15.601326 18228 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:15.620301 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.625167 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.625721 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.626042 11939 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:15.571082 18326 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.626869 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.627548 11942 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:15.629163 18146 raft_consensus.cc:993] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:15.629822 18146 raft_consensus.cc:1081] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:12:15.633659 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 56291.3us
I20260709 12:12:15.634598 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:15.636113 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:15.637522 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.612596 18332 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.645972 11946 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:15.638774 11942 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 20.
I20260709 12:12:15.647058 11988 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.656101 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:15.670630 11988 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.672811 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.648506 18133 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:15.675877 18176 raft_consensus.cc:2804] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:15.672271 18335 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.698580 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.675904 18069 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:15.675020 18345 raft_consensus.cc:2804] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:15.621433 18144 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.710216 18338 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.649084 18174 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.729894 18338 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.621362 17901 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.693982 18133 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:15.738829 18281 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:15.753233 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.728650 18176 raft_consensus.cc:697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:15.738142 18338 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:15.755764 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 68657.2us
I20260709 12:12:15.740751 18345 raft_consensus.cc:697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:15.761564 12021 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 12:12:15.756481 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 79827.3us
I20260709 12:12:15.750113 18133 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.750408 18281 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.751737 18069 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:15.765286 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.775722 11869 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:15.778213 11868 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:15.732721 18335 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.757467 17991 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.782673 11866 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:15.784188 11864 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:15.787261 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.754573 18285 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.795706 12018 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:15.776230 18281 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:15.755594 17904 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.798246 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:15.802920 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:15.783409 18289 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:15.796608 12018 pending_rounds.cc:85] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 10
I20260709 12:12:15.832317 12018 pending_rounds.cc:107] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:15.832631 12018 raft_consensus.cc:2889] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:15.804906 18323 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.805029 11871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:15.833621 11871 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:15.834132 11871 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:15.805888 18252 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.845922 18252 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.847973 18176 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.848665 18252 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:15.806946 18069 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.850772 18144 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:15.852875 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54733.2us
I20260709 12:12:15.854907 18061 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:15.855414 18061 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.855780 18061 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:15.857750 18331 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:15.858183 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.858999 11944 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:15.810894 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.814541 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:15.862278 11865 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:15.818830 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:15.863823 11870 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:15.865073 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:15.865896 11870 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.784723 18276 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.801285 18228 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.824429 17904 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:15.824805 12017 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:15.828053 18336 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:15.830669 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:15.773751 18327 consensus_queue.cc:1048] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:12:15.836982 18330 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.837881 18332 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:15.839416 17901 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:15.907802 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:15.908533 11865 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 20.
I20260709 12:12:15.908775 18133 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.843654 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:15.858601 18345 consensus_queue.cc:237] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.909797 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:15.867660 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 56846.6us
I20260709 12:12:15.812588 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.893006 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:15.915232 12019 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:12:15.898521 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:15.898984 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.903211 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:15.920123 12016 raft_consensus.cc:2410] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:15.903211 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:15.904628 12015 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:15.879808 18331 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:15.841216 18323 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:15.922789 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 110288us
I20260709 12:12:15.923527 11946 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:15.923601 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:15.925062 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.914367 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:15.927824 11870 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:15.859514 18174 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:15.935549 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:15.931461 12020 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:15.931910 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:15.943662 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:15.922704 18331 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.927258 18323 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.953392 11871 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.936651 17973 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.940925 18336 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:15.957291 18351 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:15.960296 18352 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.883121 18276 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:15.956974 18353 raft_consensus.cc:2764] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:15.970705 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:15.990790 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 131399us
I20260709 12:12:15.921952 18150 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:15.991070 12605 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:15.993224 11871 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 23 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:15.905359 18330 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.882910 18228 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:15.932924 18252 consensus_queue.cc:1059] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:12:15.967950 18343 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:15.984454 18331 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:15.987615 17973 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.989878 18336 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.992142 18325 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:16.054672 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 79554.8us
I20260709 12:12:16.085780 11864 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:16.085780 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:16.095285 12022 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:15.963282 18348 consensus_queue.cc:1059] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:12:16.096784 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 71948.8us
I20260709 12:12:16.102214 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.103609 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:16.107960 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:16.093623 18231 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:16.096558 17973 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.123040 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:16.097892 17904 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.099107 18336 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.099076 18326 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:16.098611 18325 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.123979 12604 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:16.136399 18325 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.146993 17968 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:16.140127 18150 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.147595 18150 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:16.148020 18150 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.152737 11867 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:16.154812 18330 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.106163 18347 consensus_queue.cc:1059] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:12:16.155789 18347 consensus_queue.cc:1243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 189a165e6619406382914fe3075dd436 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:16.155962 18351 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.156337 18347 raft_consensus.cc:3055] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.026762 18343 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.130309 18285 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.122566 18345 consensus_queue.cc:1048] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:12:16.166255 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:16.156684 18347 raft_consensus.cc:740] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:16.112680 18231 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.133638 17904 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:16.213635 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.214972 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 111452us
I20260709 12:12:16.176303 18133 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.236887 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:16.240111 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 244605us
I20260709 12:12:16.248488 11942 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:12:16.257359 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 263794us
I20260709 12:12:16.215513 18285 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.144524 18326 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.266505 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:16.286247 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 322089us
I20260709 12:12:16.288395 18231 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.293646 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.265750 18057 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.298293 18057 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:16.299566 18057 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.295306 18356 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:16.308394 18356 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.308900 18356 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.310770 18276 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:16.311393 18276 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.311864 18276 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.315086 18339 raft_consensus.cc:3055] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:16.315610 18339 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:16.315933 18343 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.270385 18285 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.317879 18347 consensus_queue.cc:260] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.319350 18347 raft_consensus.cc:3060] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:16.295543 18370 log.cc:927] Time spent T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:12:16.296792 18369 log.cc:927] Time spent T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:16.325816 18228 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:16.328236 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 46700.6us
I20260709 12:12:16.307822 18353 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:16.330122 18353 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:16.331158 18353 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.332787 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:16.334178 18353 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:16.294876 18338 consensus_meta.cc:287] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:12:16.335153 17904 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.335258 18338 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.316634 18339 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.336992 18326 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.337764 18339 raft_consensus.cc:3060] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.336930 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:16.339802 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46544us
I20260709 12:12:16.345098 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.345083 11986 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:16.352325 11872 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.351423 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.397895 11867 raft_consensus.cc:1240] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:16.397838 12604 raft_consensus.cc:1275] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:16.399582 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.400717 11867 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.400822 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
W20260709 12:12:16.405121 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 48817.7us
I20260709 12:12:16.412173 11869 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 21. Current term is 23. Ops: []
I20260709 12:12:16.346879 18332 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.430069 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:16.431064 12021 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:16.356163 18228 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.325253 18061 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.437749 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:16.439118 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:16.439392 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:16.450671 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.451823 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.409600 18326 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.454118 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:16.551699 11868 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.555951 18061 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:16.557696 18281 consensus_meta.cc:287] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.003s
I20260709 12:12:16.558384 18281 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.459576 18374 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:12:16.460577 18380 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:12:16.461434 18364 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.466173 17968 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.466856 18264 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 12:12:16.467736 18368 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.476524 18327 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:16.480341 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.486014 17991 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:16.494509 18328 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.495661 18344 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.518841 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:16.413970 18352 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.172s
W20260709 12:12:16.536101 18323 consensus_meta.cc:287] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.001s
I20260709 12:12:16.349361 18133 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:12:16.548751 18345 consensus_queue.cc:1048] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:16.563813 12020 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
W20260709 12:12:16.529086 18363 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.435s	user 0.001s	sys 0.002s
I20260709 12:12:16.485203 18276 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.432260 18338 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:16.531951 18379 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:12:16.626906 11868 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
W20260709 12:12:16.627878 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 276517us
I20260709 12:12:16.612157 18368 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:16.635447 18328 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.666057 18281 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.666487 18328 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.667809 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:16.673584 18361 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.499s	user 0.000s	sys 0.003s
I20260709 12:12:16.618782 18380 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:16.653964 18325 consensus_meta.cc:287] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.502s	user 0.000s	sys 0.012s
I20260709 12:12:16.669318 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.681437 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:16.661871 18336 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 12:12:16.684636 18325 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.684613 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.681051 18228 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.603454 17968 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.695051 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.633994 17991 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.676668 18368 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.643623 18323 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.743480 18323 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:16.690160 18150 consensus_meta.cc:287] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.006s
I20260709 12:12:16.744467 18150 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.746770 18150 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.688232 18336 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.747951 11872 raft_consensus.cc:2368] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 19. Current term is 20.
I20260709 12:12:16.748946 18336 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.706727 18350 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.285s
I20260709 12:12:16.715212 17968 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:16.705252 17973 consensus_meta.cc:287] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
I20260709 12:12:16.750373 17973 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.752667 17973 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.753530 18354 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.754113 18354 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.754513 18335 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:16.756441 18354 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.697959 18393 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.762344 17991 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:16.724375 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.726930 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.678906 18380 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:16.767879 18380 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.619323 18327 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.770963 18327 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.686825 18344 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.773277 18348 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:16.773432 17973 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:16.774988 18348 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:16.775135 17973 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:16.339793 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:16.699625 18276 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:16.780896 18325 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.782208 18285 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.753268 18356 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.793283 18325 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.794127 18325 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:16.799003 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 104177us
I20260709 12:12:16.800479 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.800590 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:16.798187 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 95298.6us
I20260709 12:12:16.818858 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.819531 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2487) took 1015 ms. Trace:
I20260709 12:12:16.819562 11942 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.822552 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:16.818615 18331 consensus_meta.cc:287] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
I20260709 12:12:16.826354 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:16.826606 18331 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:16.827220 12611 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 9: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:16.828540 11945 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:16.828822 18331 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:16.823853 18347 consensus_meta.cc:287] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.007s
W20260709 12:12:16.834085 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.820075 11871 rpcz_store.cc:276] 0709 12:12:15.804503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.105512 (+301009us) service_pool.cc:224] Handling call
0709 12:12:16.105969 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:16.119451 (+ 13482us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:16.214494 (+ 95043us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.362904 (+148410us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:16.412348 (+ 49444us) log.cc:844] Serialized 52 byte log entry
0709 12:12:16.412495 (+   147us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:16.412722 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.702548 (+289826us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.757375 (+ 54827us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b1800385360. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f189463f3 00007f1f189487c1 00007f1f18948779 00007f1f18948709 00007f1f189486d1 00007f1f189479cd 0000000000388634 0000000000388479 00007f1f1892983a
0709 12:12:16.797883 (+ 40508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.819187 (+ 21304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.819262 (+    75us) raft_consensus.cc:1685] finished
0709 12:12:16.819283 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.819456 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151787,"prepare.queue_time_us":32227,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":141,"raft.queue_time_us":211288,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":284,"spinlock_wait_cycles":17186688,"thread_start_us":493595,"threads_started":3,"wal-append.queue_time_us":191405}
I20260709 12:12:16.836269 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:16.836611 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:16.837596 12018 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.838330 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.841054 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.789426 18356 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:16.844461 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:16.843438 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46279.8us
I20260709 12:12:16.817974 18228 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.850410 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.848730 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.831691 18344 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.853565 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.867185 11945 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:16.840721 18276 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:16.869647 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.854022 18252 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.877638 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.878042 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.881652 11946 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.887761 18326 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:16.880189 17991 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:16.891136 18325 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:16.847609 18339 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.898667 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.899739 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.900645 11948 raft_consensus.cc:2410] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:12:16.904820 11942 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:16.916056 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:16.924134 11871 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:16.927495 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 81522.9us
I20260709 12:12:16.925602 11946 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 21.
I20260709 12:12:16.928943 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:16.929378 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.931177 11872 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:16.937129 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:16.940938 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.894385 18276 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.944108 18368 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:16.945159 18276 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:16.945302 12020 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.941211 18342 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:12:16.947907 18380 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.954638 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.976649 11866 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:16.956847 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:16.905666 18228 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.957806 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.957794 18368 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:16.980505 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52008us
I20260709 12:12:16.982270 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.984337 11868 raft_consensus.cc:1275] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:16.971139 11871 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:16.975538 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:16.985260 11872 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.984907 11868 pending_rounds.cc:85] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 10
I20260709 12:12:16.986066 11868 pending_rounds.cc:107] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:16.986340 11868 raft_consensus.cc:2889] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:16.988566 11939 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:16.989502 12018 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 21.
I20260709 12:12:16.990437 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:16.994372 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:16.993388 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.995987 11871 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:16.998153 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:16.999053 11873 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:17.012686 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:17.014573 12020 raft_consensus.cc:2468] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
I20260709 12:12:17.015998 18400 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:17.017177 18400 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:17.017200 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.018536 11873 raft_consensus.cc:2393] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:17.024036 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.024276 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.025043 18351 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:17.025732 18351 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:17.031106 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.034981 11839 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:17.036198 18276 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:17.039372 11839 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:17.040360 18276 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:17.008764 18183 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:17.042933 18183 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:17.043300 18183 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.044168 18183 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.046614 11870 raft_consensus.cc:1275] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:17.052440 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.053642 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:17.054265 11866 raft_consensus.cc:3060] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.017725 18400 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.058395 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:17.059049 11871 raft_consensus.cc:3060] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.060990 11988 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:17.063457 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:17.064126 11942 raft_consensus.cc:606] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:17.064496 11942 raft_consensus.cc:614] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:17.065071 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.065728 12018 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:17.056280 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:16.981818 18146 consensus_queue.cc:1059] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:12:17.071671 12577 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:17.072886 11868 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:17.009394 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:17.074790 17968 raft_consensus.cc:2804] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.076691 18342 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.077232 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.076618 17968 raft_consensus.cc:697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:17.077399 18342 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.078696 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.079077 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.078807 18342 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.079738 12020 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 16.
I20260709 12:12:17.045425 18183 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:17.081152 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 71796.3us
I20260709 12:12:17.096627 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.097818 11871 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 21.
I20260709 12:12:17.105857 11914 leader_election.cc:400] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 19. Current term is 20.
I20260709 12:12:17.106776 11914 leader_election.cc:403] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:17.073175 12577 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.081897 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.111075 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.069924 18289 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.113000 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.122649 11942 raft_consensus.cc:2368] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:17.123826 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.082382 18182 raft_consensus.cc:2804] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:17.110263 12020 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.136499 12018 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 23.
I20260709 12:12:17.139493 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.150895 11866 raft_consensus.cc:2468] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:17.155010 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.156589 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.157742 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.157742 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.159487 12020 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:17.160341 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.061857 18351 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:17.163826 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.161010 12013 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 9.
I20260709 12:12:17.111357 18069 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.166298 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.166564 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.167814 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.130748 18327 raft_consensus.cc:2804] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:17.171556 11940 raft_consensus.cc:2368] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 16.
I20260709 12:12:17.171307 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.172369 11947 raft_consensus.cc:2368] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:17.173357 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.176460 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.181331 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.181882 11940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:17.182590 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.182816 11940 raft_consensus.cc:606] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:17.187805 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.188953 11947 raft_consensus.cc:2393] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 21: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:17.189579 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.190452 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.185830 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.195966 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.168697 18182 raft_consensus.cc:697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:17.205935 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.208346 18182 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:17.107498 17968 consensus_queue.cc:237] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.209559 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.138471 18400 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.187355 18351 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.227268 18351 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.227363 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.227757 18351 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.227607 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:17.228497 12022 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 21. Current term is 23. Ops: []
I20260709 12:12:17.228967 11868 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.184147 18327 raft_consensus.cc:697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:17.202204 18354 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.230146 18327 consensus_queue.cc:237] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:17.231961 18401 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:17.205416 18346 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.233785 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.234433 11939 raft_consensus.cc:1240] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.215948 12018 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:17.221122 12021 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:17.218182 18335 consensus_queue.cc:1048] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:17.219578 11946 raft_consensus.cc:2393] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 16: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:17.239535 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.240692 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.241765 18400 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:17.245203 18346 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:17.221555 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.246460 18346 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.225862 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.202278 18276 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.227279 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.249869 12013 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.204382 18325 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.203956 18323 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.220966 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:17.227597 18402 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:17.313288 11865 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:17.317198 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 185704us
I20260709 12:12:17.336123 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:17.336433 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:17.319308 11868 raft_consensus.cc:2468] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:12:17.345384 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 124512us
I20260709 12:12:17.346318 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.355583 11873 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:12:17.357191 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.368639 11872 raft_consensus.cc:2468] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:17.369460 11866 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:17.374181 11839 leader_election.cc:400] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:17.312561 18276 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.354970 18323 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.354970 18176 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:17.386962 18408 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.359702 18333 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:17.398654 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.430560 18350 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:17.431143 18350 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.393775 18281 consensus_queue.cc:1048] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:12:17.397348 18408 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:17.392030 18252 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.442366 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.445699 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.396181 18323 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.451996 11839 leader_election.cc:400] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:17.385151 18133 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:12:17.437476 18285 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.451983 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 105774us
I20260709 12:12:17.454303 11839 leader_election.cc:403] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:17.432171 18350 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.412209 18176 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:17.453480 18398 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:12:17.487732 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.487860 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:17.480901 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.450037 18332 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.445822 18408 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:17.496376 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.453119 18344 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:17.435668 18333 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:17.501466 11839 leader_election.cc:400] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 14. Current term is 16.
I20260709 12:12:17.504964 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.503759 18350 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.491457 18133 consensus_queue.cc:1243] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:17.491730 18252 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17.
I20260709 12:12:17.518174 11839 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.519868 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.499306 18368 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.508790 18285 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:17.528035 11839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.508447 18330 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.527561 18344 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.530242 18276 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:17.531612 18176 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:17.532433 11986 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.539937 12013 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
I20260709 12:12:17.548385 12022 raft_consensus.cc:1240] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:17.550186 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 164045us
I20260709 12:12:17.519692 18323 raft_consensus.cc:3060] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:17.568492 11769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 195) took 12826 ms (client timeout 15000 ms). Trace:
I20260709 12:12:17.570557 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:17.572268 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 214094us
I20260709 12:12:17.526146 18228 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.570453 11769 rpcz_store.cc:269] 0709 12:12:04.742543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.745727 (+  3184us) service_pool.cc:224] Handling call
0709 12:12:17.568387 (+12822660us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:14.313773 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:14.314517 (+   744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:14.314575 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:12:14.314588 (+    13us) tablet.cc:662] Decoding operations
0709 12:12:14.316277 (+  1689us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:14.316382 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:14.316421 (+    39us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:12:14.395939 (+ 79518us) tablet.cc:701] Row locks acquired
0709 12:12:14.416553 (+ 20614us) write_op.cc:260] PREPARE: finished
0709 12:12:14.453273 (+ 36720us) write_op.cc:270] Start()
0709 12:12:14.505743 (+ 52470us) write_op.cc:276] Timestamp: P: 1783599134433066 usec, L: 0
0709 12:12:14.505799 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:12:14.506672 (+   873us) log.cc:844] Serialized 7493 byte log entry
0709 12:12:14.771123 (+264451us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54003c53a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99d090 00007f1f1b9aa6b8 00007f1f1b9aa2fa 00007f1f1ba2e965 00007f1f1ba2ee09 00007f1f1f469581 00007f1f1f468d58 00007f1f1f46d9f1 00007f1f1f46d9a9 00007f1f1f46d939 00007f1f1f46d901
0709 12:12:14.866120 (+ 94997us) op_driver.cc:464] REPLICATION: finished
0709 12:12:14.982060 (+115940us) write_op.cc:301] APPLY: starting
0709 12:12:14.982237 (+   177us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:15.335215 (+352978us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:15.344249 (+  9034us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:15.484300 (+140051us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:15.484743 (+   443us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:12:15.484824 (+    81us) write_op.cc:312] APPLY: finished
0709 12:12:15.486456 (+  1632us) log.cc:844] Serialized 172 byte log entry
0709 12:12:15.497389 (+ 10933us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:15.500945 (+  3556us) write_op.cc:454] Released schema lock
0709 12:12:15.503687 (+  2742us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:15.562718 (+ 59031us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:15.573099 (+ 10381us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39565,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":115557,"apply.run_cpu_time_us":33081,"apply.run_wall_time_us":535449,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83661,"num_ops":19,"prepare.queue_time_us":44302,"prepare.run_cpu_time_us":22519,"prepare.run_wall_time_us":496785,"raft.queue_time_us":166886,"raft.run_cpu_time_us":9079,"raft.run_wall_time_us":22987,"replication_time_us":360132,"spinlock_wait_cycles":171516160,"thread_start_us":237284,"threads_started":4,"wal-append.queue_time_us":114984,"wal-append.run_cpu_time_us":18116,"wal-append.run_wall_time_us":1865682}]]}
W20260709 12:12:17.580369 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75483.5us
I20260709 12:12:17.563164 18368 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:17.582760 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.583652 11866 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 8.
I20260709 12:12:17.585283 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:17.568774 18325 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:17.575484 18378 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:17.577028 18176 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.573956 18330 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.615381 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:17.615780 18410 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:17.617636 18354 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:17.618284 18354 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:17.605895 11873 raft_consensus.cc:1240] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:17.606906 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.635527 11942 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:17.610471 11939 raft_consensus.cc:606] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:17.612092 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.644322 12013 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 9.
I20260709 12:12:17.620402 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 15, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 15 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:17.621654 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.621958 18150 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:17.641010 11944 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 23.
I20260709 12:12:17.610371 11914 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:17.586604 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.646821 11939 raft_consensus.cc:614] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:17.647786 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 61269.7us
W20260709 12:12:17.654112 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 61037us
W20260709 12:12:17.655177 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44947.8us
I20260709 12:12:17.654870 11768 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 16, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 16 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:17.610172 18325 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:17.659554 18380 consensus_meta.cc:287] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.007s
I20260709 12:12:17.588140 18352 consensus_queue.cc:1059] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:12:17.654199 18252 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.663489 18146 raft_consensus.cc:2804] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.609491 18368 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.663070 17973 consensus_queue.cc:1059] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:17.676903 18354 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:17.661911 18183 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:17.674615 11768 catalog_manager.cc:5697] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.692134 11768 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 7 to 8, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 8 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:17.695653 18368 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:17.700836 18146 raft_consensus.cc:697] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.702328 18146 consensus_queue.cc:237] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.662276 18350 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:12:17.706219 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 16, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 16 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:17.731348 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:17.732123 11939 raft_consensus.cc:606] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:17.715749 18342 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:17.739969 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 82758.2us
I20260709 12:12:17.705753 18351 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:17.749156 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 166695us
I20260709 12:12:17.749574 18422 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:17.750053 18422 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.750824 11988 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:17.751012 18422 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.752144 18375 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:17.752454 18422 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.754113 11988 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.754984 18375 raft_consensus.cc:2804] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:17.755541 18375 raft_consensus.cc:697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:17.763566 11768 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 15 to 17, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 17 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:17.765270 11768 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 11, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 11 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:17.743088 18069 consensus_meta.cc:287] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.003s
I20260709 12:12:17.770296 12021 raft_consensus.cc:1240] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:17.741426 18342 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.774134 11947 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:17.756445 18375 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.799121 11945 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:17.799726 11945 pending_rounds.cc:85] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 7
I20260709 12:12:17.799998 11945 pending_rounds.cc:107] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:17.800239 11945 raft_consensus.cc:2889] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.802102 12604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c"
dest_uuid: "189a165e6619406382914fe3075dd436"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:12:17.803006 12604 raft_consensus.cc:606] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:17.803473 12604 raft_consensus.cc:614] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:17.805218 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:17.807540 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:17.808462 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.822810 18338 raft_consensus.cc:3055] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:17.823414 18338 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:17.822911 18368 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:17.825088 18368 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:17.825817 18351 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:17.828176 18368 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:17.828562 18333 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:17.836199 18412 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.439s	user 0.000s	sys 0.003s
I20260709 12:12:17.840375 18342 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.842366 18342 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.870945 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:17.772730 18069 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113) with higher term. Message: Invalid argument: T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 19. Current term is 20.
W20260709 12:12:17.868825 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 94245.2us
W20260709 12:12:17.888037 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 148757us
I20260709 12:12:17.896553 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.898360 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:17.899276 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:17.908288 18360 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:17.908960 18360 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.909405 18360 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:17.845352 18325 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.912451 11865 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:17.918354 11943 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:17.929947 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:17.874576 18323 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:17.943027 11869 pending_rounds.cc:85] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 10
I20260709 12:12:17.941787 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:17.940129 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58274.8us
I20260709 12:12:17.940119 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.956954 11869 pending_rounds.cc:107] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:17.957494 11869 raft_consensus.cc:2889] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.960152 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:17.960208 12020 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:17.959767 11873 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:17.942229 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.963757 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.967312 12021 raft_consensus.cc:1240] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:17.973435 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:17.978662 11947 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:17.942761 18357 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.936762 18375 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:17.979485 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:17.997216 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:17.984721 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:17.990267 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:17.998974 11839 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:18.038204 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:18.003307 18276 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:17.982230 18333 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.980216 18252 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.995167 18228 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:18.007151 18285 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:18.007727 18344 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:18.055825 18402 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:17.996691 18351 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:18.004704 18375 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:18.104758 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66675.3us
I20260709 12:12:18.004487 17968 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:12:18.058154 18333 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:18.062214 18436 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:12:18.059480 18401 log.cc:927] Time spent T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:12:18.132091 18441 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:12:18.056703 18398 log.cc:927] Time spent T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:12:18.135576 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:18.149971 18323 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:18.150627 18426 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:12:18.154865 18338 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.181151 18341 raft_consensus.cc:3055] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:12:18.163453 18439 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:12:18.168953 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:18.171072 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:18.224386 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 53419us
I20260709 12:12:18.064734 18331 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:18.091799 18228 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:12:18.160569 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.230207 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.202194 18285 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:12:18.214603 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 270472us
I20260709 12:12:18.252238 18285 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.254336 18357 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:18.255026 18357 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.226876 18448 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.257716 12019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3343) took 1033 ms. Trace:
I20260709 12:12:18.258100 12022 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:18.258159 12019 rpcz_store.cc:276] 0709 12:12:17.224599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.224727 (+   128us) service_pool.cc:224] Handling call
0709 12:12:17.225056 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.225395 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.225423 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.648788 (+423365us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b2c0011d058. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33c372 00007f1f1ba6ea01 00007f1f1ba3343a 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2
0709 12:12:17.662585 (+ 13797us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.924818 (+262233us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.924878 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.925060 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.162773 (+237713us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:12:18.257430 (+ 94657us) raft_consensus.cc:1685] finished
0709 12:12:18.257458 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.257620 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8651,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":238813184,"thread_start_us":261624,"threads_started":1,"wal-append.queue_time_us":341593}
I20260709 12:12:18.260293 11944 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:18.231106 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.182895 18333 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.265615 18374 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.266239 18374 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:18.268628 18374 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:18.229364 18331 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:18.269770 18331 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:18.271867 18357 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.235498 18228 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.274245 12611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:18.276533 18350 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.276767 11948 raft_consensus.cc:3060] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.218546 18341 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:18.247599 18325 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:18.280284 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54798.6us
I20260709 12:12:18.286554 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:18.292719 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 123277us
W20260709 12:12:18.293603 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89178.3us
I20260709 12:12:18.293824 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:18.294178 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:18.294406 11837 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:18.296129 18455 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.296650 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:18.297655 18453 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.297911 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:18.298102 18453 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:18.298516 18453 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.298750 11868 raft_consensus.cc:2393] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 17: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:18.298612 11869 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:18.277104 18350 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.303386 11988 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:18.307488 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:18.307870 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:18.308754 11947 raft_consensus.cc:1275] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:18.309792 18352 consensus_queue.cc:1059] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:18.311295 18352 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.311692 18352 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:18.312625 18352 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.314635 18325 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.316570 18416 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:18.319269 18414 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.316973 18453 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.326838 18453 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:18.327716 18357 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:18.328433 18422 consensus_queue.cc:1059] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:18.329483 18422 raft_consensus.cc:3055] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.329916 18422 raft_consensus.cc:740] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:18.330816 12019 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:18.331035 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:18.330932 18422 consensus_queue.cc:260] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.332053 18424 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.332453 11988 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:18.332609 18422 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.333707 18368 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.335000 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:18.279156 18338 raft_consensus.cc:3060] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.336707 18414 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.337832 18453 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:18.340034 18328 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:18.306507 18341 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.344054 18341 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.347347 18350 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:18.379243 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:18.380173 12021 raft_consensus.cc:2393] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 19: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:18.380636 12013 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:18.381964 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:18.384243 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:18.384902 11947 raft_consensus.cc:2376] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18. Re-sending same reply.
I20260709 12:12:18.385913 12018 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:18.386297 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:18.386509 12019 raft_consensus.cc:1240] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:18.397187 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:18.329092 18360 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:18.433025 11873 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:18.422861 18352 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.417698 18342 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:12:18.385447 18281 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:18.447751 11864 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:18.385859 18182 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:12:18.392343 18331 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:18.481721 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:18.482805 11864 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:18.434841 18450 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.439993 18382 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:12:18.517881 18331 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:18.518353 18375 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:18.519490 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.523811 18360 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:18.531749 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:18.543224 12021 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:18.574944 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:18.577960 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:18.584758 11948 raft_consensus.cc:1275] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:18.595561 12020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56168 (request call id 3346) took 1112 ms. Trace:
I20260709 12:12:18.596087 12020 rpcz_store.cc:276] 0709 12:12:17.483468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.487613 (+  4145us) service_pool.cc:224] Handling call
0709 12:12:18.595276 (+1107663us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400179654. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:18.595438 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073636096}
I20260709 12:12:18.598987 18333 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.601907 18378 consensus_queue.cc:1048] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:18.608541 18400 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.609782 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:18.613396 18452 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:12:18.601449 18333 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:18.586144 18424 consensus_queue.cc:1048] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:12:18.641194 11947 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
W20260709 12:12:18.643564 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 58533.7us
W20260709 12:12:18.643899 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70425.8us
I20260709 12:12:18.663287 18431 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:18.664212 18431 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:18.667438 18431 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:18.693114 12021 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:12:18.696734 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
W20260709 12:12:18.762480 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77537us
W20260709 12:12:18.763772 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 67144.9us
I20260709 12:12:18.775839 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:18.689275 18342 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:12:18.785410 18408 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:18.764079 18183 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:12:18.822731 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:18.828994 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:18.801723 18368 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:18.850296 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet cbba5e6f295144a79461c5afc2e273ae with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:58918
W20260709 12:12:18.851320 18469 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:18.833060 18433 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:18.838157 18368 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:18.870692 18466 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:12:18.871654 18467 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:18.857316 18471 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.866379 18433 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:18.946395 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 93290.5us
I20260709 12:12:18.908540 18471 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:18.958921 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 132293us
W20260709 12:12:18.957942 18468 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:12:18.952431 18471 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.969727 12020 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:18.972556 11943 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:18.991051 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:18.992226 11942 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:18.980381 18475 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:12:19.001155 18432 raft_consensus.cc:993] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:19.002269 18485 tablet_replica.cc:333] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:19.003324 18483 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.004099 18356 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:19.003938 18483 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.004752 18356 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.006460 18483 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.008854 12017 raft_consensus.cc:1275] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:19.013228 18323 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:19.017846 18323 consensus_queue.cc:1243] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:19.023128 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:18.979779 18368 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.030066 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.031005 11939 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 23.
I20260709 12:12:19.047719 11941 pending_rounds.cc:85] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting all ops after (but not including) 10
I20260709 12:12:19.048296 11941 pending_rounds.cc:107] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:12:19.048642 11941 raft_consensus.cc:2889] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:19.025265 18323 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.066215 18323 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.068367 18473 raft_consensus.cc:1081] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:19.045519 18057 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:19.069764 18057 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.070205 18057 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.979208 18433 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.068578 18323 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.063319 18356 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.099817 12017 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.055608 18483 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.095695 18353 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.107056 18473 consensus_queue.cc:1048] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:12:19.119426 18342 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:12:19.122116 18483 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.130823 18353 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.156611 18353 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.157704 18486 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.158463 18486 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.169552 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:19.170635 12021 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:19.189272 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:19.192207 18498 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.192780 18498 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.193190 18498 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.196306 18057 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.202725 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3350) took 1234 ms. Trace:
I20260709 12:12:19.258751 11870 rpcz_store.cc:276] 0709 12:12:17.968718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.970264 (+  1546us) service_pool.cc:224] Handling call
0709 12:12:17.970561 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.970750 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:18.098349 (+127599us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.387556 (+289207us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.201926 (+814370us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b180038c260. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f188c0c0a 00007f1f22000219 00007f1f18948a40 00007f1f189434e4 00007f1f18943455 00007f1f1ba2b060 00007f1f1ba3d716 00007f1f1ba4e287 00007f1f1ba4e208
0709 12:12:19.202159 (+   233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.202230 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:19.202303 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.202411 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.202592 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118938,"prepare.queue_time_us":88731,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":9431,"raft.queue_time_us":923016,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":44626,"spinlock_wait_cycles":16113536,"thread_start_us":260037,"threads_started":2}
W20260709 12:12:19.205475 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 816082us
I20260709 12:12:19.260270 18057 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.264309 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:19.266407 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:19.266546 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:19.267727 12019 raft_consensus.cc:2368] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10.
I20260709 12:12:19.273360 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.276086 11867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:19.305370 18341 raft_consensus.cc:993] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:19.306054 18341 raft_consensus.cc:1081] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:12:19.326341 18491 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:19.328174 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.329159 11868 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 16.
W20260709 12:12:19.339373 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 73067.8us
I20260709 12:12:19.341075 18482 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.355491 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:19.365856 18252 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.253551 18331 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.366225 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:19.366617 18252 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.367219 12019 raft_consensus.cc:2393] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 17: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:19.368319 11868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:19.369525 18252 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.370914 18431 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:19.373402 18483 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.384123 18388 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.384826 18388 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.395659 18448 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.396406 18448 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.364961 11942 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
W20260709 12:12:19.409469 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 60206.4us
I20260709 12:12:19.411613 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:19.412873 11873 raft_consensus.cc:2393] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.474339 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:19.475329 11873 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.308892 18471 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.525583 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.527896 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.532794 11946 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.536777 11873 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
W20260709 12:12:19.514010 18408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.008s
I20260709 12:12:19.492985 18414 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.541673 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.544927 11873 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 21: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.551386 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:19.480706 18228 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:19.493338 18424 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.512519 18285 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.366717 18331 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.502280 18374 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:19.494387 18333 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.512796 18057 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.568993 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:19.558817 18469 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:12:19.580780 11873 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:19.583043 18458 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.584343 18338 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:19.589823 18471 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.575766 18424 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.591611 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:19.600649 18448 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:19.561236 18414 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.648100 18424 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.649302 18414 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.603247 18388 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.615943 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:19.649660 18458 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.653928 11873 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.655901 18458 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:19.539093 18408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.012s	sys 0.008s
I20260709 12:12:19.572932 18228 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.661322 18228 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:19.607980 18374 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.636233 18331 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:19.626112 18338 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:19.637442 18500 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:19.710462 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:19.638443 11868 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.714067 11868 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:19.577716 18285 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.718185 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.718545 18352 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.719061 18352 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.720083 18285 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.721109 18352 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.642279 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:19.632985 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:19.722298 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 89464.5us
I20260709 12:12:19.722401 18490 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:19.722888 18490 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.723268 18490 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:19.621354 18057 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.644236 18360 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:19.726024 18360 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.727300 18057 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:19.728597 18360 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.626322 18422 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.729386 18422 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.731644 18422 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.608332 18333 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.733786 18333 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.627099 18498 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:19.734349 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 97577.1us
I20260709 12:12:19.736306 18498 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:19.674989 11873 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:19.718204 18338 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.739094 18338 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.739560 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:19.740182 12020 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:19.741676 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:19.742172 12017 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.737885 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.744997 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:19.745949 11873 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 21: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.683064 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.747052 11872 raft_consensus.cc:2393] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 16: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.685076 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.747807 11942 raft_consensus.cc:2368] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17.
I20260709 12:12:19.680550 18408 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:19.705574 18374 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:19.707774 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:19.758611 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.758031 11944 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 18: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.758844 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:19.759313 11943 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:19.742539 12018 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:19.740213 12019 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:19.766248 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.767144 11872 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:19.775070 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.776170 11873 raft_consensus.cc:2393] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 18: Already voted for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in this term.
I20260709 12:12:19.777169 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.779250 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:19.779955 11873 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:19.778225 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.783253 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:19.765003 11868 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.787802 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:19.791846 18483 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:19.792634 18483 consensus_queue.cc:1243] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:19.798243 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:19.799052 11872 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:19.793776 18482 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.732987 18490 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.802279 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:19.862293 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74621.4us
W20260709 12:12:19.864157 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61947.7us
I20260709 12:12:19.865022 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:19.866935 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:19.867592 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 74618.7us
I20260709 12:12:19.863408 11839 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:19.892462 11872 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 10.
I20260709 12:12:19.897971 11839 leader_election.cc:400] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10.
I20260709 12:12:19.800796 18482 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
W20260709 12:12:19.872452 18432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.014s	sys 0.031s
I20260709 12:12:19.875676 18069 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.900117 11872 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.875859 18382 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:19.903458 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 378859us
I20260709 12:12:19.870854 18333 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:19.870585 18331 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.882791 18228 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.896929 18285 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.899878 18276 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.899716 18455 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.920197 18382 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.896257 18448 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:19.899407 18388 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.889768 18458 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:19.876085 18507 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.899772 18508 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:19.904256 18432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.014s	sys 0.031s
W20260709 12:12:19.946141 18350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.029s	sys 0.045s
I20260709 12:12:19.922758 18485 raft_consensus.cc:2243] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.922180 18333 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.982049 18382 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:19.980269 18500 log.cc:927] Time spent T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:20.002332 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:19.898675 11839 leader_election.cc:403] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:12:20.018635 11866 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.009s
W20260709 12:12:20.020380 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 122604us
W20260709 12:12:20.026913 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 459140us
W20260709 12:12:20.005403 18350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.029s	sys 0.045s
W20260709 12:12:20.028330 11866 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.013s	sys 0.010s
I20260709 12:12:19.946362 18331 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.030195 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:19.981201 18285 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.981449 18228 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.919914 18408 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:19.985224 18276 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.043434 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:19.986553 18448 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:19.991742 18458 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.020323 18450 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.047963 12018 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:20.052537 12014 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:19.984427 18455 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.047140 12017 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:20.036939 18375 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.047816 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.039541 18433 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.071065 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.073228 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.076740 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.079290 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.083567 11940 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:20.083825 11865 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
W20260709 12:12:20.066336 18488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.002s
I20260709 12:12:20.007571 18508 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.016968 18482 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.078517 18490 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 24 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.120206 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:20.138127 18506 log.cc:927] Time spent T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:12:20.139053 18486 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.108935 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.085151 18344 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 9. Current term is 10.
I20260709 12:12:20.078822 18375 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:20.148289 11868 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.044914 18150 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:12:20.153277 11864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.023s
W20260709 12:12:20.139067 18501 log.cc:927] Time spent T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 12:12:20.115932 18488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.015s	sys 0.002s
I20260709 12:12:20.162727 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.112931 18449 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:20.164711 11864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.023s	sys 0.023s
I20260709 12:12:20.059461 18450 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.166663 18505 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:20.145356 18333 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.161012 18485 raft_consensus.cc:2272] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.199630 11865 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:20.153275 18413 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:12:20.202522 11867 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.207074 11867 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.176014 18344 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.202836 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.204445 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.209220 11868 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:20.209759 11866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3354) took 1809 ms. Trace:
I20260709 12:12:20.211943 11866 rpcz_store.cc:276] 0709 12:12:18.400649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.400809 (+   160us) service_pool.cc:224] Handling call
0709 12:12:18.401212 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.401552 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:18.401944 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.028988 (+1627044us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.202293 (+173305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.202347 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:20.202401 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.209560 (+  7159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.209698 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":885187,"prepare.queue_time_us":553819,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":114,"raft.queue_time_us":850997,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":49039,"thread_start_us":994318,"threads_started":3}
I20260709 12:12:20.283102 11869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3365) took 1009 ms. Trace:
I20260709 12:12:20.283576 11869 rpcz_store.cc:276] 0709 12:12:19.273509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.275781 (+  2272us) service_pool.cc:224] Handling call
0709 12:12:19.297425 (+ 21644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:19.403606 (+106181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.403643 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:19.413510 (+  9867us) log.cc:844] Serialized 52 byte log entry
0709 12:12:20.030706 (+617196us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:20.215653 (+184947us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.282784 (+ 67131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.282864 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.282907 (+    43us) raft_consensus.cc:1685] finished
0709 12:12:20.282917 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.283045 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113080,"prepare.queue_time_us":54525,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4098,"raft.queue_time_us":111265,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":27331,"thread_start_us":663035,"threads_started":2,"wal-append.queue_time_us":628726}
I20260709 12:12:20.215315 18523 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.212699 18333 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:20.297585 18512 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:12:20.300275 18509 log.cc:927] Time spent T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:12:20.301883 12021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56168 (request call id 3376) took 1094 ms. Trace:
I20260709 12:12:20.227514 18388 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:20.284366 18507 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
W20260709 12:12:20.302248 18524 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:12:20.287879 18228 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.302300 12021 rpcz_store.cc:276] 0709 12:12:19.207633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.216289 (+  8656us) service_pool.cc:224] Handling call
0709 12:12:19.216740 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.254265 (+ 37525us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:19.369741 (+115476us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.802948 (+433207us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.883959 (+ 81011us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.884179 (+   220us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.884230 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.884344 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.301613 (+417269us) raft_consensus.cc:1685] finished
0709 12:12:20.301640 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.301816 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45774,"prepare.queue_time_us":131370,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":56094,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":81441,"thread_start_us":431984,"threads_started":1,"wal-append.queue_time_us":679417}
I20260709 12:12:20.201659 18505 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.288671 18331 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:20.314924 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 169613us
I20260709 12:12:20.212119 18344 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.318645 18382 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.303851 18333 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.322288 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:20.327679 18338 consensus_meta.cc:287] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 12:12:20.329000 18228 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:12:20.330623 18522 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:12:20.332461 18485 ts_tablet_manager.cc:1916] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:20.317214 18276 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.336198 11867 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.341427 18333 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.346792 18285 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.347779 18505 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.220002 18375 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.349741 18382 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.369797 18450 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.304009 18523 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.371392 18507 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.373173 18523 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.351577 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:20.351753 18344 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.376631 18488 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.355899 18388 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.354214 18228 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.366508 18508 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:20.367022 18513 log.cc:927] Time spent T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:12:20.381449 11871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3364) took 1108 ms. Trace:
I20260709 12:12:20.382654 18228 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.381889 11871 rpcz_store.cc:276] 0709 12:12:19.273160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.273279 (+   119us) service_pool.cc:224] Handling call
0709 12:12:19.285622 (+ 12343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.402481 (+116859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.402513 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.403043 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.902308 (+499265us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.902357 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.902432 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.381201 (+478769us) raft_consensus.cc:1685] finished
0709 12:12:20.381225 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.381370 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116368,"raft.queue_time_us":121210,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":85223,"thread_start_us":498759,"threads_started":1,"wal-append.queue_time_us":660174}
I20260709 12:12:20.384102 11871 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:20.385251 11871 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.375073 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.394496 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.395462 11873 raft_consensus.cc:2410] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:20.395685 18228 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:20.396544 18458 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.396389 18228 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.404107 18228 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.410905 18482 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.427049 11867 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:20.427570 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 560659us
I20260709 12:12:20.427721 11867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36510 (request call id 3366) took 1152 ms. Trace:
I20260709 12:12:20.427863 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2536) took 1014 ms. Trace:
I20260709 12:12:20.428159 11867 rpcz_store.cc:276] 0709 12:12:19.275622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.275902 (+   280us) service_pool.cc:224] Handling call
0709 12:12:20.420650 (+1144748us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54000947d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba2aa3d 00007f1f209facd0 00007f1f19f7f254 00007f1f19f7f1e2 00007f1f19f7f111 00007f1f19f7f08c 00007f1f19f7e342 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:20.427624 (+  6974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128553344}
I20260709 12:12:20.428272 11870 rpcz_store.cc:276] 0709 12:12:19.412964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.692736 (+279772us) service_pool.cc:224] Handling call
0709 12:12:19.693083 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.754399 (+ 61316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.754430 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.754480 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.754509 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.427604 (+673095us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54001608d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:20.427655 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.427810 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140596608}
I20260709 12:12:20.442479 11872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2538) took 1029 ms. Trace:
I20260709 12:12:20.443078 11872 rpcz_store.cc:276] 0709 12:12:19.413508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.922993 (+509485us) service_pool.cc:224] Handling call
0709 12:12:19.923419 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.049112 (+125693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.049151 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.049250 (+    99us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:20.049298 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.442039 (+392741us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400069ad4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:20.442105 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.442394 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288617856}
W20260709 12:12:20.452107 11913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.477144 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.484742 11948 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:20.491128 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.491888 11948 raft_consensus.cc:2393] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:20.495746 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:20.447134 18400 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.446740 18069 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:20.498932 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:20.503180 11939 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:20.502140 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.506660 11988 leader_election.cc:400] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17.
I20260709 12:12:20.507166 11988 leader_election.cc:403] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:20.508414 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:20.508834 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.508975 12608 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:20.513913 18344 consensus_queue.cc:1059] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:20.514760 18523 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:20.515098 18523 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:20.515866 18523 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.516204 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:20.516948 18523 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:20.517599 18458 raft_consensus.cc:2749] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:20.516949 18450 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:12:20.522002 18057 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.522517 18057 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.524549 18057 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.527277 18069 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:20.527876 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 95938.7us
I20260709 12:12:20.495471 18414 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.534291 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:20.540109 11865 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.534945 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:20.535019 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:20.540884 11873 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.540750 12608 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:20.498400 18400 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.493449 18350 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:20.504508 18438 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:20.553783 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:20.559129 12016 raft_consensus.cc:3060] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.552850 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:20.561460 11837 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:20.563764 11873 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:20.549288 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.550614 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:20.576932 18424 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:20.577579 18424 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:20.578531 18424 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.549247 18375 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.580195 18375 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.555099 18400 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.590757 11865 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:20.547129 18057 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.594624 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.556643 18475 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:20.581192 18455 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.549019 18414 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.580613 18375 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.592765 18388 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:20.604900 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 54356us
I20260709 12:12:20.619976 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.625468 12016 raft_consensus.cc:2468] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:20.570971 18438 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.598356 18485 ts_tablet_manager.cc:1929] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 12:12:20.623972 18433 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.630333 18388 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:20.606420 18475 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.665601 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.666409 11941 raft_consensus.cc:2368] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:20.669356 18183 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:20.669986 18183 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.672099 18183 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.672866 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.673673 11868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 3375) took 1074 ms. Trace:
I20260709 12:12:20.675091 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.676477 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.678272 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.679651 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.680120 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.680632 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.657465 18485 log.cc:1199] T cbba5e6f295144a79461c5afc2e273ae P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/cbba5e6f295144a79461c5afc2e273ae
I20260709 12:12:20.692881 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.674201 11868 rpcz_store.cc:276] 0709 12:12:19.599332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.328114 (+728782us) service_pool.cc:224] Handling call
0709 12:12:20.328525 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.345749 (+ 17224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.345780 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.345821 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:20.345857 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.673391 (+327534us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54002d9454. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba33e01 00007f1f1ba3283e 00007f1f209f7419 00007f1f19f6ebd4 00007f1f19f6eb62 00007f1f19f6ea91 00007f1f19f6ea0c 00007f1f19f6dcc2 00007f1f19d6e48c 00007f1f19d6d8c6
0709 12:12:20.673444 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.673605 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39121152}
I20260709 12:12:20.684621 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.685527 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.690027 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.636099 18357 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:20.698334 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.698741 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.701635 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.702075 11940 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:20.703122 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.705919 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.705870 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.705238 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.706718 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.707330 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.710489 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:20.672783 18473 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:20.716292 12017 raft_consensus.cc:2393] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:20.716415 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.714418 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:20.714622 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.718233 11947 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:20.718592 11947 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:20.714417 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.726166 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.726100 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.730053 12610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.733780 18485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58918 (request call id 0) took 2046 ms. Trace:
I20260709 12:12:20.734241 18485 rpcz_store.cc:276] 0709 12:12:18.784556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.843057 (+ 58501us) service_pool.cc:224] Handling call
0709 12:12:18.998257 (+155200us) ts_tablet_manager.cc:1151] Deleting tablet cbba5e6f295144a79461c5afc2e273ae
0709 12:12:19.001690 (+  3433us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:12:20.399514 (+1397824us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:20.588068 (+188554us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:20.733694 (+145626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913814,"tablet-delete.queue_time_us":128285,"thread_start_us":96027,"threads_started":1}
I20260709 12:12:20.740626 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10ddce6896a49a8a2a9ec09702f3ec1" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.741988 11912 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:20.744546 11939 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 24.
I20260709 12:12:20.745453 11943 raft_consensus.cc:1240] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 24 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:20.754943 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.767546 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.769378 11940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:20.771306 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.756349 11947 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.774732 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.775363 11948 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:20.776218 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:20.776773 11948 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:20.777170 11948 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:20.760776 18540 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.776640 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.738234 18357 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.778847 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.779052 18357 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.779420 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.779991 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.780390 18438 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.780658 18176 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:20.781033 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.778015 18540 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.779563 18357 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.781334 18176 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.783743 11946 raft_consensus.cc:2410] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:20.790268 11941 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:20.790622 18540 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.787350 18176 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.793990 18176 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.793817 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.784297 11948 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.807435 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:20.812014 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:20.719743 18388 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.723258 18473 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.797175 18414 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.782562 18539 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.838475 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.841866 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:20.818207 18356 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.847569 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:20.815296 18382 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.869141 11944 raft_consensus.cc:2410] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:20.874082 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.884570 18507 raft_consensus.cc:2749] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.878751 18357 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.891793 18448 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:20.894089 18538 log.cc:927] Time spent T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:20.883894 18382 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.897090 18382 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.897516 11942 raft_consensus.cc:2410] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for term 21 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:12:20.897078 18357 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:20.903541 18542 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:20.904170 18507 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.905264 18507 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.905822 18473 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.895656 18400 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.905850 18448 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.908754 18448 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.909510 11948 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.910920 18448 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.910185 18057 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17.
I20260709 12:12:20.908018 18507 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.917225 18323 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.918114 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:20.917739 18490 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.919976 18490 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:20.922431 18357 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:20.918440 18323 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.924511 18357 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:20.925869 18323 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.923249 18490 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.848906 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet cbba5e6f295144a79461c5afc2e273ae (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:12:20.933852 11758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 93620us
I20260709 12:12:20.930523 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:20.903394 11914 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:20.944988 12019 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:12:20.945194 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 61883.6us
I20260709 12:12:20.947193 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:20.901682 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.933121 11948 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:20.944751 18448 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:20.947329 18475 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:20.970451 18057 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.989248 18540 consensus_queue.cc:1059] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:20.989785 18057 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.990237 12022 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:20.975685 18507 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:20.978381 12604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40986 (request call id 1022) took 1427 ms. Trace:
I20260709 12:12:20.992019 12604 rpcz_store.cc:276] 0709 12:12:19.550741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.550993 (+   252us) service_pool.cc:224] Handling call
0709 12:12:20.978141 (+1427148us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54003bb5d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:12:20.978290 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197660416}
I20260709 12:12:20.992055 18507 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.927282 18357 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.980629 18176 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.981206 18400 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.984278 18375 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:20.948362 18473 raft_consensus.cc:2804] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:20.995728 11771 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 16, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.996732 18507 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:20.999610 18176 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.991884 18057 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:20.950718 18480 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.987623 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:20.987952 11768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 127) took 14862 ms (client timeout 15000 ms). Trace:
I20260709 12:12:20.988085 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:20.988801 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.004456 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:20.986833 11839 leader_election.cc:400] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:21.000797 11771 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.006516 11839 leader_election.cc:403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.010905 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:21.013563 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.015609 12021 raft_consensus.cc:2368] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:21.015942 18480 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:21.016952 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:21.003746 11768 rpcz_store.cc:269] 0709 12:12:06.125681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.127741 (+  2060us) service_pool.cc:224] Handling call
0709 12:12:20.987892 (+14860151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:18.156062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:18.156813 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:18.156859 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:12:18.156878 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:18.157911 (+  1033us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:18.157984 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:18.158019 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:18.158721 (+   702us) tablet.cc:701] Row locks acquired
0709 12:12:18.158742 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:18.158915 (+   173us) write_op.cc:270] Start()
0709 12:12:18.159057 (+   142us) write_op.cc:276] Timestamp: P: 1783599138158857 usec, L: 0
0709 12:12:18.159082 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:18.248258 (+ 89176us) log.cc:844] Serialized 2835 byte log entry
0709 12:12:18.577825 (+329567us) op_driver.cc:464] REPLICATION: finished
0709 12:12:18.810355 (+232530us) write_op.cc:301] APPLY: starting
0709 12:12:18.821737 (+ 11382us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:18.976962 (+155225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:18.996328 (+ 19366us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:19.010869 (+ 14541us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:19.011130 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:12:19.011181 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:19.011475 (+   294us) log.cc:844] Serialized 73 byte log entry
0709 12:12:19.011674 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.011798 (+   124us) write_op.cc:454] Released schema lock
0709 12:12:19.011857 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:19.012332 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.012364 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":522794,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":211851,"apply.run_cpu_time_us":13037,"apply.run_wall_time_us":207079,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":283999,"prepare.run_cpu_time_us":5852,"prepare.run_wall_time_us":169297,"raft.queue_time_us":185845,"raft.run_cpu_time_us":38074,"raft.run_wall_time_us":154494,"replication_time_us":413826,"spinlock_wait_cycles":2816,"thread_start_us":436223,"threads_started":4,"wal-append.queue_time_us":38499,"wal-append.run_cpu_time_us":90084,"wal-append.run_wall_time_us":1730117}]]}
I20260709 12:12:21.018913 12605 raft_consensus.cc:1240] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.008217 11771 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 17, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:21.022310 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:21.022677 11771 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.015965 18375 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:21.033854 11947 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:20.993476 18448 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.002571 18473 raft_consensus.cc:697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:21.033094 11771 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 12, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 12 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.018637 18433 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.019481 18507 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:21.038583 11771 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.030646 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.048782 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.050904 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.051401 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.052045 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.052659 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
W20260709 12:12:21.056334 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 187538us
I20260709 12:12:21.057916 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.045202 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.033296 18388 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:21.060586 11947 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 14.
I20260709 12:12:21.061098 11771 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.062443 11947 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:21.062461 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.063695 11771 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 17, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.066433 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.069003 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.065367 11771 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 14 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.070521 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.071264 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:21.071020 11771 catalog_manager.cc:5697] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 14, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.073732 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.075876 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.076318 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.076867 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.080992 12020 raft_consensus.cc:1240] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:21.081259 12013 raft_consensus.cc:1240] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:21.073753 11771 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.082764 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:21.083364 12017 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.083521 11771 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 14, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.086131 11771 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 7 to 9, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 9 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.090354 11945 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:21.090880 18448 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.092341 18375 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.093165 18473 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.077787 18183 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.086686 18480 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.099133 11771 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 17, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.101339 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.101082 11771 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 15, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 15 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.103665 11941 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:21.103403 11771 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.116110 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:21.075374 18523 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.071798 18427 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:21.080521 18450 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.118325 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.129370 12017 raft_consensus.cc:2468] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:21.136484 11771 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 14, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 14 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:21.136475 18375 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.140894 12016 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:21.124747 18455 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:21.175478 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.102105 18344 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:21.183259 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 65018.9us
I20260709 12:12:21.159072 11771 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 16, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.125936 18507 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.192803 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:21.185973 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.203812 11948 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:21.184062 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.181597 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.211298 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.217183 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:21.218546 11914 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.223369 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:21.224021 11939 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.224943 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.184037 18183 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.182142 18448 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.228569 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.209507 18475 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.231655 11839 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.181084 18484 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 12:12:21.285211 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53632.1us
I20260709 12:12:21.230005 18344 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.178040 18375 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.220618 18348 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.220837 18069 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.232394 18438 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.232434 18388 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:21.255371 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 53564.7us
I20260709 12:12:21.233383 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:21.221130 18450 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.282577 11939 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
W20260709 12:12:21.297746 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64441us
I20260709 12:12:21.226516 18507 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.286067 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.234872 18475 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.238803 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.286813 18448 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.302831 18448 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.302958 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:21.303941 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.305009 11839 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.305727 18455 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:21.306138 18455 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:21.306342 18388 raft_consensus.cc:2749] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.306670 18455 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.307549 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.308648 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.306033 18450 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.309808 18507 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.310252 18508 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.310962 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.311681 18508 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:21.313159 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:21.313969 18508 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.314381 18508 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:21.314755 18508 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.316562 18455 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.323042 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:21.323073 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 84369.9us
I20260709 12:12:21.326792 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.327327 12017 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:21.326473 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.324958 18486 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.333899 11872 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:21.326180 18228 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.334709 18228 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:21.335592 18228 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.330099 18450 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:21.336826 18450 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.326455 18473 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:21.338940 18450 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.342979 18375 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:21.344089 18475 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.350528 11939 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:21.333992 18486 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.354382 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:21.357539 11914 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.363119 18473 consensus_queue.cc:1059] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:21.365650 18432 consensus_queue.cc:1059] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:21.367156 18432 raft_consensus.cc:3055] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:21.367638 18432 raft_consensus.cc:740] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:21.357244 18486 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.375581 18450 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:21.378705 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.390125 11839 leader_election.cc:400] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:21.392163 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.392738 12609 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:21.401283 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.401298 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.402848 11865 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 10.
I20260709 12:12:21.404633 11864 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:21.368737 18432 consensus_queue.cc:260] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.378734 18473 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:21.388664 18375 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.418718 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.418813 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.414824 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.397712 18338 raft_consensus.cc:2804] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.397917 18448 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.431638 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.431429 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.443114 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.443843 11872 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.446436 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.450344 11867 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:21.455600 11872 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:21.412878 18473 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
W20260709 12:12:21.488214 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 66483.7us
I20260709 12:12:21.406700 18388 consensus_queue.cc:1059] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:12:21.493242 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 65527.5us
I20260709 12:12:21.441438 18432 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.459853 18448 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:12:21.500600 18388 raft_consensus.cc:3055] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:21.506569 12016 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:21.459775 18338 raft_consensus.cc:697] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:21.424155 18414 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:12:21.442220 18478 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:21.488499 18455 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.458158 18375 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:21.512391 18388 raft_consensus.cc:740] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:21.540813 18523 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.518153 18543 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:12:21.541481 18508 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.550258 18338 consensus_queue.cc:237] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.552322 11865 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:21.565992 18486 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.568686 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.555577 11942 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 24 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:21.556499 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.624455 18486 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:21.626652 11942 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:21.592422 18473 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.560156 11867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.560417 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.576575 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:21.629426 11945 raft_consensus.cc:2368] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:21.629046 18375 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.629066 11873 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:21.642261 18473 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.580472 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.584297 11988 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436
I20260709 12:12:21.597853 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.601039 18508 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:21.684407 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 100180us
I20260709 12:12:21.591982 18543 consensus_queue.cc:1243] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:21.685426 18482 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:21.602820 11868 raft_consensus.cc:1240] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:12:21.685864 18482 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.685812 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.686601 18475 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:21.596863 18388 consensus_queue.cc:260] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.687493 18150 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.687844 18388 raft_consensus.cc:3060] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.688108 18490 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:21.686376 18482 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:21.690599 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.691390 18490 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.692631 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.693457 18490 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.592151 18523 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.701666 18523 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.698498 18414 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:12:21.701808 11867 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:21.711244 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:21.714607 12018 pending_rounds.cc:85] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 8
I20260709 12:12:21.714985 12018 pending_rounds.cc:107] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:21.715233 12018 raft_consensus.cc:2889] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:21.717497 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 137082us
I20260709 12:12:21.717957 12019 raft_consensus.cc:1240] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:21.718341 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.720242 18561 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.721446 18561 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:21.722491 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:21.723627 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.724433 18561 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:21.725764 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.726867 18561 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.734841 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:21.735512 11942 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:21.738699 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 279812us
I20260709 12:12:21.739437 11839 leader_election.cc:400] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:21.742249 11839 leader_election.cc:403] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.724663 18508 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:21.749300 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:21.762255 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:21.763059 11839 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.733641 18475 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.770678 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.772632 11868 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 24 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:12:21.773010 11868 pending_rounds.cc:85] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 14
I20260709 12:12:21.773221 11868 pending_rounds.cc:107] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:12:21.745471 18473 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.773461 11868 raft_consensus.cc:2889] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.697227 18482 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:21.785125 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.783649 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:21.788511 11942 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:21.777978 18475 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.791779 18475 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:21.792732 18408 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:21.796053 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.734782 18561 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:21.736531 18490 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:12:21.800900 18357 consensus_queue.cc:1059] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:21.801496 18427 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:21.802884 18427 raft_consensus.cc:3055] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:21.803246 18427 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:21.804047 18427 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.808434 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:21.811533 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:21.749595 18523 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 17. Current term is 18.
I20260709 12:12:21.805308 18427 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.819096 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.821080 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:21.818301 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:21.769575 18450 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.849295 12017 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:12:21.816339 18563 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:12:21.857785 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65596.7us
I20260709 12:12:21.862679 12022 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:21.847628 18388 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.871909 18490 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:21.886912 18568 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:21.879050 18348 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:21.912659 18482 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:21.917182 12013 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:21.918015 11869 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:21.925648 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:21.923888 18388 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:12:21.933676 18507 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:21.934105 18507 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:21.934930 18507 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:21.936101 18382 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:21.946996 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:21.975149 18228 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:22.041848 18578 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:21.979568 18400 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:22.031297 18568 log.cc:927] Time spent T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:22.091352 18473 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:22.091892 18473 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.106932 18576 log.cc:927] Time spent T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.205s	user 0.000s	sys 0.003s
I20260709 12:12:22.118175 18490 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:22.120008 18580 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:12:22.160835 18507 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:22.185231 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 93092.8us
I20260709 12:12:22.194535 11867 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:22.202587 11868 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:22.183701 18490 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.244717 18484 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:22.259528 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
W20260709 12:12:22.260294 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 306260us
I20260709 12:12:22.260337 11942 raft_consensus.cc:606] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:22.261336 11986 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:22.298063 11942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:22.299001 11942 raft_consensus.cc:606] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:22.299461 11942 raft_consensus.cc:614] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:22.281049 18427 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.348965 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:22.365885 11941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:22.366729 11941 raft_consensus.cc:606] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:22.377233 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.416638 11939 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:22.421495 12016 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:22.372241 18594 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:22.417685 18487 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
W20260709 12:12:22.430672 18582 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:22.472057 18594 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:22.434445 18473 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:22.500983 18338 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:22.557719 11947 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:22.558066 18595 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:12:22.476611 18487 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:22.416152 18572 consensus_queue.cc:1059] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:12:22.583087 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 115405us
W20260709 12:12:22.647572 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.618638 18582 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:22.694423 12016 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:22.730695 11948 raft_consensus.cc:1240] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:22.736773 18605 log.cc:927] Time spent T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:12:22.737821 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 103144us
W20260709 12:12:22.738400 18589 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:22.741271 18594 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:22.754251 18487 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:22.809671 11865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36526 (request call id 2590) took 1038 ms. Trace:
I20260709 12:12:22.810236 11865 rpcz_store.cc:276] 0709 12:12:21.770920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.771386 (+   466us) service_pool.cc:224] Handling call
0709 12:12:21.771678 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:21.772059 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:21.772308 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.327184 (+554876us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.327510 (+   326us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:22.349222 (+ 21712us) log.cc:844] Serialized 52 byte log entry
0709 12:12:22.350825 (+  1603us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:22.351438 (+   613us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.351946 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.352091 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.809407 (+457316us) raft_consensus.cc:1685] finished
0709 12:12:22.809431 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.809605 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50037,"prepare.queue_time_us":60100,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":111,"raft.queue_time_us":10984,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":38744,"spinlock_wait_cycles":92474624,"thread_start_us":552933,"threads_started":3,"wal-append.queue_time_us":313749}
I20260709 12:12:22.818444 18473 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:22.613893 18490 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:22.861099 18353 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:22.869304 18601 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:22.888553 18490 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:22.891444 18416 raft_consensus.cc:3055] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:22.891965 18416 raft_consensus.cc:740] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:22.893036 18416 consensus_queue.cc:260] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:22.929589 18416 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:22.933872 18612 log.cc:927] Time spent T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.081s	user 0.002s	sys 0.003s
W20260709 12:12:23.009465 11988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.919756 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 61744.5us
I20260709 12:12:23.020856 18414 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:23.023049 18414 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.036954 18480 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.038275 18480 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.042196 18480 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.043238 18388 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:23.044499 18388 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.045814 18450 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.047003 18450 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.048900 18414 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.050161 18508 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:23.051383 18508 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.062170 12017 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:23.061736 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.063169 12016 raft_consensus.cc:2468] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:23.063961 18069 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.071270 18388 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.072721 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.065061 18069 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.077037 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.061872 18338 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.079877 18338 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.093652 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:23.097627 18400 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.098688 18400 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.099318 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:23.102097 18400 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.102459 18508 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.103142 18338 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.082938 18069 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.109619 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.111109 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:23.114614 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.117717 12022 raft_consensus.cc:1240] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Rejecting Update request from peer 189a165e6619406382914fe3075dd436 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:12:23.120450 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.124764 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:23.126070 11948 raft_consensus.cc:606] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.137476 18623 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.140841 18069 raft_consensus.cc:993] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:23.141748 18338 raft_consensus.cc:1081] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:23.141885 18382 raft_consensus.cc:993] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:23.142259 18623 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.144747 18382 raft_consensus.cc:1081] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:23.144902 18323 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:23.146204 18448 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.147293 18448 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.148825 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:23.149631 11948 raft_consensus.cc:606] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.150147 11948 raft_consensus.cc:614] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:23.152863 18448 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.153739 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:23.153752 18448 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.170228 18448 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.051944 18450 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.166309 18623 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:23.198834 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45141.6us
I20260709 12:12:23.200129 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.202231 18570 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:23.229686 18591 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:23.230746 18591 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.251466 18566 raft_consensus.cc:476] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:23.256515 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:23.254137 11838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.009s	sys 0.012s
I20260709 12:12:23.257779 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.257962 18591 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.257112 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.274107 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:23.275954 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.276487 18566 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.277202 18616 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:23.277405 18566 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.278276 18616 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.278605 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.280789 18616 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:23.294652 18587 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:23.307291 18057 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:23.308264 18057 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.317278 18622 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:23.317871 18591 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.306722 18448 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.321208 18591 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.326648 18602 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:23.327961 18622 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.330590 18622 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.331863 18057 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.328235 18602 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.337278 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.339748 18602 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:23.347492 12013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.348691 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.356484 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.357450 11865 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:23.360036 11872 raft_consensus.cc:1275] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:23.360635 11872 pending_rounds.cc:85] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting all ops after (but not including) 10
I20260709 12:12:23.361001 11872 pending_rounds.cc:107] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:23.361300 11872 raft_consensus.cc:2889] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:23.361451 11911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.012s
W20260709 12:12:23.361881 12574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.365952 18566 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.367949 18591 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:23.362094 11911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.012s
I20260709 12:12:23.380204 11771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 177) took 11000 ms. Trace:
I20260709 12:12:23.393769 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.400595 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.397459 11872 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:23.408305 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6df9d20345c49f0a6f00d9f5f660140" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.408730 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.414011 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.414963 12019 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:23.413064 11865 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:23.410040 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.415995 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.425776 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.419582 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.427961 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.450518 18601 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.451205 18601 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.428555 18561 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.429237 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.454681 18353 consensus_queue.cc:1059] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:23.429834 18323 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:23.429306 12021 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:23.456235 18615 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:23.456784 18615 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:23.456487 18323 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.458768 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.459455 18323 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:23.460763 18615 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.432492 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.462797 18615 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.463260 18591 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.433382 11872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:23.465179 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.465975 18601 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.436160 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.436600 12609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:23.445747 11868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:23.449571 18599 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.467775 18599 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.470440 18599 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.470906 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.435561 12022 raft_consensus.cc:2393] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:23.471131 11868 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.466058 11872 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.473709 11868 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.474066 11872 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.475459 18570 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.511456 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:23.512748 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.519234 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:23.541895 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.535290 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.529048 18400 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.546240 11942 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:23.557207 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.561014 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.563405 11946 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:23.568274 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.574497 11839 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.580130 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.581756 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.582258 18616 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:23.582706 11870 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:23.586472 18450 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.587729 11988 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.587119 18414 consensus_queue.cc:1059] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:23.591962 18323 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:23.592862 18323 raft_consensus.cc:3055] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.580358 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.553758 18400 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.593297 18323 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:23.603935 18400 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.580207 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.630666 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.652258 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.654924 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.653970 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:23.658103 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.658749 11868 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.672783 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:23.675143 11946 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:23.676208 11868 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.380908 11771 rpcz_store.cc:276] 0709 12:12:12.380193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.381847 (+  1654us) service_pool.cc:224] Handling call
0709 12:12:23.379890 (+10998043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:21.339734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:21.340294 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:21.340328 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:12:21.340354 (+    26us) tablet.cc:662] Decoding operations
0709 12:12:21.341845 (+  1491us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:21.341929 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:21.341957 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:12:21.343320 (+  1363us) tablet.cc:701] Row locks acquired
0709 12:12:21.343340 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:12:21.343489 (+   149us) write_op.cc:270] Start()
0709 12:12:21.343603 (+   114us) write_op.cc:276] Timestamp: P: 1783599141343438 usec, L: 0
0709 12:12:21.343627 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:21.344358 (+   731us) log.cc:844] Serialized 7103 byte log entry
0709 12:12:21.437823 (+ 93465us) op_driver.cc:464] REPLICATION: finished
0709 12:12:21.494927 (+ 57104us) write_op.cc:301] APPLY: starting
0709 12:12:21.509668 (+ 14741us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:21.610792 (+101124us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800305920. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f2180eab1 00007f1f2181b281 00007f1f1b5db4bc 00007f1f1892948b 00007f1f217839a9 00007f1f1894569b 00007f1f1894393f 00007f1f18943455 00007f1f1b9b0190 00007f1f1b9a9ae7 00007f1f1b9a8dd9
0709 12:12:21.648370 (+ 37578us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:21.648401 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:21.900810 (+252409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:21.901163 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 12:12:21.901206 (+    43us) write_op.cc:312] APPLY: finished
0709 12:12:21.904867 (+  3661us) log.cc:844] Serialized 164 byte log entry
0709 12:12:21.906019 (+  1152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:21.906316 (+   297us) write_op.cc:454] Released schema lock
0709 12:12:21.906391 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:21.910575 (+  4184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:21.910607 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127815,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":1461,"apply.run_cpu_time_us":25549,"apply.run_wall_time_us":451946,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79475,"num_ops":18,"prepare.queue_time_us":93090,"prepare.run_cpu_time_us":26153,"prepare.run_wall_time_us":72359,"raft.queue_time_us":40331,"raft.run_cpu_time_us":1718,"raft.run_wall_time_us":1949,"replication_time_us":93954,"spinlock_wait_cycles":29586688,"thread_start_us":156021,"threads_started":4,"wal-append.queue_time_us":49500,"wal-append.run_cpu_time_us":13736,"wal-append.run_wall_time_us":1511798}]]}
I20260709 12:12:23.680641 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.664505 18616 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.685161 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.687036 18433 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.675237 18570 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.698966 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:23.690783 18616 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.713439 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.712561 18616 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.703258 18601 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:23.733265 11839 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:23.749051 18561 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.750181 11871 raft_consensus.cc:1240] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:23.761276 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.736356 18473 consensus_queue.cc:1048] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:23.771768 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:23.779158 18631 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:23.725775 18601 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting leader election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.780609 18601 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:23.710325 11770 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:23.753455 18433 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.752961 18323 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.792796 18323 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.793468 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:23.722280 18353 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.805791 18353 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.806254 18353 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:23.813292 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 83930us
I20260709 12:12:23.815287 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:23.788875 11770 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:23.758213 18561 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:23.836359 18561 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.842700 18600 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.846658 11770 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 13 to 15, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 15 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.852146 18433 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:23.821628 18480 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:23.857090 18480 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.859500 18480 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:23.862067 18635 log.cc:927] Time spent T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:23.868922 11872 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:23.873472 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:23.876428 11864 raft_consensus.cc:1240] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Rejecting Update request from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.884166 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:23.885880 18057 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:23.888857 11988 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.849354 11770 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:23.894088 18623 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.923862 11872 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:23.900765 18561 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:23.935869 18561 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:23.935070 11770 catalog_manager.cc:5697] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:23.944054 18540 raft_consensus.cc:993] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:23.944736 18540 raft_consensus.cc:1081] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
W20260709 12:12:23.954574 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 221428us
I20260709 12:12:23.956856 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.963904 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:23.968036 11770 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 13 to 15, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:23.965024 18448 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.979638 11770 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 16 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 18 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:23.996227 18639 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:24.006707 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.007496 12019 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:24.007942 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 192650us
I20260709 12:12:24.009336 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.016178 11988 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.024044 18602 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:24.031848 11770 catalog_manager.cc:5697] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:24.034463 18354 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:24.033895 11770 catalog_manager.cc:5697] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 15, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 15 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:24.035110 18354 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.035597 18354 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.993718 18616 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.037328 11865 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:24.038727 18616 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.040596 18353 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.048687 11939 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
W20260709 12:12:24.019510 18632 log.cc:927] Time spent T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.156s	user 0.005s	sys 0.001s
I20260709 12:12:23.987895 18601 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.053267 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.070439 18540 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:24.071465 18645 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:24.071306 18540 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.072245 18645 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.074086 18592 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:24.074901 18353 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.074864 18592 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:24.084059 18634 log.cc:927] Time spent T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
W20260709 12:12:24.085606 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 232846us
I20260709 12:12:24.074914 18645 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.089339 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.089732 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.097070 18594 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.098379 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:24.099133 12607 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.104543 18354 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.063685 11770 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:24.107625 18601 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.109741 18599 consensus_queue.cc:1059] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:24.130036 18599 raft_consensus.cc:3055] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:24.130656 18599 raft_consensus.cc:740] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:24.132017 18599 consensus_queue.cc:260] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:24.133738 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44513.8us
I20260709 12:12:24.113353 18540 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.111346 18353 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:24.133731 11986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.136157 18473 consensus_queue.cc:1059] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:24.133708 18599 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.137475 18473 raft_consensus.cc:3055] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.137930 18473 raft_consensus.cc:740] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:24.139117 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.139230 18473 consensus_queue.cc:260] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.141028 18608 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.141614 18608 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.142741 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.126426 12019 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:24.144245 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.144564 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.144950 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
W20260709 12:12:24.145401 11911 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.145619 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:24.144122 18608 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.118548 18566 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:24.144987 11943 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.149802 18566 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.122313 18323 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.151757 18323 consensus_queue.cc:1059] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:24.152539 18323 consensus_queue.cc:1243] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer 4d7b7ec0a2604d808698037dbd6fa1ef log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:24.153198 18644 raft_consensus.cc:3055] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:24.153353 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:24.145118 11947 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.153736 18644 raft_consensus.cc:740] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:24.154346 11943 raft_consensus.cc:2393] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 20: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:24.155269 18644 consensus_queue.cc:260] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.156719 18644 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.158856 18566 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:24.169314 18473 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.170172 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:24.171047 11868 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:24.110873 18592 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.126297 11770 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:24.172739 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:24.173563 12604 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 11.
W20260709 12:12:24.134542 18400 consensus_meta.cc:287] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.003s
I20260709 12:12:24.179159 18400 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.182350 12017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb26c79d86d449786430b604fee9561"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:12:24.196552 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.197149 12017 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:24.197378 11948 raft_consensus.cc:2368] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.197695 12017 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.199975 18480 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:24.200621 18480 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.185670 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:24.186561 11864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.202864 11864 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.203739 18480 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:24.186574 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.205276 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:24.205853 12016 raft_consensus.cc:3060] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.167891 11946 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:24.188333 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.189209 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa456bf4db9474f84e2e5a51c919032" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.178299 11837 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:24.190378 11839 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:24.158722 18354 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:24.189334 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.196348 12607 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:24.212072 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 21.
I20260709 12:12:24.212990 11943 raft_consensus.cc:1240] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:24.216652 18645 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.230396 18616 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:24.231037 18616 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:24.231482 18616 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:24.224635 18645 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:24.233369 18645 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.240937 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:24.199653 18400 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.215128 18353 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:24.266592 12016 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:24.266999 11837 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:24.269595 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.270370 12019 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:24.270495 11864 raft_consensus.cc:2468] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:24.271224 11839 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.272095 11839 leader_election.cc:403] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.273947 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.275867 18639 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.277740 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.277850 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.278499 11866 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.279908 18382 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:24.281576 11914 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.284945 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:24.286273 11839 leader_election.cc:400] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.286693 11839 leader_election.cc:403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.287163 18592 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.297911 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.298774 12016 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.287557 12017 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.299292 11914 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:24.299939 11987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.304652 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:24.304387 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:24.306242 18615 raft_consensus.cc:2804] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.308081 11839 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:24.285557 18639 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:24.313920 18348 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.314111 18641 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:24.295405 18353 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:24.313714 12017 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:24.314693 18640 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:24.328974 18640 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:24.330132 18640 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.314538 18566 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.331811 18566 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:24.342082 18639 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.315438 18615 raft_consensus.cc:697] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:24.346729 18615 consensus_queue.cc:237] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.314635 18641 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.350601 18641 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:24.355975 12016 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
W20260709 12:12:24.359943 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 75130.9us
I20260709 12:12:24.332865 18566 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.389166 11866 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:24.396004 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.391352 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:24.399569 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 80373.3us
I20260709 12:12:24.406592 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.407136 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.407553 12014 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:24.408990 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.410359 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff67aad7c28488cbcaa11428b8d0954" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.411139 12022 raft_consensus.cc:2368] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.391621 18591 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949) with higher term. Message: Invalid argument: T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.411388 18616 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.413515 11873 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 11.
I20260709 12:12:24.403775 18570 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.415246 18570 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:24.416226 18570 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.433626 12019 raft_consensus.cc:2410] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:12:24.453115 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.453917 11939 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.466636 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.467751 11873 raft_consensus.cc:3060] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.468361 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:24.470803 18650 log.cc:927] Time spent T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:12:24.474002 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:24.474965 11943 raft_consensus.cc:3055] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.474987 18354 raft_consensus.cc:2764] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:24.475605 11943 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:24.472066 11946 raft_consensus.cc:1240] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:24.483949 11939 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:24.485663 11941 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:24.496554 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.497769 11873 raft_consensus.cc:2468] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:24.498309 12019 raft_consensus.cc:2393] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 11: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:24.476847 11943 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.494592 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.512080 11870 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.515581 11943 raft_consensus.cc:3060] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.515745 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:24.516582 11839 leader_election.cc:400] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 19. Current term is 20.
I20260709 12:12:24.517932 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.521040 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.521878 18592 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.522657 18592 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.453667 18641 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.525753 12607 raft_consensus.cc:2368] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:24.525952 18641 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:24.538175 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:24.546504 12020 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:24.516868 18616 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:24.550086 11837 leader_election.cc:400] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:24.550944 11837 leader_election.cc:403] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.556412 18645 raft_consensus.cc:3060] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:24.584111 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:24.585579 11943 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:24.587028 11870 raft_consensus.cc:2468] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:24.588716 12020 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
W20260709 12:12:24.591697 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 77855.1us
I20260709 12:12:24.590543 12577 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:24.550014 18639 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:24.601632 18639 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.598152 18328 raft_consensus.cc:2804] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:24.605073 18328 raft_consensus.cc:697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:24.607489 18328 consensus_queue.cc:237] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:24.624208 18639 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:24.638496 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46065.8us
I20260709 12:12:24.642014 11988 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:24.657671 11988 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:24.658397 18150 raft_consensus.cc:2804] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.659070 18150 raft_consensus.cc:697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:24.660209 18150 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.661810 18433 raft_consensus.cc:2804] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.662431 18433 raft_consensus.cc:697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:24.663386 18433 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.669883 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:24.670868 11943 raft_consensus.cc:2393] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:24.682593 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:24.689865 18354 consensus_queue.cc:1059] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:24.690572 18645 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553) with higher term. Message: Invalid argument: T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 11. Current term is 12.
I20260709 12:12:24.691187 18354 raft_consensus.cc:3055] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:24.691620 18354 raft_consensus.cc:740] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:24.692580 18354 consensus_queue.cc:260] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:24.705562 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:24.713361 11873 raft_consensus.cc:2468] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 12.
I20260709 12:12:24.724398 18354 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:24.736241 18639 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.747143 11945 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:24.747023 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 52403.2us
I20260709 12:12:24.772228 18639 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.777753 18591 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:12:24.801774 12020 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:24.821807 12020 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:24.823704 18473 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:24.828714 11873 raft_consensus.cc:1275] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:24.834256 18473 consensus_queue.cc:1048] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:24.845302 18591 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:24.868211 12021 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:24.870959 11865 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:24.871064 18473 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:24.876730 18354 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:24.892015 12607 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:24.904193 18639 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:12:24.934255 11941 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:24.936388 18658 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:24.950495 11945 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:24.953990 18566 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:24.990447 18671 log.cc:927] Time spent T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:25.017426 18473 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.018167 18473 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.020493 18473 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:25.030373 12019 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:25.032413 18566 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:25.033272 18566 consensus_queue.cc:1243] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Peer 46f08e8ff3774f25acad18252e5cd57d log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:25.040966 12019 raft_consensus.cc:1217] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Deduplicated request from leader. Original: 17.9->[18.10-21.12]   Dedup: 18.10->[19.11-21.12]
I20260709 12:12:25.044277 12019 pending_rounds.cc:85] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Aborting all ops after (but not including) 10
I20260709 12:12:25.044690 12019 pending_rounds.cc:107] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:12:25.044996 12019 raft_consensus.cc:2889] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:25.054448 11948 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:25.057852 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:25.061450 18616 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:25.065366 11865 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:25.061714 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:25.068710 12018 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:25.083691 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:25.085811 18615 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.086292 18615 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.086669 18615 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.095767 18473 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:25.160956 11869 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:25.170889 18478 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:25.225492 18615 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.227880 18615 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:25.229395 12021 raft_consensus.cc:1275] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:25.231936 18328 consensus_queue.cc:1048] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:25.239058 11946 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:25.240972 11943 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:25.245257 18594 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:25.250321 18675 log.cc:927] Time spent T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:25.262362 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:25.292886 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:25.293969 12019 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.324402 12019 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:25.282743 18658 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:12:25.313766 18592 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:25.340227 18592 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.365602 18592 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:25.376694 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 67809us
I20260709 12:12:25.339093 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:25.393707 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 99321.4us
I20260709 12:12:25.400467 11869 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:25.406227 11914 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:25.417970 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 118555us
I20260709 12:12:25.426848 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:25.427596 18473 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:25.428654 11768 catalog_manager.cc:5697] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.430130 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 228) took 11035 ms. Trace:
I20260709 12:12:25.430552 11768 catalog_manager.cc:5697] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 18 to 23, leader changed from 189a165e6619406382914fe3075dd436 (127.10.114.68) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 23 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:25.432308 11768 catalog_manager.cc:5697] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:25.438009 11768 catalog_manager.cc:5697] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 16 to 17, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 17 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.443531 11768 catalog_manager.cc:5697] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.430519 11770 rpcz_store.cc:276] 0709 12:12:14.397866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.398793 (+   927us) service_pool.cc:224] Handling call
0709 12:12:25.430044 (+11031251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:24.541892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:24.542668 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:24.542733 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:12:24.542755 (+    22us) tablet.cc:662] Decoding operations
0709 12:12:24.549800 (+  7045us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:24.552345 (+  2545us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:24.552396 (+    51us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:12:24.612950 (+ 60554us) tablet.cc:701] Row locks acquired
0709 12:12:24.613003 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:12:24.613230 (+   227us) write_op.cc:270] Start()
0709 12:12:24.613419 (+   189us) write_op.cc:276] Timestamp: P: 1783599144613156 usec, L: 0
0709 12:12:24.613458 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:12:24.614405 (+   947us) log.cc:844] Serialized 4475 byte log entry
0709 12:12:24.765283 (+150878us) op_driver.cc:464] REPLICATION: finished
0709 12:12:24.858760 (+ 93477us) write_op.cc:301] APPLY: starting
0709 12:12:24.858905 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:24.936007 (+ 77102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:24.936137 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:25.068995 (+132858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:25.069431 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:12:25.069510 (+    79us) write_op.cc:312] APPLY: finished
0709 12:12:25.069992 (+   482us) log.cc:844] Serialized 105 byte log entry
0709 12:12:25.084671 (+ 14679us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.085256 (+   585us) write_op.cc:454] Released schema lock
0709 12:12:25.085344 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.103453 (+ 18109us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.103489 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"spinlock_wait_cycles":13184,"child_traces":[["op",{"apply.queue_time_us":86366,"apply.run_cpu_time_us":22063,"apply.run_wall_time_us":248464,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":178621,"prepare.run_cpu_time_us":44578,"prepare.run_wall_time_us":165362,"raft.queue_time_us":38732,"raft.run_cpu_time_us":12504,"raft.run_wall_time_us":38258,"replication_time_us":150041,"spinlock_wait_cycles":779264,"thread_start_us":288434,"threads_started":4,"wal-append.queue_time_us":107226}]]}
I20260709 12:12:25.460580 11868 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:25.471623 11768 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 8 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 10 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.478775 11768 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 15 to 21, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 21 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.506953 11768 catalog_manager.cc:5697] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.508798 11768 catalog_manager.cc:5697] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 16, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 16 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.472831 18473 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:25.511585 11768 catalog_manager.cc:5697] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 17 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 18 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.523910 11768 catalog_manager.cc:5697] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 15 to 16, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 16 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.525740 18602 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:25.527118 11768 catalog_manager.cc:5697] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.530119 18473 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.545485 18414 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:25.556658 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:25.557519 12018 raft_consensus.cc:2368] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19.
I20260709 12:12:25.606196 11839 leader_election.cc:400] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19.
I20260709 12:12:25.606745 11839 leader_election.cc:403] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:25.609823 18690 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.720860 18695 log.cc:927] Time spent T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:12:25.763945 18690 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 18. Current term is 19.
I20260709 12:12:25.922255 18684 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.923075 18684 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.923317 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:25.924146 12021 raft_consensus.cc:606] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:25.924576 12021 raft_consensus.cc:614] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:25.925514 18684 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:25.938161 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1867813aeb8b457984895a6ccb759346"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:25.940719 12021 raft_consensus.cc:606] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:25.948359 12021 raft_consensus.cc:614] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:25.959290 18687 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:25.960057 18687 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:25.977821 18687 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:25.980306 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:25.981516 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" is_pre_election: true
I20260709 12:12:25.983738 11943 raft_consensus.cc:2393] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef in current term 22: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:25.984325 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:25.982800 11869 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:26.004439 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:26.012619 18683 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:26.013156 18683 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.013494 18683 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:26.037953 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "189a165e6619406382914fe3075dd436"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:26.038748 12021 raft_consensus.cc:606] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Received request to transfer leadership to TS 189a165e6619406382914fe3075dd436
I20260709 12:12:26.039116 12021 raft_consensus.cc:614] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:26.051308 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 45140.5us
I20260709 12:12:26.080773 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:26.081457 12021 raft_consensus.cc:606] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:26.081851 12021 raft_consensus.cc:614] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:26.088450 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:26.094627 11768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34188 (request call id 128) took 4606 ms. Trace:
I20260709 12:12:26.108214 12018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:26.108974 12018 raft_consensus.cc:606] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:26.112485 11948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:26.113168 11948 raft_consensus.cc:606] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:26.094280 11769 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.115203 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:26.115862 11769 catalog_manager.cc:5697] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 16, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.095036 11768 rpcz_store.cc:276] 0709 12:12:21.488236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.493202 (+  4966us) service_pool.cc:224] Handling call
0709 12:12:26.094544 (+4601342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:25.749976 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:25.750643 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:25.750688 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:12:25.750706 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:25.753169 (+  2463us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:25.753265 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:25.753297 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:12:25.754578 (+  1281us) tablet.cc:701] Row locks acquired
0709 12:12:25.754600 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:25.754749 (+   149us) write_op.cc:270] Start()
0709 12:12:25.754863 (+   114us) write_op.cc:276] Timestamp: P: 1783599145754702 usec, L: 0
0709 12:12:25.754886 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:25.801023 (+ 46137us) log.cc:844] Serialized 4813 byte log entry
0709 12:12:25.860792 (+ 59769us) op_driver.cc:464] REPLICATION: finished
0709 12:12:25.922947 (+ 62155us) write_op.cc:301] APPLY: starting
0709 12:12:25.923043 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:25.933175 (+ 10132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:25.933294 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:25.940134 (+  6840us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:25.940413 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:12:25.940462 (+    49us) write_op.cc:312] APPLY: finished
0709 12:12:25.940800 (+   338us) log.cc:844] Serialized 113 byte log entry
0709 12:12:25.941672 (+   872us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.941840 (+   168us) write_op.cc:454] Released schema lock
0709 12:12:25.941900 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.942372 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.942406 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52152,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":61873,"apply.run_cpu_time_us":15620,"apply.run_wall_time_us":19402,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":187914,"prepare.run_cpu_time_us":5188,"prepare.run_wall_time_us":58317,"replication_time_us":105703,"thread_start_us":198314,"threads_started":2}]]}
I20260709 12:12:26.117338 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:26.138387 18683 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.139533 12019 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:26.140146 12020 raft_consensus.cc:2368] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 22. Current term is 23.
I20260709 12:12:26.140856 18683 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 23 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:26.122046 11769 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.105183 12604 consensus_queue.cc:237] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:26.147873 11868 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:26.153147 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.159057 11769 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 14 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.160882 11769 catalog_manager.cc:5697] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 18 to 19, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.171931 11769 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.174103 11769 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.175691 11769 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 14 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.179880 18615 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:26.185999 18686 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:26.203881 11769 catalog_manager.cc:5697] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.208663 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:26.209398 11865 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:26.209326 11839 leader_election.cc:400] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 22. Current term is 23.
I20260709 12:12:26.210537 11839 leader_election.cc:403] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:26.212213 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:26.212844 11941 raft_consensus.cc:3060] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:26.209290 11769 catalog_manager.cc:5697] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.218724 12020 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:26.234066 11944 raft_consensus.cc:1275] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:26.216408 11769 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 20, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.266292 11941 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 23.
I20260709 12:12:26.261792 11769 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 16, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.268857 11769 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 20, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 20 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.275084 11988 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:26.238034 18661 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:12:26.276173 18703 raft_consensus.cc:2804] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:26.276836 18703 raft_consensus.cc:697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:26.276613 18356 consensus_queue.cc:1048] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:26.277866 18703 consensus_queue.cc:237] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.286654 11769 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 11 to 13, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 13 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.292723 11769 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 16, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.299060 18354 raft_consensus.cc:993] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:26.299682 18354 raft_consensus.cc:1081] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:26.304608 11769 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 21 to 24, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 24 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.307505 11769 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 13 to 19, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.312204 11769 catalog_manager.cc:5697] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 19, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.313825 11769 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 17, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 17 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.315150 11769 catalog_manager.cc:5697] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:26.316480 11769 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.322516 11769 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:26.330399 18707 log.cc:927] Time spent T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:12:26.417385 11865 raft_consensus.cc:2468] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 23.
I20260709 12:12:26.424216 18592 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161) with higher term. Message: Invalid argument: T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 22. Current term is 23.
I20260709 12:12:26.497334 18473 raft_consensus.cc:993] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:26.497987 18473 raft_consensus.cc:1081] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:26.513720 11865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:26.514483 11865 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:26.514897 11865 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:26.520068 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 279649us
I20260709 12:12:26.533767 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:26.534435 11873 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:26.534813 11873 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:26.536828 18708 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.293s	user 0.008s	sys 0.000s
I20260709 12:12:26.573400 11865 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.575839 11865 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:26.611063 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:26.612174 11943 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:26.613287 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:26.613945 12018 raft_consensus.cc:3055] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:26.614243 12018 raft_consensus.cc:740] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:26.615222 12018 consensus_queue.cc:260] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.616678 12018 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:26.610404 11873 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.657794 11943 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:12:26.676445 11873 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:26.699797 12018 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 10.
I20260709 12:12:26.705158 11839 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:26.707887 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:26.708992 11943 raft_consensus.cc:3055] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:26.709619 11943 raft_consensus.cc:740] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:26.710461 11943 consensus_queue.cc:260] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.718863 11943 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.727684 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:26.728426 12020 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.722980 18591 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:26.761888 18591 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:26.763171 18591 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.756738 11943 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:26.748936 12020 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
W20260709 12:12:26.787856 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65424.3us
W20260709 12:12:26.803356 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 75576.2us
I20260709 12:12:26.806988 18478 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 9 to 14, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:26.818472 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 89081.2us
I20260709 12:12:26.852352 12020 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 9 to 14, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:26.860062 11943 raft_consensus.cc:2955] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 9 to 14, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:26.832592 11839 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:26.915153 11945 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:26.934320 18150 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:26.935305 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 102841us
I20260709 12:12:26.938936 18724 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.950034 18724 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:26.951326 18724 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:26.960263 11756 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecd86af74b304d58a84939321319d52b with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:26.992733 11870 raft_consensus.cc:1275] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:27.043308 11768 catalog_manager.cc:5697] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.045270 11768 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 13 to 14, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 14 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:27.071101 11768 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 17 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 18 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:27.096091 11769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57560 (request call id 178) took 2341 ms. Trace:
I20260709 12:12:27.096629 11769 rpcz_store.cc:276] 0709 12:12:24.748834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.750784 (+  1950us) service_pool.cc:224] Handling call
0709 12:12:27.090239 (+2339455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:26.503865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:26.504587 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:26.504629 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:12:26.504651 (+    22us) tablet.cc:662] Decoding operations
0709 12:12:26.506565 (+  1914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:26.506662 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:26.506699 (+    37us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:12:26.508344 (+  1645us) tablet.cc:701] Row locks acquired
0709 12:12:26.508366 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:26.508527 (+   161us) write_op.cc:270] Start()
0709 12:12:26.508652 (+   125us) write_op.cc:276] Timestamp: P: 1783599146508467 usec, L: 0
0709 12:12:26.508674 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:26.509435 (+   761us) log.cc:844] Serialized 8690 byte log entry
0709 12:12:26.714068 (+204633us) op_driver.cc:464] REPLICATION: finished
0709 12:12:26.836050 (+121982us) write_op.cc:301] APPLY: starting
0709 12:12:26.836153 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:26.891917 (+ 55764us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:26.892120 (+   203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:27.013579 (+121459us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:27.019728 (+  6149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:12:27.019784 (+    56us) write_op.cc:312] APPLY: finished
0709 12:12:27.020262 (+   478us) log.cc:844] Serialized 196 byte log entry
0709 12:12:27.020458 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:27.020696 (+   238us) write_op.cc:454] Released schema lock
0709 12:12:27.020762 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:27.062967 (+ 42205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:27.063008 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":48,"spinlock_wait_cycles":21376,"child_traces":[["op",{"apply.queue_time_us":121637,"apply.run_cpu_time_us":30648,"apply.run_wall_time_us":226910,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96219,"num_ops":22,"prepare.queue_time_us":157509,"prepare.run_cpu_time_us":6060,"prepare.run_wall_time_us":123204,"replication_time_us":205184,"spinlock_wait_cycles":2304,"thread_start_us":201690,"threads_started":2}]]}
I20260709 12:12:27.122603 18733 consensus_queue.cc:1048] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:27.143854 11768 catalog_manager.cc:5697] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 9 to 14, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 21 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.205327 11771 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 18 to 19, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.219221 11771 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.246902 11771 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.327127 11771 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.361057 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd86af74b304d58a84939321319d52b with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:53162
I20260709 12:12:27.385043 11768 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.387221 11768 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 17, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 17 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.388981 11768 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 19, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.407820 11939 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:27.411126 18742 tablet_replica.cc:333] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:27.418774 18724 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:27.429497 12018 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:27.431744 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.437981 11768 catalog_manager.cc:5697] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.431246 18742 raft_consensus.cc:2243] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.441272 11768 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 21, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 21 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.444804 11768 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.447230 18742 raft_consensus.cc:2272] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.450474 11768 catalog_manager.cc:5697] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.452390 18742 ts_tablet_manager.cc:1916] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:27.436519 18591 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:12:27.459287 11943 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:27.478116 11771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57556 (request call id 196) took 3109 ms. Trace:
I20260709 12:12:27.483431 12021 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:27.478664 11771 rpcz_store.cc:276] 0709 12:12:24.368916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.369215 (+   299us) service_pool.cc:224] Handling call
0709 12:12:27.478037 (+3108822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:27.340094 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:27.340714 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:27.340758 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:12:27.340786 (+    28us) tablet.cc:662] Decoding operations
0709 12:12:27.341484 (+   698us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:27.341581 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:27.341615 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:27.342097 (+   482us) tablet.cc:701] Row locks acquired
0709 12:12:27.342123 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:12:27.342297 (+   174us) write_op.cc:270] Start()
0709 12:12:27.342432 (+   135us) write_op.cc:276] Timestamp: P: 1783599147342242 usec, L: 0
0709 12:12:27.342456 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:27.343257 (+   801us) log.cc:844] Serialized 1702 byte log entry
0709 12:12:27.348591 (+  5334us) op_driver.cc:464] REPLICATION: finished
0709 12:12:27.350346 (+  1755us) write_op.cc:301] APPLY: starting
0709 12:12:27.350449 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:27.353149 (+  2700us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:27.353266 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:27.372101 (+ 18835us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:27.372304 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:12:27.372352 (+    48us) write_op.cc:312] APPLY: finished
0709 12:12:27.372620 (+   268us) log.cc:844] Serialized 49 byte log entry
0709 12:12:27.373563 (+   943us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:27.373691 (+   128us) write_op.cc:454] Released schema lock
0709 12:12:27.373743 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:27.374136 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:27.374167 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9661,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1495,"apply.run_cpu_time_us":6988,"apply.run_wall_time_us":23744,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":568,"prepare.run_cpu_time_us":3576,"prepare.run_wall_time_us":20050,"replication_time_us":5983}]]}
I20260709 12:12:27.493763 18724 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:27.518054 18591 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:27.556653 18742 ts_tablet_manager.cc:1929] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 12:12:27.557792 18742 log.cc:1199] T ecd86af74b304d58a84939321319d52b P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/ecd86af74b304d58a84939321319d52b
I20260709 12:12:27.560796 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet ecd86af74b304d58a84939321319d52b (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:12:27.585922 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 79675.5us
I20260709 12:12:27.703529 11768 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 9 to 10, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 10 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.705188 11768 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 18 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:27.730726 11770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57548 (request call id 229) took 1760 ms. Trace:
I20260709 12:12:27.731320 11770 rpcz_store.cc:276] 0709 12:12:25.970633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.970784 (+   151us) service_pool.cc:224] Handling call
0709 12:12:27.730617 (+1759833us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":43}
W20260709 12:12:27.771337 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 121568us
I20260709 12:12:27.780381 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd86af74b304d58a84939321319d52b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 9 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:53162
I20260709 12:12:27.856277 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet ecd86af74b304d58a84939321319d52b (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:12:27.878923 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.268170 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:28.268937 12020 raft_consensus.cc:606] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:28.286934 18150 raft_consensus.cc:993] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.287499 18150 raft_consensus.cc:1081] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.292500 11941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:49986
I20260709 12:12:28.293267 11941 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.293687 11941 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.297174 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628666a2024d4a61831835e7dee5737a"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:28.297923 12020 raft_consensus.cc:606] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:28.301688 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:28.302284 12020 raft_consensus.cc:606] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:28.304104 11941 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.304836 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:28.305402 12020 raft_consensus.cc:606] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:28.308857 12020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:28.309746 12020 raft_consensus.cc:606] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:28.318243 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:28.320569 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.326377 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.339702 11941 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:28.341647 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:28.342332 11865 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.344730 18756 raft_consensus.cc:993] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.345320 18734 raft_consensus.cc:1081] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.347318 11941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "628666a2024d4a61831835e7dee5737a"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:49986
I20260709 12:12:28.347927 11941 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.348279 11941 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.354810 11865 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:28.356055 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:28.356961 12020 raft_consensus.cc:3055] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.357324 12020 raft_consensus.cc:740] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:28.356446 11914 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:28.360468 18686 raft_consensus.cc:2804] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.365392 11941 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.369117 11941 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:28.370611 11865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:28.371285 11865 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.358282 12020 consensus_queue.cc:260] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.377800 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:28.378979 12020 raft_consensus.cc:3060] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.379153 12021 raft_consensus.cc:3055] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:28.379536 12021 raft_consensus.cc:740] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:28.385200 11865 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:28.387450 11914 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:28.389621 18715 raft_consensus.cc:2804] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:28.390163 18715 raft_consensus.cc:697] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:28.391188 18715 consensus_queue.cc:237] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:28.400219 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 6e6c59801bf644679a9e155c914bbc97: Remote error: Service unavailable: leader transfer in progress
I20260709 12:12:28.380374 12021 consensus_queue.cc:260] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.402801 12021 raft_consensus.cc:3060] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.408919 12022 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:28.420091 18756 raft_consensus.cc:993] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.420717 18150 raft_consensus.cc:1081] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:28.424510 11943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:49986
I20260709 12:12:28.425186 11943 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.425593 11943 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.443116 18686 raft_consensus.cc:697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:28.447153 11941 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:28.452075 18703 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:28.457932 11943 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.459247 12021 raft_consensus.cc:2468] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
W20260709 12:12:28.459816 11986 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efa456bf4db9474f84e2e5a51c919032. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:28.463313 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:28.464090 11870 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.479342 11865 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:28.463313 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:28.489511 12022 raft_consensus.cc:3055] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:28.489414 18703 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:28.490085 12022 raft_consensus.cc:740] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:28.491417 12022 consensus_queue.cc:260] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.492632 12022 raft_consensus.cc:3060] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.495033 18686 consensus_queue.cc:237] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.473441 12020 raft_consensus.cc:2468] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:28.534175 11870 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:28.534813 12022 raft_consensus.cc:2468] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 14.
I20260709 12:12:28.536019 11914 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:28.537459 18715 raft_consensus.cc:2804] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:28.538187 18715 raft_consensus.cc:697] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:28.539347 18715 consensus_queue.cc:237] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.460397 11943 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 14 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:28.584929 18703 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:28.602721 11865 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:28.597777 11941 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:28.628384 18734 raft_consensus.cc:993] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:28.629060 18734 raft_consensus.cc:1081] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:28.637890 11865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:28.639259 11865 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.639684 11865 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.652462 11770 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:28.679858 12021 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:28.699133 11771 catalog_manager.cc:5697] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 18 to 19, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.704792 11865 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.720615 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:28.721578 11939 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.736756 18733 raft_consensus.cc:993] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:28.737069 11943 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:28.737643 11868 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:12:28.739315 11986 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d10ddce6896a49a8a2a9ec09702f3ec1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:28.741021 11865 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:28.741297 18703 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:28.740587 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:28.744290 12021 raft_consensus.cc:3055] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.744638 12021 raft_consensus.cc:740] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:28.737576 18733 raft_consensus.cc:1081] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:28.745800 11939 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:28.745707 18703 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:28.746619 11941 raft_consensus.cc:1240] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:28.751087 11868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:28.751875 12021 consensus_queue.cc:260] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.753202 11868 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.753675 11868 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.756110 11839 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:28.758423 12021 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.760507 18753 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.766561 18753 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:28.767589 18753 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.795846 12021 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:28.797683 11868 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.810653 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:28.811374 11939 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.811910 11868 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:28.822638 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:28.823400 12022 raft_consensus.cc:3055] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:28.823712 12022 raft_consensus.cc:740] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:28.824599 12022 consensus_queue.cc:260] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.828644 11939 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:28.829766 12022 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.830930 11839 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:28.837550 11865 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:28.841133 18733 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:28.843385 18753 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.843993 18753 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:28.844365 18715 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:28.844993 18753 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:28.876263 12022 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 17.
I20260709 12:12:28.916165 11941 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:28.946251 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 54f6b4dc8b6a484da6aa10c1562ab511: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:12:28.977602 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 75819.4us
I20260709 12:12:28.988134 11869 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:28.992642 18776 ts_tablet_manager.cc:933] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:29.051534 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 148077us
I20260709 12:12:29.061179 11771 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 18 to 19, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 19 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.064695 11771 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 16 to 17, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 17 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.065927 18776 tablet_copy_client.cc:323] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:29.070672 11771 catalog_manager.cc:5697] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 14 to 15, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } }
I20260709 12:12:29.073040 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet efa456bf4db9474f84e2e5a51c919032 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:29.073772 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet efa456bf4db9474f84e2e5a51c919032 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-efa456bf4db9474f84e2e5a51c919032
I20260709 12:12:29.079483 11865 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:29.090471 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103175us
I20260709 12:12:29.092698 18775 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.092887 11768 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 11, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.094527 12032 tablet_copy_source_session.cc:215] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:29.100337 18776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa456bf4db9474f84e2e5a51c919032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:29.112671 12020 raft_consensus.cc:1275] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:29.141081 12022 raft_consensus.cc:1275] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:29.162123 11768 catalog_manager.cc:5697] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 13 to 14, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 14 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.164901 12020 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:29.200662 12020 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:29.270912 18784 ts_tablet_manager.cc:933] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:29.273998 18776 tablet_copy_client.cc:806] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:29.274752 18776 tablet_copy_client.cc:670] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:29.270851 11865 raft_consensus.cc:1275] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:29.284261 18777 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:29.294142 18776 tablet_copy_client.cc:538] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:29.324100 18715 consensus_queue.cc:1048] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.325834 18715 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:29.327342 18729 consensus_queue.cc:1048] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:29.328823 18757 consensus_queue.cc:1048] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.357141 12020 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:29.363083 18751 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:12:29.388916 18784 tablet_copy_client.cc:323] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:29.391810 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet d10ddce6896a49a8a2a9ec09702f3ec1 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:29.392474 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet d10ddce6896a49a8a2a9ec09702f3ec1 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-d10ddce6896a49a8a2a9ec09702f3ec1
W20260709 12:12:29.406256 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 82034.4us
I20260709 12:12:29.411947 11939 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:29.423532 11941 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:29.439488 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:29.485702 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 49203.2us
I20260709 12:12:29.485244 18724 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:12:29.542109 18776 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:29.548914 12019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:29.549702 12019 raft_consensus.cc:606] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:29.555303 12032 tablet_copy_source_session.cc:215] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:29.560000 18784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10ddce6896a49a8a2a9ec09702f3ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:29.583887 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:29.584677 12021 raft_consensus.cc:606] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:29.586279 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:29.612390 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.613600 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:29.626067 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 78112.4us
W20260709 12:12:29.722565 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 248629us
I20260709 12:12:29.726315 18724 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 12:12:30.049561 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 180047us
W20260709 12:12:30.070760 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 128420us
W20260709 12:12:30.072072 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 182182us
I20260709 12:12:30.090832 18150 raft_consensus.cc:993] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:12:30.169824 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 76635.5us
I20260709 12:12:30.177009 18150 raft_consensus.cc:1081] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
W20260709 12:12:30.186182 18803 log.cc:927] Time spent T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:12:30.185878 18784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41008 (request call id 845) took 1019 ms. Trace:
W20260709 12:12:30.284372 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 50641.3us
I20260709 12:12:30.291083 18713 raft_consensus.cc:993] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:30.293740 18713 raft_consensus.cc:1081] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:30.328058 11943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:49986
I20260709 12:12:30.328804 11943 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.330003 11943 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.210933 18784 rpcz_store.cc:276] 0709 12:12:29.154650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.154835 (+   185us) service_pool.cc:224] Handling call
0709 12:12:29.272532 (+117697us) ts_tablet_manager.cc:934] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
0709 12:12:29.558449 (+285917us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:29.712172 (+153723us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:29.712328 (+   156us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:30.024666 (+312338us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:30.063362 (+ 38696us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:30.093728 (+ 30366us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:30.173554 (+ 79826us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":46593,"tablet-copy.queue_time_us":115509,"thread_start_us":76940,"threads_started":2}
W20260709 12:12:30.373226 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 159388us
W20260709 12:12:30.366847 18806 log.cc:927] Time spent T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:12:30.440532 18784 tablet_copy_client.cc:806] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:30.441390 18784 tablet_copy_client.cc:670] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:30.441948 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:30.442631 11870 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.443055 11870 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.468490 11870 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:30.495234 11866 raft_consensus.cc:1240] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.497587 11870 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:30.561779 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 197826us
I20260709 12:12:30.596549 11943 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:30.597878 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 347407us
I20260709 12:12:30.636482 11943 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:30.636929 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:30.637630 12608 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.644021 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:30.644690 12018 raft_consensus.cc:3055] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.645038 12018 raft_consensus.cc:740] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:30.645819 12018 consensus_queue.cc:260] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:30.646719 12018 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.661358 11948 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.682595 12018 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:30.688799 12608 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:30.689715 12605 raft_consensus.cc:1240] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.711256 11912 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:30.713840 18809 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.714521 18809 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:30.715559 18809 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:30.737236 11839 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:30.738452 18792 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.739282 18792 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:30.740317 18792 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:30.760515 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 64990us
I20260709 12:12:30.772876 18150 consensus_queue.cc:1059] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:30.775435 18808 raft_consensus.cc:3055] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:30.775997 18808 raft_consensus.cc:740] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:30.776966 18808 consensus_queue.cc:260] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:30.778179 18808 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.789894 18784 tablet_copy_client.cc:538] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:30.804106 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:30.804862 11943 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.818569 11943 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 19.
I20260709 12:12:30.828691 18784 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:30.863273 11771 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 18 to 19, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 19 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.883450 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:30.913264 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 46233.2us
I20260709 12:12:30.936174 12020 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:12:30.948239 18776 log.cc:927] Time spent T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:12:30.981272 18776 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:30.987030 18776 tablet_bootstrap.cc:492] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:30.989269 18776 ts_tablet_manager.cc:1403] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.448s	user 0.037s	sys 0.036s
I20260709 12:12:31.004822 18776 raft_consensus.cc:359] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:31.006227 18776 raft_consensus.cc:740] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:31.007217 18776 consensus_queue.cc:260] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:31.015384 18776 ts_tablet_manager.cc:1434] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:12:31.019658 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-efa456bf4db9474f84e2e5a51c919032 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:31.020324 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-efa456bf4db9474f84e2e5a51c919032 on tablet efa456bf4db9474f84e2e5a51c919032 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:31.029804 12608 raft_consensus.cc:1217] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 12:12:31.043516 11768 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 16 to 17, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.047772 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.127100 12020 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:31.130116 18715 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:31.179500 12019 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:31.181201 18751 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:31.210016 12608 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:31.217363 18715 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:12:31.302103 11948 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:31.317610 18796 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:31.407639 18784 log.cc:927] Time spent T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:12:31.498128 18784 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:31.499274 18784 tablet_bootstrap.cc:492] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:31.511059 18784 ts_tablet_manager.cc:1403] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.683s	user 0.053s	sys 0.011s
I20260709 12:12:31.514750 18784 raft_consensus.cc:359] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:31.515764 18784 raft_consensus.cc:740] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:31.516526 18784 consensus_queue.cc:260] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:31.542058 18784 ts_tablet_manager.cc:1434] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:12:31.555418 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-d10ddce6896a49a8a2a9ec09702f3ec1 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:31.555990 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-d10ddce6896a49a8a2a9ec09702f3ec1 on tablet d10ddce6896a49a8a2a9ec09702f3ec1 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:31.576965 18808 raft_consensus.cc:1064] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:31.587628 11946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:31.588413 11946 raft_consensus.cc:606] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:31.582464 18808 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:31.590595 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:31.592842 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:31.593784 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.637975 12608 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:31.639762 11946 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:31.641086 11870 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:31.641932 18781 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:31.644834 18756 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:31.646621 18808 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:31.692190 18808 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:31.696705 12605 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:31.734994 11870 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:31.739152 11946 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:31.803243 11770 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:31.813689 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 53794us
W20260709 12:12:31.891710 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 55029.2us
I20260709 12:12:31.926324 12605 raft_consensus.cc:1217] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:12:32.090813 18861 raft_consensus.cc:993] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:32.091596 18857 raft_consensus.cc:1081] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:32.096422 12022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56168
I20260709 12:12:32.097170 12022 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:32.097666 12022 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.142814 12022 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:32.149941 12022 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:32.154012 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:32.156996 11866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:32.170024 11948 raft_consensus.cc:3055] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:32.170163 11866 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.170444 11948 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:32.171402 11948 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:32.172591 11948 raft_consensus.cc:3060] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.182480 11948 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:32.169278 12019 consensus_queue.cc:237] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:32.189585 11988 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:32.198350 12605 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:32.219801 18856 raft_consensus.cc:2804] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:32.220542 18856 raft_consensus.cc:697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:32.221086 11866 raft_consensus.cc:2468] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:32.224994 18854 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:12:32.233835 11870 raft_consensus.cc:1275] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:32.244668 18812 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:32.249490 12605 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:32.243988 18856 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:32.265358 18860 consensus_queue.cc:1048] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:32.281147 11866 raft_consensus.cc:2955] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:32.321382 11768 catalog_manager.cc:5697] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 14 to 15, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:32.345510 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet efa456bf4db9474f84e2e5a51c919032 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:59450
I20260709 12:12:32.391687 18867 tablet_replica.cc:333] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:32.393150 18867 raft_consensus.cc:2243] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.417977 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 20 to 21, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.426515 18867 raft_consensus.cc:2272] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.451684 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efa456bf4db9474f84e2e5a51c919032 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:32.462622 18781 raft_consensus.cc:1064] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:32.468611 18781 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:32.479429 18867 ts_tablet_manager.cc:1916] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:32.640136 11948 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:32.643956 11869 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:32.649767 18854 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:32.651264 18860 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:32.662731 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 51426.9us
I20260709 12:12:32.699645 12605 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:32.711054 11948 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:32.713837 18860 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:32.708010 18756 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 12:12:32.769138 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 75953.6us
I20260709 12:12:32.788887 11870 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:32.792368 18867 ts_tablet_manager.cc:1929] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 12:12:32.793840 18867 log.cc:1199] T efa456bf4db9474f84e2e5a51c919032 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/efa456bf4db9474f84e2e5a51c919032
I20260709 12:12:32.840467 18756 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:32.894724 18860 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:32.934701 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 68692.7us
I20260709 12:12:32.952437 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet efa456bf4db9474f84e2e5a51c919032 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:12:32.970752 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.975044 11866 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.034376 12605 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.040166 11946 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.081919 11768 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 11 to 12, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:33.316788 12019 consensus_queue.cc:237] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:33.376030 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 72845.9us
W20260709 12:12:33.436800 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54471us
I20260709 12:12:33.517771 12608 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:33.595530 11866 raft_consensus.cc:1275] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:33.629175 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 72122us
I20260709 12:12:33.669099 18896 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.679679 18898 consensus_queue.cc:1048] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.713886 18856 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.729640 12605 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.772845 11771 catalog_manager.cc:5697] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 12 to 13, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.795789 12017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:33.796584 12017 raft_consensus.cc:606] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:33.797219 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d10ddce6896a49a8a2a9ec09702f3ec1 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:33.802063 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:33.810616 11865 raft_consensus.cc:2955] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:33.855860 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:33.866319 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.912624 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet d10ddce6896a49a8a2a9ec09702f3ec1 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:59450
I20260709 12:12:33.956487 18903 tablet_replica.cc:333] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:33.957867 18903 raft_consensus.cc:2243] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.959092 18903 raft_consensus.cc:2272] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.967989 18903 ts_tablet_manager.cc:1916] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:34.023478 18903 ts_tablet_manager.cc:1929] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:12:34.040763 18903 log.cc:1199] T d10ddce6896a49a8a2a9ec09702f3ec1 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/d10ddce6896a49a8a2a9ec09702f3ec1
I20260709 12:12:34.043061 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet d10ddce6896a49a8a2a9ec09702f3ec1 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:12:34.176124 18756 raft_consensus.cc:993] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:34.176990 18854 raft_consensus.cc:1081] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:34.179383 11873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:34.180154 11873 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.180558 11873 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.219359 11873 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:34.225986 11873 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Requested vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:34.225394 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:34.226878 12017 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:34.227232 12017 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:34.228318 12017 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:34.228837 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:34.229478 12605 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.229862 12017 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.236948 12605 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:34.240034 11837 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:34.241365 18893 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:34.241978 18893 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:34.243185 18893 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:34.240073 12017 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 12.
I20260709 12:12:34.267665 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 11 to 12, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 12 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.860481 12020 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:12:34.877596 18874 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:34.914961 12605 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:12:34.919301 18874 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:35.007725 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:35.153460 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 91430.4us
I20260709 12:12:35.256963 11948 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:12:35.310140 11912 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72e0c467da954999a14a9ba2a9af25b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.311568 12017 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:35.315685 18905 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:35.309460 11873 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:35.332085 18915 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:35.382804 18857 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.396986 11866 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.398962 12017 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.421849 11873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:44856
I20260709 12:12:35.422616 11873 raft_consensus.cc:606] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:35.427024 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:35.429216 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.430194 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.445669 11946 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:35.510561 11769 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 14, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.526095 12018 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:12:35.530256 11912 consensus_peers.cc:597] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1bb8ee4e7b34277ac74a869a9f66f97. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.540241 11866 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:35.540408 18929 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:35.563922 18915 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 12:12:35.567306 18931 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:12:35.615619 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 50576.2us
I20260709 12:12:35.691110 18857 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.696408 12018 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.696645 11866 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.736308 12017 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:35.792254 18942 ts_tablet_manager.cc:933] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:35.817269 18942 tablet_copy_client.cc:323] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:12:35.819885 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet 72e0c467da954999a14a9ba2a9af25b9 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:12:35.820560 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet 72e0c467da954999a14a9ba2a9af25b9 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-72e0c467da954999a14a9ba2a9af25b9
I20260709 12:12:35.846576 11958 tablet_copy_source_session.cc:215] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:35.846717 11945 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:35.846993 11986 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 854cd8d1c97d4fff9b7c0600dd83259b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.857311 18756 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:35.861039 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e0c467da954999a14a9ba2a9af25b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:35.885622 11873 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:35.903080 18927 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.904068 11770 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.909145 11945 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:35.931365 18756 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:35.962697 12017 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:35.973606 18950 ts_tablet_manager.cc:933] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:35.978235 11771 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.976672 11873 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:36.003230 18944 raft_consensus.cc:993] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:36.003856 18944 raft_consensus.cc:1081] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:36.015065 18942 tablet_copy_client.cc:806] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:36.016155 18942 tablet_copy_client.cc:670] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:36.016826 11943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:12:36.018865 11943 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.019354 11943 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.045727 18950 tablet_copy_client.cc:323] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:12:36.078948 18942 tablet_copy_client.cc:538] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:36.216945 11943 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:36.221997 11958 tablet_copy_service.cc:140] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Received BeginTabletCopySession request for tablet b1bb8ee4e7b34277ac74a869a9f66f97 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:43956)
I20260709 12:12:36.223290 11958 tablet_copy_service.cc:161] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Beginning new tablet copy session on tablet b1bb8ee4e7b34277ac74a869a9f66f97 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:43956: session id = 189a165e6619406382914fe3075dd436-b1bb8ee4e7b34277ac74a869a9f66f97
W20260709 12:12:36.228878 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 177377us
I20260709 12:12:36.244801 11943 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:36.280107 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:36.280934 11873 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:36.281263 11873 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:36.294776 11873 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:36.307628 11873 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.340549 11958 tablet_copy_source_session.cc:215] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:36.362955 11873 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
W20260709 12:12:36.358700 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 117629us
W20260709 12:12:36.373373 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 123260us
I20260709 12:12:36.393923 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:36.394670 12608 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.430598 12608 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:36.487556 11912 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:36.489859 18961 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:36.490587 18961 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:36.491890 18961 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:36.499876 18942 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:36.551193 18950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb8ee4e7b34277ac74a869a9f66f97. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:36.614413 11838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.616685 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.627296 11948 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:36.633021 11870 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:36.657727 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 71561.2us
I20260709 12:12:36.684263 18968 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:36.740592 11986 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0feb55752b27445c8dee19903f9e6d41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.762467 18973 ts_tablet_manager.cc:933] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:36.784723 11870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44856
I20260709 12:12:36.785729 11870 raft_consensus.cc:606] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:36.808202 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:36.810523 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.813235 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:36.830201 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 59396.4us
I20260709 12:12:36.813274 18950 tablet_copy_client.cc:806] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:36.837857 18935 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:36.840821 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 92214.3us
I20260709 12:12:36.832403 11769 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 16 to 17, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.846295 18950 tablet_copy_client.cc:670] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:36.871887 18906 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:36.881918 11939 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:36.893220 18950 tablet_copy_client.cc:538] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:36.938477 18950 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:36.957660 18973 tablet_copy_client.cc:323] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:36.985231 12605 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:36.995184 18954 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:36.996594 18978 ts_tablet_manager.cc:933] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:36.982662 11770 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 20 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.032796 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 854cd8d1c97d4fff9b7c0600dd83259b from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:37.033638 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 854cd8d1c97d4fff9b7c0600dd83259b from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-854cd8d1c97d4fff9b7c0600dd83259b
I20260709 12:12:37.064504 11873 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:37.163591 18978 tablet_copy_client.cc:323] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:37.270586 12032 tablet_copy_source_session.cc:215] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:37.367976 18973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854cd8d1c97d4fff9b7c0600dd83259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:37.386741 18990 raft_consensus.cc:993] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:37.387930 11866 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:37.388664 18919 raft_consensus.cc:1081] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:37.349371 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 0feb55752b27445c8dee19903f9e6d41 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:37.395732 18988 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:37.395810 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 0feb55752b27445c8dee19903f9e6d41 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-0feb55752b27445c8dee19903f9e6d41
I20260709 12:12:37.417557 12018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56174
I20260709 12:12:37.418377 12018 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.418871 12018 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:37.443861 12032 tablet_copy_source_session.cc:215] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:37.456537 12018 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:37.494333 12018 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:37.533547 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:37.534500 11869 raft_consensus.cc:3055] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:37.534902 11869 raft_consensus.cc:740] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:37.535996 11869 consensus_queue.cc:260] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:37.558137 11869 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:37.633149 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 269073us
I20260709 12:12:37.674474 11869 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:37.677021 18978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feb55752b27445c8dee19903f9e6d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:37.694897 18942 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.696323 18942 tablet_bootstrap.cc:492] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:37.699957 18942 ts_tablet_manager.cc:1403] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.199s	user 0.062s	sys 0.069s
I20260709 12:12:37.730865 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c1fe07352d4472a01fce46f98ce1a6" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:37.731630 12605 raft_consensus.cc:3060] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:37.762176 11988 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:37.763240 18935 raft_consensus.cc:2804] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:37.763808 18935 raft_consensus.cc:697] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:37.764734 18935 consensus_queue.cc:237] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:37.768642 12605 raft_consensus.cc:2468] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:37.841789 18942 raft_consensus.cc:359] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:37.843152 11769 catalog_manager.cc:5697] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 12 to 13, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 13 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.865087 18973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41008 (request call id 919) took 1205 ms. Trace:
I20260709 12:12:37.865690 18973 rpcz_store.cc:276] 0709 12:12:36.659647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.659788 (+   141us) service_pool.cc:224] Handling call
0709 12:12:36.777281 (+117493us) ts_tablet_manager.cc:934] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
0709 12:12:37.342531 (+565250us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:37.644695 (+302164us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:37.660252 (+ 15557us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:37.741012 (+ 80760us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:37.777304 (+ 36292us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:37.864915 (+ 87611us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:37.864990 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":123236,"tablet-copy.queue_time_us":101966,"thread_start_us":139539,"threads_started":2}
I20260709 12:12:37.843218 18942 raft_consensus.cc:740] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:37.873986 18973 tablet_copy_client.cc:806] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:37.900965 18973 tablet_copy_client.cc:670] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:37.901063 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:37.916251 18942 consensus_queue.cc:260] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:37.949602 18942 ts_tablet_manager.cc:1434] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.235s	user 0.011s	sys 0.000s
I20260709 12:12:37.962214 12605 raft_consensus.cc:1217] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:12:37.968685 18973 tablet_copy_client.cc:538] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:37.986479 18973 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:38.000623 18978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41008 (request call id 924) took 1156 ms. Trace:
I20260709 12:12:38.001184 18978 rpcz_store.cc:276] 0709 12:12:36.844316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.844491 (+   175us) service_pool.cc:224] Handling call
0709 12:12:36.997010 (+152519us) ts_tablet_manager.cc:934] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
0709 12:12:37.672938 (+675928us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:37.871345 (+198407us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:37.873318 (+  1973us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:37.999467 (+126149us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:37.999929 (+   462us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:38.000450 (+   521us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:38.000532 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27029,"tablet-copy.queue_time_us":120948,"thread_start_us":158994,"threads_started":2}
I20260709 12:12:38.006755 18978 tablet_copy_client.cc:806] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:38.007450 18978 tablet_copy_client.cc:670] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:38.012432 18978 tablet_copy_client.cc:538] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:12:38.013268 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 46535.1us
I20260709 12:12:38.017333 11939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:44140
I20260709 12:12:38.018051 11939 raft_consensus.cc:606] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:38.035048 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 51792.3us
I20260709 12:12:38.066195 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-72e0c467da954999a14a9ba2a9af25b9 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:12:38.077340 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-72e0c467da954999a14a9ba2a9af25b9 on tablet 72e0c467da954999a14a9ba2a9af25b9 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:38.093461 12022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:38.094296 12022 raft_consensus.cc:606] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:38.099023 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:38.101318 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:38.102289 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.257840 18950 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.259020 18950 tablet_bootstrap.cc:492] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:38.259868 18950 ts_tablet_manager.cc:1403] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 1.322s	user 0.052s	sys 0.017s
I20260709 12:12:38.284598 18950 raft_consensus.cc:359] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:38.285746 18950 raft_consensus.cc:740] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:38.286813 18950 consensus_queue.cc:260] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:38.304934 18995 raft_consensus.cc:993] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:38.309967 18995 raft_consensus.cc:1081] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:38.320130 18978 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:38.320506 11870 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:12:38.346591 18962 raft_consensus.cc:993] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:38.347250 18962 raft_consensus.cc:1081] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:38.350777 11869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:12:38.351580 11869 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:38.351974 11869 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.373574 19009 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:12:38.383637 18950 ts_tablet_manager.cc:1434] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.123s	user 0.011s	sys 0.000s
I20260709 12:12:38.393151 11958 tablet_copy_service.cc:342] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Request end of tablet copy session 189a165e6619406382914fe3075dd436-b1bb8ee4e7b34277ac74a869a9f66f97 received from {username='slave'} at 127.0.0.1:43956
I20260709 12:12:38.393668 11958 tablet_copy_service.cc:434] P 6b7d9b5a12ef4a6cb097df86b95e5bfa: ending tablet copy session 189a165e6619406382914fe3075dd436-b1bb8ee4e7b34277ac74a869a9f66f97 on tablet b1bb8ee4e7b34277ac74a869a9f66f97 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:38.404631 11869 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:38.406515 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:38.408313 11870 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:38.408717 11870 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:38.412081 12607 raft_consensus.cc:1275] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:12:38.414484 18968 consensus_queue.cc:1048] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:38.441740 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:38.442482 11945 raft_consensus.cc:3055] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:38.442799 11945 raft_consensus.cc:740] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:38.419729 11870 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:38.446445 11869 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:38.448629 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:38.449342 12605 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.450862 18997 raft_consensus.cc:1064] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:38.443507 11945 consensus_queue.cc:260] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:38.456722 11945 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.462404 12605 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:38.476737 11837 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 
I20260709 12:12:38.482254 18957 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:38.483139 18957 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:38.484355 18957 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:38.496630 11870 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 25 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:38.505434 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:38.506168 11946 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:38.514580 12014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:38.515364 12014 raft_consensus.cc:3055] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:38.515677 12014 raft_consensus.cc:740] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:38.516485 12014 consensus_queue.cc:260] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:38.517974 12014 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:38.454519 18997 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:38.542294 11945 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 18.
I20260709 12:12:38.592406 12014 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 25.
I20260709 12:12:38.601989 11946 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 25.
I20260709 12:12:38.609798 11839 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:38.625910 19008 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:38.626564 19008 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 25 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:38.656450 19008 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:38.660801 19015 log.cc:927] Time spent T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:12:38.700127 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 91361.7us
W20260709 12:12:38.725787 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 75101us
W20260709 12:12:38.726580 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 104754us
I20260709 12:12:38.736215 12605 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:38.754865 12604 raft_consensus.cc:1217] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 12:12:38.792419 11866 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:38.752353 18967 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:12:38.800208 18973 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.801326 18973 tablet_bootstrap.cc:492] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:38.802143 18973 ts_tablet_manager.cc:1403] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.816s	user 0.047s	sys 0.021s
W20260709 12:12:38.786902 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 177187us
I20260709 12:12:38.819999 12014 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:38.874897 19019 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:38.890367 18973 raft_consensus.cc:359] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:38.898535 18973 raft_consensus.cc:740] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:38.903578 18973 consensus_queue.cc:260] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:38.907343 12604 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:38.914104 18973 ts_tablet_manager.cc:1434] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 12:12:38.917364 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-854cd8d1c97d4fff9b7c0600dd83259b received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:38.917922 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-854cd8d1c97d4fff9b7c0600dd83259b on tablet 854cd8d1c97d4fff9b7c0600dd83259b with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:38.920264 19001 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:38.921039 19020 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:38.979948 11769 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 17 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 18 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.015818 11948 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:39.034911 19007 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.059764 12607 raft_consensus.cc:1217] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 12:12:39.062991 11873 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.063212 12607 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.075471 12014 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.078832 18975 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:39.105736 11770 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 14 to 15, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:39.180855 18978 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=3 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:39.182139 18978 tablet_bootstrap.cc:492] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:39.182950 18978 ts_tablet_manager.cc:1403] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.873s	user 0.038s	sys 0.028s
I20260709 12:12:39.185302 11768 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 24 to 25, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 25 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:39.212363 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.197114 18978 raft_consensus.cc:359] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:39.222447 18978 raft_consensus.cc:740] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:39.223457 18978 consensus_queue.cc:260] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:39.226835 18978 ts_tablet_manager.cc:1434] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 12:12:39.231614 19007 raft_consensus.cc:1064] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:39.235380 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-0feb55752b27445c8dee19903f9e6d41 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:39.236014 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-0feb55752b27445c8dee19903f9e6d41 on tablet 0feb55752b27445c8dee19903f9e6d41 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:39.250136 19007 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:39.304191 12014 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:39.308943 11946 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:39.312259 18975 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:12:39.316691 18921 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:39.331183 12607 raft_consensus.cc:1217] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 12:12:39.378940 12607 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:39.409273 19019 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:39.414825 11945 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:39.435889 12017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
mode: GRACEFUL
new_leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:34274
I20260709 12:12:39.444538 12014 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:39.454780 19001 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:39.436576 12017 raft_consensus.cc:606] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Received request to transfer leadership to TS 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:39.545899 12607 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:39.568415 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 103086us
W20260709 12:12:39.570915 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 110874us
I20260709 12:12:39.603312 11873 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:39.608033 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:39.583449 18995 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:12:39.670758 19049 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:39.784019 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.785020 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:39.822082 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 252569us
W20260709 12:12:39.845990 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 257139us
W20260709 12:12:39.933921 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 94482.4us
I20260709 12:12:39.939942 12022 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:39.947824 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 77017.3us
I20260709 12:12:39.953281 18985 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.990286 11870 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:39.992427 19067 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 12:12:40.005261 18968 raft_consensus.cc:1064] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
W20260709 12:12:40.066934 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 86406.9us
W20260709 12:12:40.068259 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 77554us
I20260709 12:12:40.008782 18968 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:40.143862 12021 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:40.212654 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 230635us
W20260709 12:12:40.214422 19064 log.cc:927] Time spent T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.004s
W20260709 12:12:40.265499 11837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 51717.1us
W20260709 12:12:40.277601 11985 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.287842 11768 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:40.298934 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 87007us
W20260709 12:12:40.356092 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 47683us
I20260709 12:12:40.358814 19039 raft_consensus.cc:993] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: : Instructing follower 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:40.359349 19039 raft_consensus.cc:1081] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Signalling peer 4d7b7ec0a2604d808698037dbd6fa1ef to start an election
I20260709 12:12:40.400506 19048 raft_consensus.cc:1064] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:40.403609 11870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:12:40.404227 11870 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.404575 11870 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.431489 12022 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.429423 19001 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.460872 11870 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:40.471519 12607 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.476555 11866 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:40.479301 19047 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:40.415712 19048 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:40.531951 12604 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:40.533600 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:40.534214 11943 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.533003 11870 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:40.541718 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:40.542382 12017 raft_consensus.cc:3055] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:40.542723 12017 raft_consensus.cc:740] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:40.562433 12017 consensus_queue.cc:260] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:40.564489 12017 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.569851 19080 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:40.570531 19080 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:40.576948 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:40.577329 11873 raft_consensus.cc:1240] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Rejecting Update request from peer 46f08e8ff3774f25acad18252e5cd57d for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:40.578400 11943 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:40.584161 12017 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7b7ec0a2604d808698037dbd6fa1ef in term 20.
I20260709 12:12:40.583873 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:40.576757 19080 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:40.591070 11839 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:40.591912 19080 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:40.558214 18968 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:12:40.587942 12604 raft_consensus.cc:2955] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.594913 11839 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:40.592437 19080 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 LEADER]: Becoming Leader. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:40.599241 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:40.598891 19082 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.634578 19080 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:40.642927 11941 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:40.646349 19047 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:40.700500 19062 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.703097 11943 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:40.707809 19076 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:40.713704 11870 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:40.715643 11943 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.727164 12607 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:40.724391 19076 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:40.738384 12604 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.746325 19048 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:40.864078 11870 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.845513 19001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59450 (request call id 3) took 1428 ms. Trace:
I20260709 12:12:40.863643 11769 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 15 to 16, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 19 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.893584 19062 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.874974 19001 rpcz_store.cc:276] 0709 12:12:39.412090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.412266 (+   176us) service_pool.cc:224] Handling call
0709 12:12:39.439483 (+ 27217us) log.cc:844] Serialized 501 byte log entry
0709 12:12:39.566390 (+126907us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b54002295a0. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1b9ac142 00007f1f1b98ceaa 00007f1f1b993d53 00007f1f1b993cd9 00007f1f1b993c69 00007f1f1b993c31 00007f1f1b992dfd 0000000000388634 0000000000388479 00007f1f18946475
0709 12:12:39.770894 (+204504us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b2c00010da8. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1a32ca11 00007f1f1a33ba0a 00007f1f1a33b693 00007f1f1a33b631 00007f1f1ba6fb52 00007f1f1ba6fcf5 00007f1f1b9ac691 00007f1f1b98ceaa 00007f1f1b993d53 00007f1f1b993cd9 00007f1f1b993c69
0709 12:12:40.840079 (+1069185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40568,"raft.queue_time_us":41414,"raft.run_cpu_time_us":8269,"raft.run_wall_time_us":473695,"spinlock_wait_cycles":44284160}
I20260709 12:12:40.900074 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72e0c467da954999a14a9ba2a9af25b9 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:12:40.899807 19101 log.cc:927] Time spent T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:40.920924 12608 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:40.933300 11768 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef reported cstate change: term changed from 19 to 20, leader changed from 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) to 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65). New cstate: current_term: 20 leader_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.938815 11941 consensus_queue.cc:237] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:40.945490 11863 tablet_service.cc:1558] Processing DeleteTablet for tablet 72e0c467da954999a14a9ba2a9af25b9 with delete_type TABLET_DATA_TOMBSTONED (TS 4d7b7ec0a2604d808698037dbd6fa1ef not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:53162
I20260709 12:12:40.980269 12607 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:40.982400 11866 raft_consensus.cc:1275] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:40.970396 19103 tablet_replica.cc:333] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:40.970956 11771 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.990449 18985 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:12:40.993155 11866 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.005324 11948 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.033260 12022 consensus_queue.cc:237] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:41.039642 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 52738us
I20260709 12:12:41.050851 19001 consensus_queue.cc:1048] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:41.051398 12607 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:12:41.054809 19103 raft_consensus.cc:2243] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:41.055729 19103 raft_consensus.cc:2272] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:41.054908 19019 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.061483 11770 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 12 to 13, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.064491 18935 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:12:41.061179 12607 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.069729 19103 ts_tablet_manager.cc:1916] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:41.089942 11870 raft_consensus.cc:2955] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.095337 18968 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.108772 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1bb8ee4e7b34277ac74a869a9f66f97 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:41.111255 12608 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.114341 12022 consensus_queue.cc:237] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.125865 12605 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:41.133960 19048 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:41.143087 11869 raft_consensus.cc:1275] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:12:41.154999 19076 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.160655 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 854cd8d1c97d4fff9b7c0600dd83259b with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:41.160363 11770 catalog_manager.cc:5697] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index 14 to 15, VOTER 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67) evicted. New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.166200 11869 raft_consensus.cc:1275] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:41.166713 12605 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.168267 11948 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:41.175684 19083 consensus_queue.cc:1048] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:41.180606 12011 tablet_service.cc:1558] Processing DeleteTablet for tablet b1bb8ee4e7b34277ac74a869a9f66f97 with delete_type TABLET_DATA_TOMBSTONED (TS 46f08e8ff3774f25acad18252e5cd57d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:58918
I20260709 12:12:41.182363 19047 consensus_queue.cc:1048] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:41.185261 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0feb55752b27445c8dee19903f9e6d41 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:41.186218 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.175772 12022 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 4d7b7ec0a2604d808698037dbd6fa1ef: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:41.188411 11769 catalog_manager.cc:5697] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 16 to 17, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.232266 19023 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:41.253500 19106 tablet_replica.cc:333] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:41.255692 19103 ts_tablet_manager.cc:1929] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 12:12:41.258296 19103 log.cc:1199] T 72e0c467da954999a14a9ba2a9af25b9 P 4d7b7ec0a2604d808698037dbd6fa1ef: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/wals/72e0c467da954999a14a9ba2a9af25b9
I20260709 12:12:41.263829 19106 raft_consensus.cc:2243] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:41.266741 19106 raft_consensus.cc:2272] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:41.279454 19106 ts_tablet_manager.cc:1916] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:41.285442 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet 854cd8d1c97d4fff9b7c0600dd83259b with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:59450
W20260709 12:12:41.299539 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 54649.8us
I20260709 12:12:41.308779 11870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:44856
I20260709 12:12:41.309479 11870 raft_consensus.cc:606] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Received request to transfer leadership to TS 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:41.309327 19104 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:41.314796 11870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190"
dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
mode: GRACEFUL
new_leader_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:44856
I20260709 12:12:41.316947 11870 raft_consensus.cc:606] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Received request to transfer leadership to TS 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:41.319418 19108 tablet_replica.cc:333] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:41.320611 19108 raft_consensus.cc:2243] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:41.321406 11758 catalog_manager.cc:5028] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): tablet 72e0c467da954999a14a9ba2a9af25b9 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:12:41.344312 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:41.352010 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.352954 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.362061 11873 raft_consensus.cc:2955] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.367259 19108 raft_consensus.cc:2272] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:41.371188 11769 catalog_manager.cc:5697] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index 13 to 14, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New cstate: current_term: 20 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.370087 11869 raft_consensus.cc:2955] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:41.388600 19106 ts_tablet_manager.cc:1929] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 12:12:41.392647 19106 log.cc:1199] T b1bb8ee4e7b34277ac74a869a9f66f97 P 46f08e8ff3774f25acad18252e5cd57d: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/wals/b1bb8ee4e7b34277ac74a869a9f66f97
I20260709 12:12:41.395166 11758 catalog_manager.cc:5028] TS 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): tablet b1bb8ee4e7b34277ac74a869a9f66f97 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:12:41.474921 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 116258us
I20260709 12:12:41.481009 19108 ts_tablet_manager.cc:1916] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:12:41.498974 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 120100us
I20260709 12:12:41.522083 11938 tablet_service.cc:1558] Processing DeleteTablet for tablet 0feb55752b27445c8dee19903f9e6d41 with delete_type TABLET_DATA_TOMBSTONED (TS 6b7d9b5a12ef4a6cb097df86b95e5bfa not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:59450
W20260709 12:12:41.673801 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 152574us
W20260709 12:12:41.685616 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 92293.9us
I20260709 12:12:41.741539 19108 ts_tablet_manager.cc:1929] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.16
I20260709 12:12:41.743643 19108 log.cc:1199] T 854cd8d1c97d4fff9b7c0600dd83259b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/854cd8d1c97d4fff9b7c0600dd83259b
I20260709 12:12:41.754436 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet 854cd8d1c97d4fff9b7c0600dd83259b (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
I20260709 12:12:41.755064 19108 tablet_replica.cc:333] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:41.756333 19108 raft_consensus.cc:2243] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:41.757376 19108 raft_consensus.cc:2272] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:41.768405 19071 raft_consensus.cc:993] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: : Instructing follower 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:41.773303 19116 raft_consensus.cc:1081] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Signalling peer 6b7d9b5a12ef4a6cb097df86b95e5bfa to start an election
I20260709 12:12:41.776281 19108 ts_tablet_manager.cc:1916] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:41.800243 19071 raft_consensus.cc:993] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: : Instructing follower 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:41.801208 19111 raft_consensus.cc:1081] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Signalling peer 46f08e8ff3774f25acad18252e5cd57d to start an election
I20260709 12:12:41.826187 12018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190"
dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
 from {username='slave'} at 127.0.0.1:56174
I20260709 12:12:41.826721 12018 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.827046 12018 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.830507 11943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565"
dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:12:41.831142 11943 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.831513 11943 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:41.839556 11943 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.843283 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:41.843976 12605 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:41.854471 12605 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:41.855804 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:41.894045 11869 raft_consensus.cc:3055] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:41.894423 11869 raft_consensus.cc:740] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:41.895268 11869 consensus_queue.cc:260] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.896327 11869 raft_consensus.cc:3060] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:41.861451 12018 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.910236 12019 raft_consensus.cc:1240] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Rejecting Update request from peer 4d7b7ec0a2604d808698037dbd6fa1ef for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:41.915138 11869 raft_consensus.cc:2468] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 15.
I20260709 12:12:41.893033 19108 ts_tablet_manager.cc:1929] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 12:12:41.916592 12018 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:41.916872 11943 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:41.918838 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:41.919384 12607 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.918076 11914 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:41.922199 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef"
I20260709 12:12:41.925694 11870 raft_consensus.cc:3055] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:41.926014 11870 raft_consensus.cc:740] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4d7b7ec0a2604d808698037dbd6fa1ef, State: Running, Role: LEADER
I20260709 12:12:41.926759 11870 consensus_queue.cc:260] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.920760 19108 log.cc:1199] T 0feb55752b27445c8dee19903f9e6d41 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: Deleting WAL directory at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/wals/0feb55752b27445c8dee19903f9e6d41
I20260709 12:12:41.927839 11870 raft_consensus.cc:3060] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.929009 11758 catalog_manager.cc:5028] TS 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): tablet 0feb55752b27445c8dee19903f9e6d41 (table test-workload [id=7e5721564cb04025b98a0a76e9250838]) successfully deleted
W20260709 12:12:41.935669 19125 log.cc:927] Time spent T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:12:41.935563 19060 raft_consensus.cc:2804] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:41.938504 19060 raft_consensus.cc:697] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:41.939394 19060 consensus_queue.cc:237] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:41.940064 12607 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:41.936597 11870 raft_consensus.cc:2468] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:41.941289 11986 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:41.943884 19047 raft_consensus.cc:2804] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:41.944456 19047 raft_consensus.cc:697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:41.945302 19047 consensus_queue.cc:237] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:42.014370 11768 catalog_manager.cc:5697] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 14 to 15, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 15 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.010075 11770 catalog_manager.cc:5697] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 16 to 17, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 17 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.328570 11869 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:42.330767 19121 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:42.385960 12607 raft_consensus.cc:1275] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:42.389148 19019 consensus_queue.cc:1048] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:42.439620 12605 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:42.453493 19047 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:42.553723 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 48472.1us
I20260709 12:12:42.572393 11869 raft_consensus.cc:1275] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:42.599880 19140 consensus_queue.cc:1048] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:42.607829 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:42.624442 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 52632.4us
I20260709 12:12:42.680336 12022 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:12:42.717290 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
W20260709 12:12:42.766021 11986 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f4f6fbe75cb413188e56f5338fb4c05. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:42.766139 11943 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:42.775959 11988 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 17 similar messages]
W20260709 12:12:42.847108 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 59891.3us
W20260709 12:12:42.877926 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 83157.1us
W20260709 12:12:42.881394 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 105476us
W20260709 12:12:42.902406 12577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 47089us
W20260709 12:12:42.926028 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.927469 11914 consensus_peers.cc:597] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.938038 11914 consensus_peers.cc:597] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.943917 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.953136 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.952441 11914 consensus_peers.cc:597] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:42.954614 19047 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
W20260709 12:12:42.960011 11914 consensus_peers.cc:597] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.958945 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.963171 11914 consensus_peers.cc:597] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.974115 11914 consensus_peers.cc:597] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.989997 11914 consensus_peers.cc:597] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.016587 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.031313 11914 consensus_peers.cc:597] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.040755 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.041855 11914 consensus_peers.cc:597] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.048596 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.049033 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.051395 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.053951 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.057430 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.058503 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.062328 11914 consensus_peers.cc:597] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.063614 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.093329 19154 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:43.097853 11943 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:43.112402 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.114594 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.125324 11914 consensus_peers.cc:597] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.128768 11914 consensus_peers.cc:597] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.142390 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.158697 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:12:43.175243 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.173300 11770 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 15, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:43.180222 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.181934 10697 tablet_replica.cc:333] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.183048 10697 raft_consensus.cc:2243] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.184348 10697 raft_consensus.cc:2272] T 895f46e6dc144b38be8e04b5aac35a2e P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:43.191246 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.197434 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.226438 10697 tablet_replica.cc:333] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.228257 10697 raft_consensus.cc:2243] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.229557 10697 raft_consensus.cc:2272] T 0cb26c79d86d449786430b604fee9561 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:43.263505 11914 consensus_peers.cc:597] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:43.264299 11914 consensus_peers.cc:597] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:43.265089 10697 tablet_replica.cc:333] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.266440 10697 raft_consensus.cc:2243] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.267956 10697 raft_consensus.cc:2272] T 0bace639158f425898b2859f751fc2cd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:43.285841 11839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 70321.1us
I20260709 12:12:43.311883 10697 tablet_replica.cc:333] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.312955 10697 raft_consensus.cc:2243] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.313724 10697 raft_consensus.cc:2272] T 1f8660209a034cd2a004c54e65aa0b9b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.323535 10697 tablet_replica.cc:333] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.327409 10697 raft_consensus.cc:2243] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.328112 10697 raft_consensus.cc:2272] T b2c1fe07352d4472a01fce46f98ce1a6 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.331173 10697 tablet_replica.cc:333] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.332163 10697 raft_consensus.cc:2243] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.331212 19161 ts_tablet_manager.cc:933] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:43.358425 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 8673bd187fa94b98baa982f36c6d2102: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:43.373379 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 1867813aeb8b457984895a6ccb759346: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:43.381654 10697 raft_consensus.cc:2272] T 79900041d3b94f09a8d4b882957a37c3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.385259 10697 tablet_replica.cc:333] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.386633 10697 raft_consensus.cc:2243] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.387475 10697 raft_consensus.cc:2272] T b93a2cf326204d8e89e4fe76ead348c5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:43.389806 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 6ed1e68af58741ceb833c997cabb45a3: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:43.392261 10697 tablet_replica.cc:333] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.395143 10697 raft_consensus.cc:2243] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.396546 10697 raft_consensus.cc:2272] T d10ddce6896a49a8a2a9ec09702f3ec1 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.421830 19161 tablet_copy_client.cc:323] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:43.423861 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 7f4f6fbe75cb413188e56f5338fb4c05 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:43.424646 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 7f4f6fbe75cb413188e56f5338fb4c05 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-7f4f6fbe75cb413188e56f5338fb4c05
I20260709 12:12:43.434010 10697 tablet_replica.cc:333] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.435168 10697 raft_consensus.cc:2243] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.441154 12032 tablet_copy_source_session.cc:215] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:43.449223 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4f6fbe75cb413188e56f5338fb4c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:43.435892 10697 raft_consensus.cc:2272] T efa456bf4db9474f84e2e5a51c919032 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.503480 10697 tablet_replica.cc:333] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.504563 10697 raft_consensus.cc:2243] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.511418 10697 raft_consensus.cc:2272] T 9ff67aad7c28488cbcaa11428b8d0954 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.524271 10697 tablet_replica.cc:333] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.525327 10697 raft_consensus.cc:2243] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.526291 10697 raft_consensus.cc:2272] T f845a1dd30e04dccb21da2a17ebf1415 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.714320 10697 tablet_replica.cc:333] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.718792 10697 raft_consensus.cc:2243] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.722167 10697 raft_consensus.cc:2272] T d6df9d20345c49f0a6f00d9f5f660140 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.781823 10697 tablet_replica.cc:333] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.784368 10697 raft_consensus.cc:2243] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.799959 19054 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:43.801419 19054 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:43.804256 19161 tablet_copy_client.cc:806] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
W20260709 12:12:43.818297 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.809130 19161 tablet_copy_client.cc:670] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:43.864404 19160 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:43.883075 19149 raft_consensus.cc:493] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:43.884449 19082 raft_consensus.cc:493] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:43.884701 19123 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:43.885556 19082 raft_consensus.cc:515] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:43.885862 19123 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:43.884431 19149 raft_consensus.cc:515] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:43.899839 10697 raft_consensus.cc:2272] T 1867813aeb8b457984895a6ccb759346 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.913940 19054 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:43.915907 19107 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:43.889245 19123 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:43.957183 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:43.971103 10697 tablet_replica.cc:333] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:43.916770 19107 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:43.975260 19082 leader_election.cc:290] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:43.977721 10697 raft_consensus.cc:2243] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.865486 19160 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:43.989271 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:43.976791 19149 leader_election.cc:290] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:43.976295 19107 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.009672 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:43.982712 19123 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.030877 19123 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.056180 10697 raft_consensus.cc:2272] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.069409 19177 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.084146 19160 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.072861 19177 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.081105 19082 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:44.096952 19107 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.097231 19082 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.097932 19107 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.100518 19107 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.101161 19107 raft_consensus.cc:493] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:44.103076 19054 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.101966 19107 raft_consensus.cc:515] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.105837 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.108420 19107 leader_election.cc:290] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.114485 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.116560 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.119474 19123 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.124308 10697 tablet_replica.cc:333] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.127154 19177 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.127621 10697 raft_consensus.cc:2243] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.125137 19054 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.127974 19177 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.128778 19177 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.100519 19082 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.139634 19054 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.145453 19123 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:44.141945 19149 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.147918 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.147687 19123 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.148048 19149 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.150410 19123 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.151125 19149 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.151641 10697 raft_consensus.cc:2272] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.152266 19054 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.153173 19054 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.153643 19160 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.154582 19160 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.156096 19054 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.156850 19160 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.158048 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.162240 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.171041 19149 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.172060 19149 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.165285 10697 tablet_replica.cc:333] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.175379 10697 raft_consensus.cc:2243] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.175668 19160 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.173235 19123 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.176622 19160 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.176790 19123 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.177201 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.179204 19160 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.179265 19123 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:44.180397 11837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.180719 10697 raft_consensus.cc:2272] T 8673bd187fa94b98baa982f36c6d2102 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.182361 19160 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.183632 19177 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.183403 19160 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.184235 19177 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.184552 10697 tablet_replica.cc:333] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.184947 19177 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.199337 19123 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:44.200148 19123 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.200613 10697 raft_consensus.cc:2243] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.201743 10697 raft_consensus.cc:2272] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.201756 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 131990us
I20260709 12:12:44.202986 19177 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.203715 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.204497 19123 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.205322 19054 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:44.212159 19054 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.214026 10697 tablet_replica.cc:333] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.214960 19054 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.215322 10697 raft_consensus.cc:2243] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.193799 19149 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.222590 10697 raft_consensus.cc:2272] T f18a923a6db4400eb4027dc16134d310 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.225721 19149 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:44.229363 19149 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.227876 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.228637 19160 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.231248 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.227766 10697 tablet_replica.cc:333] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.240376 10697 raft_consensus.cc:2243] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.240677 19161 tablet_copy_client.cc:538] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:44.241215 10697 raft_consensus.cc:2272] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.241597 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.244460 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.245160 10697 tablet_replica.cc:333] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.246649 10697 raft_consensus.cc:2243] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.248235 10697 raft_consensus.cc:2272] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.257918 10697 tablet_replica.cc:333] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.258258 19149 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:44.263367 10697 raft_consensus.cc:2243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.266959 10697 raft_consensus.cc:2272] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.268424 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.270220 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00e47b0acb44843a177246087e87ffd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.271001 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd3b75a5fa040ba872559d73e67a565" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.271443 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.271808 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.272360 11944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbba5e6f295144a79461c5afc2e273ae" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.269241 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.273205 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.266944 11943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.274134 11942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.275490 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.276988 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.277640 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.282449 10697 tablet_replica.cc:333] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.284026 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0feb55752b27445c8dee19903f9e6d41" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.286306 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb8ee4e7b34277ac74a869a9f66f97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.286633 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.287072 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.287406 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.289220 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae562d279c44236883cb0e50643fa9c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.293051 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d0a2103114406e9d43b045cd4acfe0" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.295584 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.303175 10697 raft_consensus.cc:2243] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.304121 10697 raft_consensus.cc:2272] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.304638 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f6b4dc8b6a484da6aa10c1562ab511" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.307386 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee46b14be8c4a1a99faf37e6697390a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.307824 10697 tablet_replica.cc:333] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.315441 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35e2d3e5b034ad6adcc494a92b92886" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.317435 10697 raft_consensus.cc:2243] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.323765 10697 raft_consensus.cc:2272] T b6b73f446b5a4a9891731cc5f2c0877f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.328555 19161 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:44.327136 11839 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.329455 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4755afb6a253477badd7f673bff77faa" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.332384 10697 tablet_replica.cc:333] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.342212 11839 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.342917 10697 raft_consensus.cc:2243] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.344026 10697 raft_consensus.cc:2272] T c21839ab34e84260a341ab0c1eeab564 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.344102 11839 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.345824 11839 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.347079 11839 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.326028 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a431e9f3bc6146ccbaa801baac0eeb37" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.335026 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.347681 10697 tablet_replica.cc:333] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.348587 19160 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.348784 10697 raft_consensus.cc:2243] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.342041 19149 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:44.349417 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.350206 10697 raft_consensus.cc:2272] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.350262 19149 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:44.349445 19160 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:44.352541 11839 raft_consensus.cc:2686] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.355898 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf27a0b964974f51bc07dec427f3a190" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.362108 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628666a2024d4a61831835e7dee5737a" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.364395 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.362337 10697 tablet_replica.cc:333] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.366577 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c59801bf644679a9e155c914bbc97" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.366731 10697 raft_consensus.cc:2243] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.371526 10697 raft_consensus.cc:2272] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.374200 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854cd8d1c97d4fff9b7c0600dd83259b" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.379061 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.380728 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c36db79b9b44bf9225011eaecc17c4" candidate_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:44.388410 11836 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:44.404299 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 67061.6us
I20260709 12:12:44.416633 10697 tablet_replica.cc:333] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.418035 10697 raft_consensus.cc:2243] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.437749 10697 raft_consensus.cc:2272] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.441479 10697 tablet_replica.cc:333] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.442865 10697 raft_consensus.cc:2243] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.443815 10697 raft_consensus.cc:2272] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.446617 19171 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.447409 19171 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.450052 11839 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.454658 11839 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.461987 11839 raft_consensus.cc:2686] T b1bb8ee4e7b34277ac74a869a9f66f97 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.457619 19054 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:44.463953 19171 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:44.472116 10697 tablet_replica.cc:333] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.500584 10697 raft_consensus.cc:2243] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.506773 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.507613 10697 raft_consensus.cc:2272] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.511480 10697 tablet_replica.cc:333] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.518075 10697 raft_consensus.cc:2243] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.520421 10697 raft_consensus.cc:2272] T b00e47b0acb44843a177246087e87ffd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.539040 11839 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:44.546768 11839 raft_consensus.cc:2686] T 0feb55752b27445c8dee19903f9e6d41 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.547935 11839 leader_election.cc:304] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:44.542361 10697 tablet_replica.cc:333] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.549364 10697 raft_consensus.cc:2243] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.550442 10697 raft_consensus.cc:2272] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.551815 19162 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.551831 19171 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.552665 19162 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.552944 19171 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.554697 10697 tablet_replica.cc:333] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.555747 10697 raft_consensus.cc:2243] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.556823 19171 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:44.562271 11914 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.563339 19162 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.564767 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.565764 12020 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:44.566748 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:44.568112 19162 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:44.568627 19162 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.569116 19162 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.575995 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:44.591208 11839 leader_election.cc:304] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:44.592801 11839 raft_consensus.cc:2686] T a1d0a2103114406e9d43b045cd4acfe0 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.593888 11839 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.594560 11839 raft_consensus.cc:2686] T 7f4f6fbe75cb413188e56f5338fb4c05 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.595717 19160 raft_consensus.cc:2749] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:44.596206 11839 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.597317 19160 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.605316 10697 raft_consensus.cc:2272] T 6ed1e68af58741ceb833c997cabb45a3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.606201 11839 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.607156 11839 raft_consensus.cc:2686] T 7ee46b14be8c4a1a99faf37e6697390a P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.609392 11839 leader_election.cc:304] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:44.610395 11839 raft_consensus.cc:2686] T f35e2d3e5b034ad6adcc494a92b92886 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.612291 11839 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.614358 11839 raft_consensus.cc:2686] T 4755afb6a253477badd7f673bff77faa P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.615124 11839 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.615881 11839 raft_consensus.cc:2686] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.622660 19162 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.630616 10697 tablet_replica.cc:333] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.643920 11839 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.645776 19160 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.647171 11839 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.647939 11839 raft_consensus.cc:2686] T 198dd765f8a54a299a0558eccc0f684f P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.648253 10697 raft_consensus.cc:2243] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.649099 10697 raft_consensus.cc:2272] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.648981 11839 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:44.654618 11914 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.655849 11839 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.657449 11839 raft_consensus.cc:2686] T 628666a2024d4a61831835e7dee5737a P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.657604 19160 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.658656 11839 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.660948 11839 raft_consensus.cc:2686] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.661856 11839 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.663004 19054 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.663045 11839 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:44.664727 11839 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.665375 11839 raft_consensus.cc:2686] T c3402a9e1fa24f56be441155ae895d98 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.666245 11839 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d7b7ec0a2604d808698037dbd6fa1ef; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:44.668346 19054 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.671027 19162 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.671303 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79900041d3b94f09a8d4b882957a37c3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:44.673008 12019 raft_consensus.cc:3060] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.674510 10697 tablet_replica.cc:333] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.675549 10697 raft_consensus.cc:2243] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.676774 10697 raft_consensus.cc:2272] T f31959fa0f994ee8a9587eb78cb124b3 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.680032 10697 tablet_replica.cc:333] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.680953 10697 raft_consensus.cc:2243] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.682178 10697 raft_consensus.cc:2272] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.685230 10697 tablet_replica.cc:333] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.686113 10697 raft_consensus.cc:2243] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.687147 10697 raft_consensus.cc:2272] T a431e9f3bc6146ccbaa801baac0eeb37 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.690320 11839 raft_consensus.cc:2686] T 92c36db79b9b44bf9225011eaecc17c4 P 4d7b7ec0a2604d808698037dbd6fa1ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:44.690382 10697 tablet_replica.cc:333] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.691645 10697 raft_consensus.cc:2243] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.692441 10697 raft_consensus.cc:2272] T 005405ff7b534db6b4c6be122c445915 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.692936 12019 raft_consensus.cc:2468] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 21.
I20260709 12:12:44.694362 11914 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:44.695704 19176 raft_consensus.cc:2804] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:44.696359 19176 raft_consensus.cc:697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:44.699489 19176 consensus_queue.cc:237] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.701015 19181 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.701715 19181 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.696282 10697 tablet_replica.cc:333] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.705029 10697 raft_consensus.cc:2243] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.705577 19162 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.707577 10697 raft_consensus.cc:2272] T bf27a0b964974f51bc07dec427f3a190 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.707782 19162 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.710331 19162 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.712400 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.713181 12020 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 10.
I20260709 12:12:44.713408 10697 tablet_replica.cc:333] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.714423 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:44.715070 19181 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:44.716020 11914 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.717494 19162 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:44.718014 19162 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.718655 19162 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:44.714459 10697 raft_consensus.cc:2243] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.721079 10697 raft_consensus.cc:2272] T cbba5e6f295144a79461c5afc2e273ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.722996 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:44.723901 12019 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 14.
I20260709 12:12:44.725425 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:44.726764 19184 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:44.727239 19184 raft_consensus.cc:493] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.727658 19184 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.730687 10697 tablet_replica.cc:333] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.732580 10697 raft_consensus.cc:2243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.735644 10697 raft_consensus.cc:2272] T 99ffb9377dca4ebd94a32fd00a581fb5 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.741001 10697 tablet_replica.cc:333] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.745289 10697 raft_consensus.cc:2243] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.746927 10697 raft_consensus.cc:2272] T 3cd3b75a5fa040ba872559d73e67a565 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.754827 10697 tablet_replica.cc:333] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.758354 10697 raft_consensus.cc:2243] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.760396 10697 raft_consensus.cc:2272] T e4f11d66c6904b2bb34a6291c444fbcd P 4d7b7ec0a2604d808698037dbd6fa1ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.779368 19184 raft_consensus.cc:515] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:44.795089 11770 catalog_manager.cc:5697] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 20 to 21, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 21 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.812592 19161 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:44.820312 19162 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.822921 19162 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.825120 19184 leader_election.cc:290] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:44.828881 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895f46e6dc144b38be8e04b5aac35a2e" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:44.832926 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bace639158f425898b2859f751fc2cd" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:44.831372 11914 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.841331 12020 raft_consensus.cc:3060] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:44.841356 12019 raft_consensus.cc:3060] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.838362 19161 tablet_bootstrap.cc:492] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:44.854527 12020 raft_consensus.cc:2468] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 11.
I20260709 12:12:44.856313 11914 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:44.859802 12019 raft_consensus.cc:2468] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 15.
I20260709 12:12:44.861009 12577 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:44.864946 19146 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:44.862330 19176 raft_consensus.cc:2804] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:44.871004 19176 raft_consensus.cc:697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:44.872121 19176 consensus_queue.cc:237] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.865855 19146 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:44.875885 19146 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:44.866464 19184 raft_consensus.cc:2804] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:44.882330 19184 raft_consensus.cc:697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:44.883113 10697 tablet_replica.cc:333] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.887243 10697 raft_consensus.cc:2243] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.892752 10697 raft_consensus.cc:2272] T 854cd8d1c97d4fff9b7c0600dd83259b P 4d7b7ec0a2604d808698037dbd6fa1ef [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.883669 19184 consensus_queue.cc:237] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:44.896474 12577 leader_election.cc:336] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.867419 19161 ts_tablet_manager.cc:1403] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.539s	user 0.055s	sys 0.074s
W20260709 12:12:44.898015 12577 leader_election.cc:336] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.903980 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:44.904784 11946 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:44.929378 19161 raft_consensus.cc:359] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:44.930512 19161 raft_consensus.cc:740] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:44.931315 19161 consensus_queue.cc:260] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:44.955578 19161 ts_tablet_manager.cc:1434] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
W20260709 12:12:44.956342 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:44.970455 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:44.969652 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 63402.4us
I20260709 12:12:44.985329 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-7f4f6fbe75cb413188e56f5338fb4c05 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:44.985980 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-7f4f6fbe75cb413188e56f5338fb4c05 on tablet 7f4f6fbe75cb413188e56f5338fb4c05 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:44.987581 10697 tablet_replica.cc:333] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:44.989454 10697 raft_consensus.cc:2243] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.996328 19141 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:45.004055 10697 raft_consensus.cc:2272] T be722abe8c2249e0862fd29352eed5da P 4d7b7ec0a2604d808698037dbd6fa1ef [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.998050 11988 leader_election.cc:336] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.011834 11988 leader_election.cc:304] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:45.014070 19141 raft_consensus.cc:2749] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:45.031281 11768 catalog_manager.cc:5697] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 14 to 15, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 15 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.058823 10697 tablet_replica.cc:333] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:45.094640 10697 raft_consensus.cc:2243] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.061101 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.103977 19146 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.104470 19146 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.104853 19146 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:45.117676 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 56692.3us
I20260709 12:12:45.148972 19162 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.149806 19162 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.152346 19162 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:45.170423 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:45.175345 10697 raft_consensus.cc:2272] T 6e6c59801bf644679a9e155c914bbc97 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.132359 11768 catalog_manager.cc:5697] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 10 to 11, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 11 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.117339 19146 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.193890 19146 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.225060 10697 tablet_replica.cc:333] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:45.226455 10697 raft_consensus.cc:2243] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.227913 10697 raft_consensus.cc:2272] T 54f6b4dc8b6a484da6aa10c1562ab511 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:45.239007 11988 leader_election.cc:336] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.281340 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:45.282171 11946 raft_consensus.cc:3060] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.304657 10697 tablet_replica.cc:333] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:45.313773 12020 raft_consensus.cc:1275] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:45.340499 10697 raft_consensus.cc:2243] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.325702 11946 raft_consensus.cc:2468] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:45.379660 10697 raft_consensus.cc:2272] T 6dded4de56124928b0b4c23213e34af4 P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.438047 11988 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.453593 12608 raft_consensus.cc:1217] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 12:12:45.455241 10697 tablet_replica.cc:333] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:45.447350 19141 raft_consensus.cc:2804] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:45.447038 19162 consensus_queue.cc:1048] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:12:45.475083 10697 raft_consensus.cc:2243] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.482668 19141 raft_consensus.cc:697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:45.505070 10697 raft_consensus.cc:2272] T 1ae562d279c44236883cb0e50643fa9c P 4d7b7ec0a2604d808698037dbd6fa1ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.540591 19141 consensus_queue.cc:237] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:45.564841 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:45.618400 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 85008.9us
I20260709 12:12:45.621286 10697 tablet_replica.cc:333] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef: stopping tablet replica
I20260709 12:12:45.622328 10697 raft_consensus.cc:2243] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.626084 10697 raft_consensus.cc:2272] T 6a334a018a5045c29f59fb1e4e5119ae P 4d7b7ec0a2604d808698037dbd6fa1ef [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:45.629043 11914 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.629828 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:45.630245 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 109068us
I20260709 12:12:45.630903 19176 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:45.632136 11914 consensus_peers.cc:597] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:45.639986 12020 raft_consensus.cc:1275] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:45.641894 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 46035.8us
I20260709 12:12:45.643715 12022 raft_consensus.cc:1275] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:45.652132 19207 consensus_queue.cc:1048] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:45.660686 11988 leader_election.cc:336] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:45.679390 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.711406 11914 consensus_peers.cc:597] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:45.712224 19176 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.714210 19198 consensus_queue.cc:1048] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:45.712874 19176 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.719825 19176 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:45.724296 11770 catalog_manager.cc:5697] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:45.700986 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.737221 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:45.750114 19209 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.750999 19209 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.758318 19198 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.757956 19190 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.771467 19198 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.767551 19190 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.774032 19198 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:45.775249 19190 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:45.770090 11914 consensus_peers.cc:597] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.788832 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.789691 19209 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:45.790439 11914 consensus_peers.cc:597] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.791420 19190 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.796788 19190 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:45.793936 11914 consensus_peers.cc:597] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.803047 19211 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.803550 19199 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.803790 19211 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.804495 19190 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.804193 19199 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.806239 19211 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.806954 19199 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.793466 19205 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.811703 19205 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.812322 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.813017 11946 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 17.
I20260709 12:12:45.813248 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.814284 19205 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.819176 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.819989 11947 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:45.820123 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.825845 19205 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.826637 19205 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.828944 19205 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.837198 19208 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.837931 19208 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.840400 19208 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.851472 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:45.852207 12021 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:45.859793 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:45.860615 12021 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:45.882054 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.882884 11941 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:45.883333 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.884310 19209 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.884752 19209 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.885130 19209 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.887468 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.888237 11947 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:45.890549 19141 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.890746 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.891137 19141 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.891753 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.892372 11941 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:45.894081 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.893380 19141 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.896757 19199 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.897424 19199 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.897480 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.898049 19199 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.898512 19141 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:45.898902 19141 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.899348 19141 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.912307 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.914366 19208 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.914871 19208 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.915271 19208 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.917137 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.918217 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:45.919015 19205 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.919445 19205 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.919726 19211 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.919811 19205 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.920296 19211 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.920780 19211 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.920837 19141 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.923394 19141 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:45.930274 19205 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:45.933773 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.955714 19205 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:45.964668 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 66953.4us
I20260709 12:12:45.964850 19176 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.967881 19176 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:45.968305 19176 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.969228 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:45.976970 19208 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:45.979295 11914 consensus_peers.cc:597] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.988943 19208 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:45.989141 11914 consensus_peers.cc:597] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.992033 11914 consensus_peers.cc:597] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.992777 11914 consensus_peers.cc:597] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.993407 11914 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.993889 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:45.994760 19210 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:45.995159 11914 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.996443 19211 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:45.997292 11988 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:45.999297 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:45.999456 19209 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:45.999933 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:46.001159 19141 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:45.989006 19199 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:46.002880 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.003379 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:46.004403 19141 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.004492 19199 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:46.005824 11988 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.014640 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.015345 11941 raft_consensus.cc:3060] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:46.018380 11914 consensus_peers.cc:597] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.019196 11914 consensus_peers.cc:597] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.019804 11914 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.024588 11941 raft_consensus.cc:2468] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 21.
I20260709 12:12:46.026063 19209 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.033324 19176 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.035199 19211 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:46.044695 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.045687 11946 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 18: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:46.045814 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.046422 11947 raft_consensus.cc:3060] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.050990 19176 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.054330 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:46.055250 12017 raft_consensus.cc:2393] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 18: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:46.058413 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:46.059334 12017 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 19: Already voted for candidate 46f08e8ff3774f25acad18252e5cd57d in this term.
I20260709 12:12:46.060132 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.065934 11941 raft_consensus.cc:2393] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 46f08e8ff3774f25acad18252e5cd57d in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
W20260709 12:12:46.068626 11914 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.069864 11947 raft_consensus.cc:2468] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 20.
I20260709 12:12:46.087119 11988 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.093042 19208 raft_consensus.cc:2804] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:46.093566 19141 raft_consensus.cc:1064] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:46.093827 19208 raft_consensus.cc:697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:46.094889 19208 consensus_queue.cc:237] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.097411 19141 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.091770 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.099788 19176 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:46.099045 11988 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.103621 19199 raft_consensus.cc:2804] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.104511 19199 raft_consensus.cc:697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:46.107228 19199 consensus_queue.cc:237] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.115527 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.120561 11941 raft_consensus.cc:1275] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:46.123908 11947 raft_consensus.cc:3060] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:46.133983 11914 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.134910 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.138638 19176 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:46.136655 11988 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.143985 11988 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.145947 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.157174 11914 consensus_peers.cc:597] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.157059 12605 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:46.163638 19205 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:46.166280 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.166707 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.168550 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:46.168002 11947 raft_consensus.cc:2468] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 22.
I20260709 12:12:46.178411 19199 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:46.196251 11941 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:46.214973 11988 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.216164 19141 consensus_queue.cc:1048] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:46.217298 19146 raft_consensus.cc:2804] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:46.218006 19146 raft_consensus.cc:697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 22 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:46.219086 19146 consensus_queue.cc:237] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.233258 19208 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:46.242121 11988 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.243547 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.244076 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:46.265120 11771 catalog_manager.cc:5697] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 20 to 21, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.267452 11771 catalog_manager.cc:5697] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 19 to 20, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 20 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:46.273128 11988 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.275691 11988 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.276152 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:46.274297 19211 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.278635 19146 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:46.279050 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:46.279656 11988 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.295439 19204 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.298434 19204 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.300782 19204 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.306176 19204 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.306767 19204 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.307052 19209 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.307693 19209 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.308946 19204 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.310096 19209 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.317555 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:46.318082 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:46.318288 12017 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:46.318753 12021 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 25.
I20260709 12:12:46.319034 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:46.319667 12022 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 17.
I20260709 12:12:46.324230 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.325134 19209 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:46.325191 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.325657 19209 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.326121 19209 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.326319 19204 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:46.326995 19204 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.327419 19204 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:46.337404 19204 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.326270 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:46.341905 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.342604 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:46.344290 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.340462 19210 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.349999 19210 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.353197 19210 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.353778 19209 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.356046 19209 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.358661 19204 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.359488 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31959fa0f994ee8a9587eb78cb124b3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:46.360126 12022 raft_consensus.cc:3060] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.383672 12022 raft_consensus.cc:2468] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
W20260709 12:12:46.384678 11914 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.385735 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ffb9377dca4ebd94a32fd00a581fb5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
W20260709 12:12:46.386234 11914 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.386585 12021 raft_consensus.cc:3060] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:46.387316 11914 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.388615 11914 consensus_peers.cc:597] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.389207 11914 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.391651 11914 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.392539 19176 raft_consensus.cc:2804] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.393070 19176 raft_consensus.cc:697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:46.398242 19176 consensus_queue.cc:237] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:46.406899 11914 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:46.407984 11914 consensus_peers.cc:597] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.408874 11914 consensus_peers.cc:597] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.407524 19146 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:46.413136 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.416455 12021 raft_consensus.cc:2468] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 26.
I20260709 12:12:46.417922 11914 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.418819 19209 raft_consensus.cc:2804] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:46.419346 19209 raft_consensus.cc:697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 26 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:46.420382 19209 consensus_queue.cc:237] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.415436 11947 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
W20260709 12:12:46.428994 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.440734 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.441089 12605 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:46.449658 19204 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.450371 19204 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.458875 19210 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.470443 19204 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:46.471630 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:46.474078 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70a3c0cc664c8cb6b298c2c4ab5441" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:46.474622 12022 raft_consensus.cc:3060] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.487008 19202 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.470762 19210 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.490557 19202 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.495471 19202 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:46.496588 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:46.486991 11914 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.499279 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.489796 12022 raft_consensus.cc:2468] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
W20260709 12:12:46.501806 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.520494 19210 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:46.519574 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.528334 12577 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.528939 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.531683 19202 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.532364 19202 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.535259 19202 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:46.540372 19207 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:46.542769 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:46.543534 11947 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
W20260709 12:12:46.544152 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:46.544750 12577 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.546299 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.547674 19202 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:46.548082 19202 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.548611 19202 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.562762 19211 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.563589 19211 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.576535 11768 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 15 to 16, 189a165e6619406382914fe3075dd436 (127.10.114.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:46.573971 19202 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.579942 19211 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:46.586104 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:46.587080 12608 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 15.
I20260709 12:12:46.604074 11941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:46.604866 11941 raft_consensus.cc:3060] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.606422 11986 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:46.607432 19211 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:46.607852 19211 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.608223 19211 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.583066 19202 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:46.617147 19211 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.619995 11941 raft_consensus.cc:2468] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
I20260709 12:12:46.634482 19211 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:46.643989 11768 catalog_manager.cc:5697] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 21 to 22, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 22 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:46.654500 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 153779us
W20260709 12:12:46.655361 11914 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.664805 11771 catalog_manager.cc:5697] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 19 to 20, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:46.674937 11988 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.676780 12577 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.683269 19207 raft_consensus.cc:2804] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:46.684355 19207 raft_consensus.cc:697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:46.685554 19207 consensus_queue.cc:237] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.687686 11914 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:46.690847 19198 raft_consensus.cc:2804] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.693485 19198 raft_consensus.cc:697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:46.694587 19198 consensus_queue.cc:237] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:46.702096 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be722abe8c2249e0862fd29352eed5da" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:46.702333 12577 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.702798 12608 raft_consensus.cc:3060] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:46.720417 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 44329.7us
I20260709 12:12:46.722735 11941 raft_consensus.cc:1275] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:46.726042 11768 catalog_manager.cc:5697] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 18 to 19, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 19 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.732585 12608 raft_consensus.cc:2468] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 16.
I20260709 12:12:46.735306 11986 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:46.736274 19146 raft_consensus.cc:2804] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:46.736852 19146 raft_consensus.cc:697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:46.737792 19146 consensus_queue.cc:237] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.784298 11941 raft_consensus.cc:1275] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:46.784996 12019 consensus_queue.cc:237] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:46.788618 11914 connection.cc:769] client connection to 127.10.114.65:39113 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:46.793092 11988 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:46.793380 12605 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:12:46.794284 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.794961 19239 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:46.800601 19239 consensus_queue.cc:1048] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:46.805104 19146 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:46.812942 11768 catalog_manager.cc:5697] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 25 to 26, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 26 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.817662 11768 catalog_manager.cc:5697] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 17 to 18, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 18 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.828088 12605 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:46.828048 19239 consensus_queue.cc:1048] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:12:46.852519 11941 raft_consensus.cc:1275] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:12:46.855026 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 65806.8us
I20260709 12:12:46.859269 11768 catalog_manager.cc:5697] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 15 to 16, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 16 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.861627 12019 raft_consensus.cc:1275] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:46.884801 11941 raft_consensus.cc:1275] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:12:46.885517 11988 connection.cc:769] client connection to 127.10.114.65:39113 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:46.888285 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:46.894394 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:46.897415 19202 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.900159 12019 raft_consensus.cc:1275] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:46.901129 11758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f4f6fbe75cb413188e56f5338fb4c05 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:46.898154 19202 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.906524 11771 catalog_manager.cc:5697] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 reported cstate change: config changed from index 16 to 17, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New cstate: current_term: 21 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:46.909986 19202 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:46.952682 11939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:46.946720 19236 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.967072 19146 consensus_queue.cc:1048] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:46.965049 19209 consensus_queue.cc:1048] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:46.967907 19198 consensus_queue.cc:1048] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:46.969765 19239 consensus_queue.cc:1048] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:46.964470 19236 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:46.972396 11939 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:46.973587 19236 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:46.974965 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:46.975731 12608 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 18.
I20260709 12:12:46.977233 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:46.978030 19236 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:46.978555 19236 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:46.979059 19236 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:46.989951 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:47.002056 11914 consensus_peers.cc:597] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:47.007277 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:47.009276 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:47.017360 11914 consensus_peers.cc:597] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:47.009649 19236 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:47.014528 11939 raft_consensus.cc:2955] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } }
I20260709 12:12:47.018743 19197 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.024192 19197 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4d7b7ec0a2604d808698037dbd6fa1ef)
I20260709 12:12:47.024448 19236 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:47.024664 19197 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:47.015635 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:47.025584 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
W20260709 12:12:47.037735 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:47.046314 11914 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:47.052052 11914 consensus_peers.cc:597] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:47.075513 11914 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:47.131179 11758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 100127us
W20260709 12:12:47.143143 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:47.143368 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 85914.2us
I20260709 12:12:47.146787 19197 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:47.174182 11914 consensus_peers.cc:597] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:47.229722 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 55596.2us
W20260709 12:12:47.229297 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 171124us
I20260709 12:12:47.179571 11941 raft_consensus.cc:1275] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:47.242595 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:47.242965 19197 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:47.244328 12608 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in current term 19: Already voted for candidate 189a165e6619406382914fe3075dd436 in this term.
I20260709 12:12:47.251185 19207 consensus_queue.cc:1048] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
W20260709 12:12:47.288021 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:47.293344 12607 raft_consensus.cc:1275] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:47.316699 19146 consensus_queue.cc:1048] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:47.327857 11988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45949, user_credentials={real_user=slave}} blocked reactor thread for 58128.7us
I20260709 12:12:47.334300 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:47.335717 19260 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:47.336609 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:47.344466 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:47.345449 11946 raft_consensus.cc:2393] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 189a165e6619406382914fe3075dd436 in current term 19: Already voted for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in this term.
I20260709 12:12:47.350419 12021 raft_consensus.cc:1275] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:47.367178 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:47.376039 19207 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:47.397508 19198 consensus_queue.cc:1048] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:47.403337 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:47.403980 11988 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:47.538808 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:47.625415 11914 consensus_peers.cc:597] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:47.674021 11914 consensus_peers.cc:597] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:47.780194 11988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111) [suppressed 376 similar messages]
W20260709 12:12:47.920399 10697 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11894)
W20260709 12:12:47.957033 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.039613 11914 consensus_peers.cc:597] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.056113 19208 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.056730 19208 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:48.064303 11988 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:48.064623 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.069504 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" is_pre_election: true
I20260709 12:12:48.068439 19208 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:48.070562 11946 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 18.
I20260709 12:12:48.072187 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:48.073769 19208 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.075626 19208 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.078336 19208 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:48.121273 11914 consensus_peers.cc:597] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.153695 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.153964 11819 auto_rebalancer.cc:629] Failed to schedule move for tablet 6ed1e68af58741ceb833c997cabb45a3: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:48.126688 19208 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:48.161753 19208 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:48.163364 12022 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:12:48.184872 11914 consensus_peers.cc:597] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.186712 11946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa"
I20260709 12:12:48.190250 11946 raft_consensus.cc:3060] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:48.202823 11988 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:48.239220 11986 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 198dd765f8a54a299a0558eccc0f684f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.240926 19263 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.241647 19263 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:48.243749 19263 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:48.245486 11914 consensus_peers.cc:597] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.245585 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
I20260709 12:12:48.249053 11946 raft_consensus.cc:2468] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 19.
I20260709 12:12:48.254245 11988 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:48.251194 11941 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:48.256460 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:48.257470 12022 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:48.260861 19199 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:48.257059 19256 raft_consensus.cc:2804] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.263424 19256 raft_consensus.cc:697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Becoming Leader. State: Replica: 46f08e8ff3774f25acad18252e5cd57d, State: Running, Role: LEADER
I20260709 12:12:48.264330 19256 consensus_queue.cc:237] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:48.268069 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.273346 11914 consensus_peers.cc:597] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.274260 11914 consensus_peers.cc:597] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.290346 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:48.292202 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
I20260709 12:12:48.295084 19263 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:48.295657 19263 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.296114 19263 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:48.302160 11914 consensus_peers.cc:597] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.303275 11914 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:48.313849 11768 catalog_manager.cc:5697] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: term changed from 17 to 19, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67). New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:48.315462 11914 consensus_peers.cc:597] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.316543 11914 consensus_peers.cc:597] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.367890 19263 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:48.401340 11914 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:48.406929 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:48.407805 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923a6db4400eb4027dc16134d310" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:48.408532 12019 raft_consensus.cc:3060] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.418241 12019 raft_consensus.cc:2468] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
I20260709 12:12:48.419941 11914 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:48.421212 19198 raft_consensus.cc:2804] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:48.421803 19198 raft_consensus.cc:697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:48.422729 19198 consensus_queue.cc:237] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:48.425500 19263 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:48.465502 11770 catalog_manager.cc:5697] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 18 to 20, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:48.470693 11914 consensus_peers.cc:597] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.501461 19208 raft_consensus.cc:2955] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:48.507400 11946 raft_consensus.cc:2955] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:48.526783 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.570314 12022 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:48.602782 11946 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:48.606938 19256 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:48.614395 11986 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cb26c79d86d449786430b604fee9561. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.617470 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.616636 11768 catalog_manager.cc:5697] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 19 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:48.648543 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.656862 19199 raft_consensus.cc:2955] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:48.667626 11939 raft_consensus.cc:2955] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:48.670233 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.692909 11946 consensus_queue.cc:237] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
W20260709 12:12:48.733875 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:48.741853 11914 consensus_peers.cc:597] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.746438 12022 raft_consensus.cc:1275] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:48.750684 11912 consensus_peers.cc:597] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 189a165e6619406382914fe3075dd436 (127.10.114.68:39553): Couldn't send request to peer 189a165e6619406382914fe3075dd436. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4755afb6a253477badd7f673bff77faa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.745453 11770 catalog_manager.cc:5697] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d reported cstate change: config changed from index -1 to 13, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 18 leader_uuid: "46f08e8ff3774f25acad18252e5cd57d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.770171 19275 consensus_queue.cc:1048] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:48.789391 11914 consensus_peers.cc:597] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.807750 19292 ts_tablet_manager.cc:933] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:48.828635 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.856957 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:48.858198 19292 tablet_copy_client.cc:323] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:48.860049 19275 raft_consensus.cc:2955] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
I20260709 12:12:48.865897 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 198dd765f8a54a299a0558eccc0f684f from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:48.866653 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 198dd765f8a54a299a0558eccc0f684f from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-198dd765f8a54a299a0558eccc0f684f
I20260709 12:12:48.876964 11939 raft_consensus.cc:1275] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:48.883597 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
I20260709 12:12:48.887449 19289 consensus_queue.cc:1048] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:48.892969 12032 tablet_copy_source_session.cc:215] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:48.897351 11988 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.918424 12017 raft_consensus.cc:1275] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:48.913349 12022 raft_consensus.cc:2955] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } }
W20260709 12:12:48.932089 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.945518 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198dd765f8a54a299a0558eccc0f684f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:48.963342 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.970335 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.966456 19273 consensus_queue.cc:1048] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:48.968474 11914 consensus_peers.cc:597] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.965577 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.972090 11770 catalog_manager.cc:5697] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: config changed from index -1 to 12, NON_VOTER 189a165e6619406382914fe3075dd436 (127.10.114.68) added. New cstate: current_term: 17 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:48.986816 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.990996 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.995254 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:48.998198 11914 consensus_peers.cc:597] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.998982 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.012183 11914 consensus_peers.cc:597] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:49.026176 19292 tablet_copy_client.cc:806] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:49.027042 19292 tablet_copy_client.cc:670] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
W20260709 12:12:49.027206 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:49.028301 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.029033 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.046665 19292 tablet_copy_client.cc:538] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:12:49.053431 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:49.129416 19292 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Bootstrap starting.
W20260709 12:12:49.130512 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.136823 19273 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.137498 19273 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:49.139674 19273 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:49.163744 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:49.164441 12607 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 19.
I20260709 12:12:49.196022 19298 ts_tablet_manager.cc:933] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:49.239954 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.243763 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:49.246681 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 83400.7us
W20260709 12:12:49.267181 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 102535us
I20260709 12:12:49.291635 19298 tablet_copy_client.cc:323] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.67:37161
I20260709 12:12:49.314653 19304 ts_tablet_manager.cc:933] T 4755afb6a253477badd7f673bff77faa P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:49.342316 11986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 56723.5us
W20260709 12:12:49.346372 11914 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:49.414155 12032 tablet_copy_service.cc:140] P 46f08e8ff3774f25acad18252e5cd57d: Received BeginTabletCopySession request for tablet 0cb26c79d86d449786430b604fee9561 from peer 189a165e6619406382914fe3075dd436 ({username='slave'} at 127.0.0.1:58674)
I20260709 12:12:49.424034 12032 tablet_copy_service.cc:161] P 46f08e8ff3774f25acad18252e5cd57d: Beginning new tablet copy session on tablet 0cb26c79d86d449786430b604fee9561 from peer 189a165e6619406382914fe3075dd436 at {username='slave'} at 127.0.0.1:58674: session id = 189a165e6619406382914fe3075dd436-0cb26c79d86d449786430b604fee9561
I20260709 12:12:49.519053 19304 tablet_copy_client.cc:323] T 4755afb6a253477badd7f673bff77faa P 189a165e6619406382914fe3075dd436: tablet copy: Beginning tablet copy session from remote peer at address 127.10.114.66:45949
I20260709 12:12:49.555688 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:49.577363 19303 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:49.577950 19303 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.578285 19303 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.558736 12032 tablet_copy_source_session.cc:215] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:49.605228 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.614483 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.615141 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.664420 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.665398 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.729285 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:49.734547 19303 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:49.737067 19303 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Requested vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:49.743360 11758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.114.65:39113, user_credentials={real_user=slave}} blocked reactor thread for 162278us
W20260709 12:12:49.749337 11912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:39553, user_credentials={real_user=slave}} blocked reactor thread for 131329us
I20260709 12:12:49.760171 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a334a018a5045c29f59fb1e4e5119ae" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436"
I20260709 12:12:49.760960 12608 raft_consensus.cc:3060] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:49.759523 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:49.764273 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:49.764937 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:49.765465 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:49.774895 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb26c79d86d449786430b604fee9561. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:49.797942 11914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:37161, user_credentials={real_user=slave}} blocked reactor thread for 196629us
I20260709 12:12:49.815908 12608 raft_consensus.cc:2468] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9b5a12ef4a6cb097df86b95e5bfa in term 20.
W20260709 12:12:49.828024 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.832691 11912 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 
W20260709 12:12:49.834120 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.844832 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.841982 11988 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.844713 19263 raft_consensus.cc:2804] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:49.856016 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.862586 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.859318 19263 raft_consensus.cc:697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Becoming Leader. State: Replica: 6b7d9b5a12ef4a6cb097df86b95e5bfa, State: Running, Role: LEADER
I20260709 12:12:49.866288 19263 consensus_queue.cc:237] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:49.875722 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:49.876243 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:49.878839 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:49.879834 19336 raft_consensus.cc:493] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:49.880431 19336 raft_consensus.cc:515] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:49.876505 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.882754 19336 leader_election.cc:290] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:49.891976 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:49.935182 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f90dd7ad649d99cfdaddca2c38694" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:49.935823 19336 raft_consensus.cc:493] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:49.938460 19320 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:49.941792 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:49.943269 11914 leader_election.cc:304] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:49.947921 19306 raft_consensus.cc:2749] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:49.944953 19320 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:49.945070 19336 raft_consensus.cc:515] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:49.965138 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:49.968258 11914 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:49.972277 19320 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:49.974229 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:49.978063 19336 leader_election.cc:290] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:49.979725 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e68fbb001a46d6af7bd0fc3e94e9ec" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:49.993398 19336 raft_consensus.cc:493] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:49.994321 19298 tablet_copy_client.cc:806] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:49.994094 19336 raft_consensus.cc:515] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:49.994966 19298 tablet_copy_client.cc:670] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:49.976400 19263 raft_consensus.cc:493] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.011889 19306 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:49.998505 19336 leader_election.cc:290] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:49.997895 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dded4de56124928b0b4c23213e34af4" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.019114 19263 raft_consensus.cc:515] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.021333 19263 leader_election.cc:290] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.019174 19306 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.025804 19306 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.026965 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246d42c8e70c46dca72a4d8848a218d7" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:50.036099 11988 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:50.041427 19298 tablet_copy_client.cc:538] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:50.042057 19306 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.042703 19306 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.043184 19292 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:50.044210 19292 tablet_bootstrap.cc:492] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:50.045054 19292 ts_tablet_manager.cc:1403] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.916s	user 0.070s	sys 0.011s
I20260709 12:12:50.044838 11771 catalog_manager.cc:5697] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa reported cstate change: term changed from 18 to 20, leader changed from 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65) to 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66). New cstate: current_term: 20 leader_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.061058 19306 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.056990 19298 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Bootstrap starting.
I20260709 12:12:50.062925 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.081444 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8660209a034cd2a004c54e65aa0b9b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.084472 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198dd765f8a54a299a0558eccc0f684f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.096192 19302 raft_consensus.cc:493] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:50.096823 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:50.096915 19302 raft_consensus.cc:515] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.064841 19292 raft_consensus.cc:359] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.098210 19292 raft_consensus.cc:740] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:50.089311 19263 raft_consensus.cc:493] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.104313 19263 raft_consensus.cc:515] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:50.105432 11914 consensus_peers.cc:597] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.106859 11914 consensus_peers.cc:597] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:50.107100 19302 leader_election.cc:290] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:50.107661 11914 consensus_peers.cc:597] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:50.107788 19263 leader_election.cc:290] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.110841 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4f6fbe75cb413188e56f5338fb4c05" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.113906 19302 raft_consensus.cc:493] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.118731 19263 raft_consensus.cc:493] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.118938 11914 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.119086 19302 raft_consensus.cc:515] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.119431 19263 raft_consensus.cc:515] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.120113 19306 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.122803 11914 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.123309 19263 leader_election.cc:290] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.123665 19306 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.123955 19302 leader_election.cc:290] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.137115 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b73f446b5a4a9891731cc5f2c0877f" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.137383 12018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3402a9e1fa24f56be441155ae895d98" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:50.139432 11914 leader_election.cc:336] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.139973 11914 leader_election.cc:304] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.143673 19306 raft_consensus.cc:2749] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:50.145458 11914 leader_election.cc:336] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.149243 11914 leader_election.cc:304] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:50.151762 11914 consensus_peers.cc:597] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.152232 11914 leader_election.cc:336] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.152729 11914 leader_election.cc:304] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:50.155241 11914 leader_election.cc:336] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.155704 11914 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.165410 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8673bd187fa94b98baa982f36c6d2102" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.154771 19302 raft_consensus.cc:2749] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.153951 19306 raft_consensus.cc:2749] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.167560 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5cd0fe2cf34ab5817d4b21dcbec80c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.157470 19336 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.136382 19292 consensus_queue.cc:260] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.177273 19311 raft_consensus.cc:493] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.183775 19311 raft_consensus.cc:515] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.169219 19320 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.189069 19311 leader_election.cc:290] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.185477 19336 raft_consensus.cc:493] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.192806 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.185743 19315 raft_consensus.cc:493] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
W20260709 12:12:50.201165 11914 leader_election.cc:336] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.202827 11914 leader_election.cc:304] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:50.204560 11914 leader_election.cc:336] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.205018 11914 leader_election.cc:304] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.196497 19336 raft_consensus.cc:515] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.206741 19308 raft_consensus.cc:2749] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.209880 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3e790dfc8a4be2938233d59465f7b8" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.206070 19311 raft_consensus.cc:2749] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.200023 19320 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.204448 19315 raft_consensus.cc:515] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.232821 19336 leader_election.cc:290] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.233012 19315 leader_election.cc:290] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.236132 19320 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.241974 19336 raft_consensus.cc:493] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.242681 19336 raft_consensus.cc:515] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.245164 19336 leader_election.cc:290] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.252362 19292 ts_tablet_manager.cc:1434] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.207s	user 0.011s	sys 0.001s
I20260709 12:12:50.257607 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.258854 11914 leader_election.cc:304] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
W20260709 12:12:50.259756 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:50.260545 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21839ab34e84260a341ab0c1eeab564" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.260828 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb26c79d86d449786430b604fee9561" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.261947 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1867813aeb8b457984895a6ccb759346" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.270668 19306 raft_consensus.cc:2749] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.272341 19320 raft_consensus.cc:493] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.272904 19320 raft_consensus.cc:515] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.277906 19320 leader_election.cc:290] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.278141 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:50.285822 11914 leader_election.cc:336] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.286358 11914 leader_election.cc:304] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.287942 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361e6345864efa81f207f2a9dafda0" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.289655 19306 raft_consensus.cc:2749] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:50.292918 11914 leader_election.cc:336] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.293401 11914 leader_election.cc:304] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.294569 19320 raft_consensus.cc:2749] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:50.295725 11914 leader_election.cc:336] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.296177 11914 leader_election.cc:304] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.299250 19320 raft_consensus.cc:2749] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.307670 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-198dd765f8a54a299a0558eccc0f684f received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:50.308279 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-198dd765f8a54a299a0558eccc0f684f on tablet 198dd765f8a54a299a0558eccc0f684f with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:50.311079 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a71dd6e2e74227b7e93c1026aa2e8d" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.316375 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:50.320451 10697 tablet_replica.cc:333] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.321661 10697 raft_consensus.cc:2243] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.322501 10697 raft_consensus.cc:2272] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.329010 10697 tablet_replica.cc:333] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.330070 10697 raft_consensus.cc:2243] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.332705 10697 raft_consensus.cc:2272] T 79900041d3b94f09a8d4b882957a37c3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.338943 19320 raft_consensus.cc:493] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.339531 19320 raft_consensus.cc:515] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.341897 19320 leader_election.cc:290] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.343516 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:50.346448 11914 leader_election.cc:336] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.346997 11914 leader_election.cc:304] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.350324 10697 tablet_replica.cc:333] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.351086 19320 raft_consensus.cc:2749] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:50.352397 11914 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.352959 11914 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.354192 19320 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.355000 19320 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.356122 19306 raft_consensus.cc:493] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.356737 19306 raft_consensus.cc:515] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:50.354979 11914 raft_consensus.cc:2686] T 0cb26c79d86d449786430b604fee9561 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:50.354456 10697 raft_consensus.cc:2243] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.368330 19320 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.370407 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.382179 19320 raft_consensus.cc:493] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:12:50.386138 19320 raft_consensus.cc:515] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.388293 19320 leader_election.cc:290] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.389333 19306 leader_election.cc:290] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.390476 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93a2cf326204d8e89e4fe76ead348c5" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.395735 19306 raft_consensus.cc:493] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.397295 19306 raft_consensus.cc:515] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.405283 19306 leader_election.cc:290] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.405645 10697 raft_consensus.cc:2272] T 1f8660209a034cd2a004c54e65aa0b9b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.406389 12608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005405ff7b534db6b4c6be122c445915" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.408422 11914 leader_election.cc:304] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.409718 11914 leader_election.cc:304] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.410477 19320 raft_consensus.cc:2749] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.412714 19306 raft_consensus.cc:2749] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.417615 12608 raft_consensus.cc:1275] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Refusing update from remote peer 6b7d9b5a12ef4a6cb097df86b95e5bfa: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:50.419588 19324 consensus_queue.cc:1048] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:50.426052 12605 raft_consensus.cc:1217] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 12:12:50.428500 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd86af74b304d58a84939321319d52b" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.429854 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba16e46f4d34fb7a53a7a797485a99c" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.408675 10697 tablet_replica.cc:333] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.439697 10697 raft_consensus.cc:2243] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.440958 10697 raft_consensus.cc:2272] T 895f46e6dc144b38be8e04b5aac35a2e P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.453878 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0061f3d1f1a748729a1af7a6da2ecbb2" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.462086 19306 raft_consensus.cc:493] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.462874 19306 raft_consensus.cc:515] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.464208 10697 tablet_replica.cc:333] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.466830 19308 raft_consensus.cc:493] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 189a165e6619406382914fe3075dd436)
I20260709 12:12:50.470166 19308 raft_consensus.cc:515] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.472462 19308 leader_election.cc:290] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.473479 10697 raft_consensus.cc:2243] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.474023 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f11d66c6904b2bb34a6291c444fbcd" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:50.474428 10697 raft_consensus.cc:2272] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.480492 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:50.482434 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:50.487391 19306 leader_election.cc:290] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:50.498194 10697 tablet_replica.cc:333] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.499492 10697 raft_consensus.cc:2243] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.520458 11914 leader_election.cc:304] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.522046 10697 raft_consensus.cc:2272] T 9ff67aad7c28488cbcaa11428b8d0954 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.522954 19308 raft_consensus.cc:2749] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.527038 11914 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.529103 19306 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:50.530067 10697 tablet_replica.cc:333] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.531152 10697 raft_consensus.cc:2243] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.531836 10697 raft_consensus.cc:2272] T eba16e46f4d34fb7a53a7a797485a99c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.535373 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f2784828ee4269bb9bb741533de573" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:50.574784 10697 tablet_replica.cc:333] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.576957 10697 raft_consensus.cc:2243] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:12:50.578398 11914 consensus_peers.cc:597] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:50.579136 11914 leader_election.cc:336] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.579696 11914 leader_election.cc:304] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:50.580853 11914 leader_election.cc:336] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.581414 19306 raft_consensus.cc:2749] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.585717 10697 raft_consensus.cc:2272] T f845a1dd30e04dccb21da2a17ebf1415 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.586184 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:50.595220 10697 tablet_replica.cc:333] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.596266 10697 raft_consensus.cc:2243] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.597494 10697 raft_consensus.cc:2272] T 8bcc1200587447cb913298cc7ed8c931 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.581468 11914 leader_election.cc:304] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:50.599783 11914 raft_consensus.cc:2686] T b93a2cf326204d8e89e4fe76ead348c5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:50.600459 10697 tablet_replica.cc:333] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.601468 10697 raft_consensus.cc:2243] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.602520 10697 raft_consensus.cc:2272] T d6df9d20345c49f0a6f00d9f5f660140 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.600850 11914 leader_election.cc:336] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.616919 11914 leader_election.cc:304] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.621759 19306 raft_consensus.cc:2749] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:50.625826 10697 tablet_replica.cc:333] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.626946 10697 raft_consensus.cc:2243] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.627676 10697 raft_consensus.cc:2272] T 1867813aeb8b457984895a6ccb759346 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.631106 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:50.638896 11914 leader_election.cc:304] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d
I20260709 12:12:50.639917 19306 raft_consensus.cc:2749] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:50.642951 11914 leader_election.cc:336] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.643427 19298 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:50.643465 11914 leader_election.cc:304] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 189a165e6619406382914fe3075dd436, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.646055 19320 raft_consensus.cc:2749] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:50.646710 11914 consensus_peers.cc:597] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.644541 10697 tablet_replica.cc:333] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.650308 10697 raft_consensus.cc:2243] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.651196 10697 raft_consensus.cc:2272] T ecd86af74b304d58a84939321319d52b P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.644550 19298 tablet_bootstrap.cc:492] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Bootstrap complete.
I20260709 12:12:50.654405 19298 ts_tablet_manager.cc:1403] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Time spent bootstrapping tablet: real 0.598s	user 0.050s	sys 0.009s
I20260709 12:12:50.658146 19298 raft_consensus.cc:359] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.659169 19298 raft_consensus.cc:740] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 189a165e6619406382914fe3075dd436, State: Initialized, Role: LEARNER
I20260709 12:12:50.659950 19298 consensus_queue.cc:260] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:50.672994 10697 tablet_replica.cc:333] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.682199 10697 raft_consensus.cc:2243] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.683697 10697 raft_consensus.cc:2272] T 4755afb6a253477badd7f673bff77faa P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.692076 19298 ts_tablet_manager.cc:1434] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:12:50.694135 12032 tablet_copy_service.cc:342] P 46f08e8ff3774f25acad18252e5cd57d: Request end of tablet copy session 189a165e6619406382914fe3075dd436-0cb26c79d86d449786430b604fee9561 received from {username='slave'} at 127.0.0.1:58674
I20260709 12:12:50.694600 12032 tablet_copy_service.cc:434] P 46f08e8ff3774f25acad18252e5cd57d: ending tablet copy session 189a165e6619406382914fe3075dd436-0cb26c79d86d449786430b604fee9561 on tablet 0cb26c79d86d449786430b604fee9561 with peer 189a165e6619406382914fe3075dd436
I20260709 12:12:50.700012 10697 tablet_replica.cc:333] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.701079 10697 raft_consensus.cc:2243] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:12:50.717780 11914 consensus_peers.cc:597] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:50.714480 10697 raft_consensus.cc:2272] T f18a923a6db4400eb4027dc16134d310 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.730060 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:50.735106 10697 tablet_replica.cc:333] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.736272 10697 raft_consensus.cc:2243] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.745958 10697 raft_consensus.cc:2272] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.749161 10697 tablet_replica.cc:333] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.750090 10697 raft_consensus.cc:2243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.750761 10697 raft_consensus.cc:2272] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.776096 10697 tablet_replica.cc:333] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.777103 10697 raft_consensus.cc:2243] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.777858 10697 raft_consensus.cc:2272] T 8673bd187fa94b98baa982f36c6d2102 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.780795 10697 tablet_replica.cc:333] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.781714 10697 raft_consensus.cc:2243] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.782397 10697 raft_consensus.cc:2272] T 3e361e6345864efa81f207f2a9dafda0 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.785284 10697 tablet_replica.cc:333] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.792062 10697 raft_consensus.cc:2243] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.793448 10697 raft_consensus.cc:2272] T 628666a2024d4a61831835e7dee5737a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.796521 10697 tablet_replica.cc:333] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.797426 10697 raft_consensus.cc:2243] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.814759 10697 raft_consensus.cc:2272] T 92c36db79b9b44bf9225011eaecc17c4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.817829 10697 tablet_replica.cc:333] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.818755 10697 raft_consensus.cc:2243] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.819543 10697 raft_consensus.cc:2272] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.838598 10697 tablet_replica.cc:333] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.839555 10697 raft_consensus.cc:2243] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.840884 10697 raft_consensus.cc:2272] T 7ee46b14be8c4a1a99faf37e6697390a P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.843851 10697 tablet_replica.cc:333] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.844784 10697 raft_consensus.cc:2243] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:12:50.854025 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:50.858265 10697 raft_consensus.cc:2272] T b1bb8ee4e7b34277ac74a869a9f66f97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.871114 10697 tablet_replica.cc:333] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.872642 10697 raft_consensus.cc:2243] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.873772 10697 raft_consensus.cc:2272] T 246d42c8e70c46dca72a4d8848a218d7 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.885308 10697 tablet_replica.cc:333] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.887259 10697 raft_consensus.cc:2243] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.898999 10697 raft_consensus.cc:2272] T 7f4f6fbe75cb413188e56f5338fb4c05 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.899956 19308 raft_consensus.cc:493] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.900463 19308 raft_consensus.cc:515] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:50.905807 19308 leader_election.cc:290] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:50.908121 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed1e68af58741ceb833c997cabb45a3" candidate_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:50.912875 11914 leader_election.cc:336] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:50.902191 10697 tablet_replica.cc:333] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.918336 10697 raft_consensus.cc:2243] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.920570 10697 raft_consensus.cc:2272] T b00e47b0acb44843a177246087e87ffd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.923623 10697 tablet_replica.cc:333] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.924513 10697 raft_consensus.cc:2243] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.925165 10697 raft_consensus.cc:2272] T c21839ab34e84260a341ab0c1eeab564 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.925426 19199 raft_consensus.cc:1064] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:50.917729 11914 leader_election.cc:304] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:12:50.928620 19199 consensus_queue.cc:237] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:50.936079 19302 raft_consensus.cc:2749] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.945919 10697 tablet_replica.cc:333] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.965375 10697 raft_consensus.cc:2243] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.967129 10697 raft_consensus.cc:2272] T c3402a9e1fa24f56be441155ae895d98 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.970872 10697 tablet_replica.cc:333] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:50.971891 10697 raft_consensus.cc:2243] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.972625 10697 raft_consensus.cc:2272] T 6ed1e68af58741ceb833c997cabb45a3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.989527 12605 raft_consensus.cc:1275] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:50.991707 19333 consensus_queue.cc:1048] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:51.006760 10697 tablet_replica.cc:333] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.007951 10697 raft_consensus.cc:2243] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.008828 10697 raft_consensus.cc:2272] T 198dd765f8a54a299a0558eccc0f684f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.029928 10697 tablet_replica.cc:333] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.030869 10697 raft_consensus.cc:2243] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.031610 10697 raft_consensus.cc:2272] T b6b73f446b5a4a9891731cc5f2c0877f P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.045782 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:51.046067 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.051862 10697 tablet_replica.cc:333] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.052899 10697 raft_consensus.cc:2243] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.054239 10697 raft_consensus.cc:2272] T 3cd3b75a5fa040ba872559d73e67a565 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.050910 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:51.060737 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.057395 10697 tablet_replica.cc:333] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.070701 10697 raft_consensus.cc:2243] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.071522 10697 raft_consensus.cc:2272] T b76f90dd7ad649d99cfdaddca2c38694 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.080106 10697 tablet_replica.cc:333] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.081127 10697 raft_consensus.cc:2243] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.081861 10697 raft_consensus.cc:2272] T 005405ff7b534db6b4c6be122c445915 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.112869 10697 tablet_replica.cc:333] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.113909 10697 raft_consensus.cc:2243] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:12:51.127892 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.128620 12605 raft_consensus.cc:1217] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 12:12:51.115226 10697 raft_consensus.cc:2272] T 72e0c467da954999a14a9ba2a9af25b9 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.142382 10697 tablet_replica.cc:333] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.143339 10697 raft_consensus.cc:2243] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.144106 10697 raft_consensus.cc:2272] T c0a71dd6e2e74227b7e93c1026aa2e8d P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.159713 10697 tablet_replica.cc:333] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.170322 10697 raft_consensus.cc:2243] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.171193 10697 raft_consensus.cc:2272] T e4f11d66c6904b2bb34a6291c444fbcd P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.183357 10697 tablet_replica.cc:333] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.190310 10697 raft_consensus.cc:2243] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.191489 10697 raft_consensus.cc:2272] T eb3e790dfc8a4be2938233d59465f7b8 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.196100 10697 tablet_replica.cc:333] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
W20260709 12:12:51.197925 11914 consensus_peers.cc:597] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.203330 10697 raft_consensus.cc:2243] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.214686 10697 raft_consensus.cc:2272] T 6e6c59801bf644679a9e155c914bbc97 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.218305 10697 tablet_replica.cc:333] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.230263 10697 raft_consensus.cc:2243] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.231266 10697 raft_consensus.cc:2272] T f4f2784828ee4269bb9bb741533de573 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.235689 10697 tablet_replica.cc:333] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
W20260709 12:12:51.238912 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.240345 10697 raft_consensus.cc:2243] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.241423 10697 raft_consensus.cc:2272] T 54f6b4dc8b6a484da6aa10c1562ab511 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.245329 10697 tablet_replica.cc:333] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.246168 10697 raft_consensus.cc:2243] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.246812 10697 raft_consensus.cc:2272] T 6dded4de56124928b0b4c23213e34af4 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.247291 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:51.252334 10697 tablet_replica.cc:333] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.253351 10697 raft_consensus.cc:2243] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.257324 10697 raft_consensus.cc:2272] T 6a334a018a5045c29f59fb1e4e5119ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.261957 10697 tablet_replica.cc:333] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.262843 10697 raft_consensus.cc:2243] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.265872 10697 raft_consensus.cc:2272] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.285732 10697 tablet_replica.cc:333] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.291661 10697 raft_consensus.cc:2243] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.298694 10697 raft_consensus.cc:2272] T f31959fa0f994ee8a9587eb78cb124b3 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.303128 10697 tablet_replica.cc:333] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.306165 10697 raft_consensus.cc:2243] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.311597 19199 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.319036 19199 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:51.320433 10697 raft_consensus.cc:2272] T cbba5e6f295144a79461c5afc2e273ae P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.321507 19199 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:51.329728 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:51.335484 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:51.335999 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.337929 19199 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.340945 10697 tablet_replica.cc:333] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
I20260709 12:12:51.346958 10697 raft_consensus.cc:2243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.348258 10697 raft_consensus.cc:2272] T 99ffb9377dca4ebd94a32fd00a581fb5 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.352341 10697 tablet_replica.cc:333] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa: stopping tablet replica
W20260709 12:12:51.343974 11988 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.344772 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.365806 10697 raft_consensus.cc:2243] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.367163 10697 raft_consensus.cc:2272] T a431e9f3bc6146ccbaa801baac0eeb37 P 6b7d9b5a12ef4a6cb097df86b95e5bfa [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.402025 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:51.426479 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.504479 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.508962 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:51.532866 11914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:51.534951 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.560475 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.566789 19326 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.567536 19326 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:51.571913 19326 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:51.575265 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
W20260709 12:12:51.614035 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.619916 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:51.620596 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
W20260709 12:12:51.623600 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:51.624734 19348 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:51.628367 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.633144 19314 raft_consensus.cc:1064] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: attempting to promote NON_VOTER 189a165e6619406382914fe3075dd436 to VOTER
I20260709 12:12:51.636575 19314 consensus_queue.cc:237] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:51.642130 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:51.655700 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:51.657270 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.669497 19313 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.670516 19313 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:51.675943 19313 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:51.703234 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:51.704602 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.704792 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:51.706388 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.708122 19313 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.719635 12605 raft_consensus.cc:1275] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: Refusing update from remote peer 46f08e8ff3774f25acad18252e5cd57d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:51.721614 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.721412 19313 consensus_queue.cc:1048] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:51.728881 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:51.730633 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:51.743992 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.748466 19313 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.749125 19313 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:51.752957 19199 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.753105 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:51.753512 19199 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:51.755504 19199 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:51.756762 19313 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:51.779479 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.780691 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:51.784600 11988 leader_election.cc:336] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:51.792138 11988 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.792968 19199 raft_consensus.cc:2749] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:51.794246 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:51.796715 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.797485 19199 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:51.813201 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.816635 19199 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.825954 19199 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:51.827987 19199 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:51.830789 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:51.831404 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:51.834717 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:51.838027 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.844508 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:51.850118 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:51.850697 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.851632 19199 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:51.861662 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.886631 19348 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.887276 19348 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:51.889631 19348 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:51.894039 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:51.894820 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 17.
I20260709 12:12:51.896875 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:51.897660 19348 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:51.898067 19348 raft_consensus.cc:493] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.898602 19348 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:51.905119 12577 leader_election.cc:336] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:51.912281 19326 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:51.912892 19326 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:51.914999 19326 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:51.921208 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:51.922225 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:51.922631 12577 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.923482 19326 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.922905 19348 raft_consensus.cc:515] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:51.929806 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcc1200587447cb913298cc7ed8c931" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:51.930425 12022 raft_consensus.cc:3060] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.930560 19348 leader_election.cc:290] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:51.931165 12577 leader_election.cc:336] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:51.949882 12022 raft_consensus.cc:2468] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 18.
I20260709 12:12:51.951380 12577 leader_election.cc:304] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:51.952399 19348 raft_consensus.cc:2804] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:51.952909 19348 raft_consensus.cc:697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
W20260709 12:12:51.955487 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:51.953876 19348 consensus_queue.cc:237] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:51.967588 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:51.975850 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:51.982335 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:52.010612 11768 catalog_manager.cc:5697] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 17 to 18, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 18 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.012346 19199 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.012925 19199 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.015144 19199 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:52.020929 19199 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.021683 19199 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:52.024951 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.025676 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.026081 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.026786 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:52.027508 12605 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
I20260709 12:12:52.029263 19199 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:52.029821 19199 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:52.040153 11988 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.043390 11988 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.043905 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.045390 19199 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:52.078112 19313 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.078764 19313 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:52.081161 19313 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.092667 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.094309 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.094838 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.099767 19313 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:52.132172 11988 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.137264 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.150015 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:52.151885 19313 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.152523 19313 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.154814 19313 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.157497 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.170661 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.172036 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.183629 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.195581 19314 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:52.200661 19199 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.201205 19199 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.203253 19199 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.228847 11988 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:52.234762 19348 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.244732 19348 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.247130 19348 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.256508 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.257313 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.257766 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.258620 19348 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:52.259315 19199 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.259922 19199 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.262116 19199 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.269173 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.270474 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.270928 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.277259 19304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41000 (request call id 1633) took 3103 ms. Trace:
I20260709 12:12:52.277876 19304 rpcz_store.cc:276] 0709 12:12:49.173910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.174593 (+   683us) service_pool.cc:224] Handling call
0709 12:12:49.328441 (+153848us) ts_tablet_manager.cc:934] T 4755afb6a253477badd7f673bff77faa P 189a165e6619406382914fe3075dd436: Initiating tablet copy from peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
0709 12:12:52.277139 (+2948698us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10152,"spinlock_wait_cycles":51456,"tablet-copy.queue_time_us":116311,"thread_start_us":246822,"threads_started":2}
W20260709 12:12:52.279838 12574 connection.cc:466] server connection from 127.0.0.1:41000 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41000 (request call id 1633) could send its response
I20260709 12:12:52.287372 19199 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:52.291164 19313 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.291733 19313 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.293859 19313 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.319312 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.324028 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.324914 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.325889 19313 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:52.343492 19313 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.344166 19313 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.349669 19313 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
I20260709 12:12:52.353494 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
W20260709 12:12:52.357499 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.362828 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.370833 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:52.371577 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:52.372080 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.372516 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.373384 19313 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:52.378471 19313 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.379065 19313 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.381821 19313 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.388751 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.400740 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.408779 11988 leader_election.cc:336] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.416661 19358 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.421932 19358 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.424367 19358 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:52.420368 12022 raft_consensus.cc:1275] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:52.428725 11988 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 189a165e6619406382914fe3075dd436, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.433032 19313 raft_consensus.cc:2749] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.444875 19358 consensus_queue.cc:1048] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
W20260709 12:12:52.474406 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.494688 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.495378 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.500164 19313 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:52.500350 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:52.528221 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:52.556193 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.557206 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.557811 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.558766 19348 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:52.587029 19348 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.587785 19348 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.591604 19348 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:52.597067 19365 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.597805 19365 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.601506 19365 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:52.603571 12577 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.610841 19313 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.615849 19313 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.618288 19313 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.615137 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:52.647785 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:52.648589 12021 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 19.
W20260709 12:12:52.660468 10697 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11969)
I20260709 12:12:52.668551 19358 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.669267 19358 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.671578 19358 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.694777 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:52.722055 19199 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.722807 19199 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.724928 19199 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.729461 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.741322 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.743474 19199 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.751005 19199 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.753373 19199 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:52.754563 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.750087 12577 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 
I20260709 12:12:52.755970 19358 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:52.756358 19358 raft_consensus.cc:493] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.756384 19199 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.756774 19358 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.767984 19358 raft_consensus.cc:515] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:52.782341 19358 leader_election.cc:290] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 election: Requested vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:12:52.784863 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.794452 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.795044 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:52.792274 11988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111) [suppressed 623 similar messages]
I20260709 12:12:52.798623 19358 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:52.799969 12577 leader_election.cc:336] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.818603 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e0c467da954999a14a9ba2a9af25b9" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d"
I20260709 12:12:52.819344 12022 raft_consensus.cc:3060] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.825794 19199 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:52.826475 19199 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:52.828672 19199 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:52.811614 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.835246 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:52.836589 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.840344 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.839766 12022 raft_consensus.cc:2468] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 20.
W20260709 12:12:52.838199 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.843536 19199 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:52.847870 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:52.849182 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:52.848583 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.851697 12577 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.852699 19358 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:52.853677 19199 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:12:52.868400 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:52.876899 12577 leader_election.cc:336] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:52.886377 12577 leader_election.cc:304] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:52.888028 19358 raft_consensus.cc:2804] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:52.888569 19358 raft_consensus.cc:697] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 20 LEADER]: Becoming Leader. State: Replica: 189a165e6619406382914fe3075dd436, State: Running, Role: LEADER
I20260709 12:12:52.889619 19358 consensus_queue.cc:237] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:52.899287 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:52.946738 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:52.951962 11771 catalog_manager.cc:5697] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 reported cstate change: term changed from 19 to 20, leader changed from 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66) to 189a165e6619406382914fe3075dd436 (127.10.114.68). New cstate: current_term: 20 leader_uuid: "189a165e6619406382914fe3075dd436" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:53.218834 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:53.249825 19199 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.250464 19199 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:53.252722 19199 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.257431 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:53.267267 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:53.349843 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:53.402112 12021 raft_consensus.cc:1275] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Refusing update from remote peer 189a165e6619406382914fe3075dd436: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:53.404439 19358 consensus_queue.cc:1048] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:12:53.407193 12577 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.432452 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:53.539948 19199 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.540545 19199 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:53.542661 19199 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.552326 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:53.598613 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:53.605051 19199 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.605756 19199 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:53.607901 19199 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.616529 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:53.659008 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:53.661142 10697 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11969)
W20260709 12:12:53.674283 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:53.709975 19377 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.710685 19377 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:53.713292 19377 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.720837 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:53.721700 19348 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.722395 19348 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:53.725626 19348 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:53.728204 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:53.728996 12021 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
W20260709 12:12:53.729672 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:53.738139 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:53.740877 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.741295 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.742671 19376 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:53.788956 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:53.797101 19348 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:53.797744 19348 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:53.802922 19348 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.811880 11802 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
W20260709 12:12:53.815527 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:53.816471 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:53.816872 12577 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.817653 19348 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:53.936148 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.937186 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.942505 19377 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
W20260709 12:12:53.943665 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:53.941634 19314 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.944870 19377 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:53.960717 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.961412 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.962697 19199 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:53.963868 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.964627 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.966657 19314 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:53.970925 19377 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:53.980265 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.981086 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:53.987591 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:53.988341 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:53.989481 19199 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.986796 19377 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:54.003762 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.011000 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.011547 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.013422 19379 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:54.022300 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:54.027498 19379 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.028602 19379 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:54.029163 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:54.031997 19379 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.039702 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.049618 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.050693 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.051157 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.061314 19379 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.084682 19379 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.086341 19379 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.113916 19379 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.124238 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.142601 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.143185 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.144053 19199 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:54.145421 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:54.162209 19376 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.164674 19376 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:54.175392 19376 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.185125 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:54.185868 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:54.198483 19379 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.199499 19379 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:54.205940 19379 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.236793 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:54.237653 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:54.238154 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
W20260709 12:12:54.243790 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.245446 19379 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:54.246749 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.250016 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:54.250569 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.257632 19376 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:54.262915 19379 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.263831 19379 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.266490 19379 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.286017 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:54.286921 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:54.287381 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.289702 19379 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:54.316998 11988 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:54.320861 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:54.324754 19376 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.325739 19376 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:54.332881 19376 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.345321 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.346400 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.346946 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.348042 19376 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:12:54.359310 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:54.381515 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.405334 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:54.432636 11988 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.436483 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:54.455758 19199 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.456486 19199 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.458835 19199 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.471396 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.472256 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.472680 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.485697 19199 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:54.503888 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:54.505975 19199 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.506772 19199 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.508941 19199 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:54.519572 19199 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.520385 19199 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.532773 19199 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.534503 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.544499 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.550884 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:54.556993 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:54.557730 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.559414 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.558388 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:54.559865 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.576609 19379 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:54.577968 19358 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.578882 19358 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
W20260709 12:12:54.579545 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:54.581552 19358 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.587039 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.587777 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.588191 12577 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.589046 19358 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:54.589478 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.590029 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:54.590668 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:54.591101 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.591929 19199 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:54.633455 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:54.636653 19379 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.637467 19379 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:54.640121 19379 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.645699 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.646422 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.646839 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.647681 19379 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:54.648736 19379 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.649484 19379 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:54.657114 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.658165 12577 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:54.659027 19379 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.662554 10697 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11969)
W20260709 12:12:54.664166 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:54.664683 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.665943 19379 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:54.674227 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.712438 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.820468 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.825623 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.831025 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:54.859760 19358 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:54.860554 19358 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:54.863029 19358 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:54.867650 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.872035 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:54.888495 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:54.892477 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:54.893270 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:54.892964 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:54.897156 19358 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:54.931617 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.963097 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:54.979934 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:55.053985 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:55.258091 11988 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:55.275189 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:55.297943 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:55.314793 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:55.353260 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:55.426227 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:55.511471 19199 raft_consensus.cc:493] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:55.512127 19199 raft_consensus.cc:515] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:55.514490 19199 leader_election.cc:290] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:55.522621 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:55.523346 11988 leader_election.cc:336] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:55.523850 11988 leader_election.cc:304] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:55.524642 19199 raft_consensus.cc:2749] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:55.573604 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:55.663206 10697 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 11969)
W20260709 12:12:55.668246 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:55.678966 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:55.708457 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:55.714843 19358 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:55.715788 19358 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:55.724799 19358 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:12:55.731745 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "189a165e6619406382914fe3075dd436" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "46f08e8ff3774f25acad18252e5cd57d" is_pre_election: true
I20260709 12:12:55.732946 12022 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 189a165e6619406382914fe3075dd436 in term 13.
W20260709 12:12:55.775470 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:55.777218 12577 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:55.777809 12577 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436, 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:55.778985 19381 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:55.782756 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:55.788992 12577 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:55.985872 19199 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:55.986796 19199 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:55.989173 19199 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:55.999365 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.011236 19358 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.012001 19358 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:56.014585 19358 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.020507 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:56.021402 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.021960 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.022943 19358 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:12:56.129969 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.167214 19199 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.167963 19199 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:56.175453 19199 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.189462 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.214048 19379 raft_consensus.cc:493] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.214895 19379 raft_consensus.cc:515] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:56.242765 19379 leader_election.cc:290] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:56.217897 19199 raft_consensus.cc:493] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.243863 19199 raft_consensus.cc:515] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:56.246308 19199 leader_election.cc:290] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.293102 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.298292 19358 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.309286 19358 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:56.312095 19358 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.315807 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:56.370688 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:56.391625 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.392251 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.394846 19358 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:56.409037 19385 raft_consensus.cc:493] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.409947 19385 raft_consensus.cc:515] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:56.412619 19385 leader_election.cc:290] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.423974 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:56.515621 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:56.533779 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:56.642462 19385 raft_consensus.cc:493] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.643150 19385 raft_consensus.cc:515] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:56.651320 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.652606 19385 leader_election.cc:290] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.663899 10697 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 11969)
I20260709 12:12:56.682229 19386 raft_consensus.cc:493] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.682955 19386 raft_consensus.cc:515] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:56.698154 19386 leader_election.cc:290] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.709484 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:56.771998 11988 consensus_peers.cc:597] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:56.775163 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:56.797737 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:56.821821 19358 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.822410 19358 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:56.824623 19358 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.835281 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:56.862216 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:56.864784 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:56.877369 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.891225 19381 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.913931 19381 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:56.914717 19381 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:56.918993 19381 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:56.925907 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:56.936053 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:56.934404 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.943162 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.944728 19386 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:56.944742 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:56.948451 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:56.949208 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.950382 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.951992 19386 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:56.954598 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:56.955180 11988 leader_election.cc:336] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.955629 11988 leader_election.cc:304] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.956490 19386 raft_consensus.cc:2749] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:56.956738 11988 leader_election.cc:336] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.957327 11988 leader_election.cc:304] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.958215 19386 raft_consensus.cc:2749] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:56.958699 11988 leader_election.cc:336] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.959244 11988 leader_election.cc:304] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.960047 19386 raft_consensus.cc:2749] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:56.960275 11988 leader_election.cc:336] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.960808 11988 leader_election.cc:304] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.961615 19386 raft_consensus.cc:2749] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:56.961880 11988 leader_election.cc:336] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.962390 11988 leader_election.cc:304] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.963168 19386 raft_consensus.cc:2749] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:56.972723 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:56.986403 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:56.988884 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:56.989380 12577 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:56.990281 19381 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:57.006485 19386 raft_consensus.cc:493] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.007189 19386 raft_consensus.cc:515] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:57.010804 19386 leader_election.cc:290] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.013186 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.016851 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.029807 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.030422 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:57.030987 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:57.031618 11988 leader_election.cc:336] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:57.031991 11988 leader_election.cc:304] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.032791 19388 raft_consensus.cc:2749] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:57.061803 11988 consensus_peers.cc:597] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:57.075677 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:57.096105 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:57.098073 19388 raft_consensus.cc:493] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.098760 19388 raft_consensus.cc:515] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:57.101141 19388 leader_election.cc:290] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.106863 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.113649 11988 leader_election.cc:336] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:57.113813 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:57.114274 11988 leader_election.cc:304] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.129433 19388 raft_consensus.cc:2749] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:57.137471 11988 consensus_peers.cc:597] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:57.138298 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.219506 11988 consensus_peers.cc:597] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:57.220348 11988 consensus_peers.cc:597] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.257382 11988 consensus_peers.cc:597] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.261473 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.327432 11988 consensus_peers.cc:597] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.329699 12577 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:57.369690 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.404815 11988 consensus_peers.cc:597] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:57.405040 19385 raft_consensus.cc:493] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.405711 19385 raft_consensus.cc:515] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } attrs { replace: true } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } }
I20260709 12:12:57.408198 19385 leader_election.cc:290] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.423537 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.424394 11988 leader_election.cc:336] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.424819 11988 leader_election.cc:304] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.428592 19385 raft_consensus.cc:2749] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:57.435120 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.443533 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:57.459246 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.471901 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:57.509651 19381 raft_consensus.cc:493] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.510236 19381 raft_consensus.cc:515] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:57.512537 19381 leader_election.cc:290] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:57.513772 19379 raft_consensus.cc:493] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.514350 19379 raft_consensus.cc:515] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:57.516577 19379 leader_election.cc:290] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.525732 11988 consensus_peers.cc:597] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:57.540885 19385 raft_consensus.cc:493] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.552024 19385 raft_consensus.cc:515] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
W20260709 12:12:57.553936 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.555645 11988 leader_election.cc:336] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.556084 11988 leader_election.cc:304] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.556653 19385 leader_election.cc:290] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:57.557228 19385 raft_consensus.cc:2749] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:57.562474 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:57.577633 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.578624 11988 leader_election.cc:336] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.579061 11988 leader_election.cc:304] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.579797 19385 raft_consensus.cc:2749] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:12:57.587266 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.588792 12577 leader_election.cc:336] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.589383 12577 leader_election.cc:304] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.590440 19358 raft_consensus.cc:2749] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:57.612809 19379 raft_consensus.cc:493] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.613585 19379 raft_consensus.cc:515] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:57.615994 19379 leader_election.cc:290] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.621330 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:57.622149 11988 leader_election.cc:336] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.622582 11988 leader_election.cc:304] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.623420 19379 raft_consensus.cc:2749] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:57.664443 10697 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 11969)
W20260709 12:12:57.673349 11988 consensus_peers.cc:597] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:57.684535 11988 consensus_peers.cc:597] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.694065 11988 consensus_peers.cc:597] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:57.749852 19388 raft_consensus.cc:493] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.750458 19388 raft_consensus.cc:515] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:57.752856 19388 leader_election.cc:290] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:57.759233 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:12:57.760247 11988 leader_election.cc:336] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:57.760703 11988 leader_election.cc:304] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.761727 19385 raft_consensus.cc:2749] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:57.778957 11988 consensus_peers.cc:597] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:57.798233 12577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111) [suppressed 594 similar messages]
W20260709 12:12:57.829181 11988 consensus_peers.cc:597] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.862088 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:57.939114 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:57.946645 11988 consensus_peers.cc:597] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:57.981148 19385 raft_consensus.cc:493] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:57.981838 19385 raft_consensus.cc:515] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:57.987241 19385 leader_election.cc:290] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 189a165e6619406382914fe3075dd436 (127.10.114.68:39553)
W20260709 12:12:57.989493 11988 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:57.990613 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f845a1dd30e04dccb21da2a17ebf1415" candidate_uuid: "46f08e8ff3774f25acad18252e5cd57d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "189a165e6619406382914fe3075dd436" is_pre_election: true
I20260709 12:12:57.991365 12607 raft_consensus.cc:2468] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f08e8ff3774f25acad18252e5cd57d in term 13.
W20260709 12:12:57.993690 11988 leader_election.cc:336] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:57.994194 11988 leader_election.cc:304] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:57.995142 19385 raft_consensus.cc:2749] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:58.119009 11988 consensus_peers.cc:597] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:58.133173 11988 consensus_peers.cc:597] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:58.222906 11988 consensus_peers.cc:597] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:58.386927 11988 consensus_peers.cc:597] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:58.445880 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:58.451738 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:58.455042 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:58.508108 12577 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:58.560205 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:58.618067 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:12:58.621704 19391 raft_consensus.cc:493] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:58.622361 19391 raft_consensus.cc:515] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:58.624361 19391 leader_election.cc:290] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:58.636970 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:58.638355 11988 leader_election.cc:336] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:58.638860 11988 leader_election.cc:304] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:58.640657 19391 raft_consensus.cc:2749] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.703205 19385 raft_consensus.cc:493] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:58.703852 19385 raft_consensus.cc:515] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } }
I20260709 12:12:58.706218 19385 leader_election.cc:290] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:58.712815 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:58.716244 11988 leader_election.cc:336] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:58.716919 11988 leader_election.cc:304] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46f08e8ff3774f25acad18252e5cd57d; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:58.717921 19385 raft_consensus.cc:2749] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.837569 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
W20260709 12:12:58.868978 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:58.882500 11988 consensus_peers.cc:597] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:58.893884 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:58.909379 19392 raft_consensus.cc:493] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:58.910095 19392 raft_consensus.cc:515] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:58.912200 19392 leader_election.cc:290] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:12:58.912959 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:58.923909 11988 consensus_peers.cc:597] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:58.975112 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:12:58.977209 12577 leader_election.cc:336] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:58.977954 12577 leader_election.cc:304] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:58.978821 19358 raft_consensus.cc:2749] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.993501 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:58.998442 10697 tablet_replica.cc:333] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:58.999894 10697 raft_consensus.cc:2243] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.000833 10697 raft_consensus.cc:2272] T 895f46e6dc144b38be8e04b5aac35a2e P 46f08e8ff3774f25acad18252e5cd57d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:59.001758 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:59.002655 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.004608 10697 tablet_replica.cc:333] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.009037 10697 raft_consensus.cc:2243] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.010607 10697 raft_consensus.cc:2272] T b2c1fe07352d4472a01fce46f98ce1a6 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.015111 10697 tablet_replica.cc:333] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.016284 10697 raft_consensus.cc:2243] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.017891 10697 raft_consensus.cc:2272] T 1f8660209a034cd2a004c54e65aa0b9b P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.021953 10697 tablet_replica.cc:333] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
W20260709 12:12:59.022621 12577 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.023208 10697 raft_consensus.cc:2243] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:12:59.024649 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.025353 10697 pending_rounds.cc:70] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Trying to abort 1 pending ops.
I20260709 12:12:59.025724 10697 pending_rounds.cc:77] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305622207015321600 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "0cb26c79d86d449786430b604fee9561" old_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } } }
I20260709 12:12:59.026767 10697 raft_consensus.cc:2917] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Aborting config change with OpId 18.14: Aborted: Op aborted
I20260709 12:12:59.027179 10697 raft_consensus.cc:2889] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:12:59.027520 10697 raft_consensus.cc:2272] T 0cb26c79d86d449786430b604fee9561 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.034299 10697 tablet_replica.cc:333] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.035367 10697 raft_consensus.cc:2243] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.036443 10697 raft_consensus.cc:2272] T 79900041d3b94f09a8d4b882957a37c3 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:59.039346 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:59.044929 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.047350 10697 tablet_replica.cc:333] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
W20260709 12:12:59.047852 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.048487 10697 raft_consensus.cc:2243] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.049420 10697 raft_consensus.cc:2272] T d6df9d20345c49f0a6f00d9f5f660140 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.052135 10697 tablet_replica.cc:333] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.052820 10697 raft_consensus.cc:2243] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.054193 10697 raft_consensus.cc:2272] T efa456bf4db9474f84e2e5a51c919032 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.056519 10697 tablet_replica.cc:333] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.057121 10697 raft_consensus.cc:2243] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.057705 10697 raft_consensus.cc:2272] T 0bace639158f425898b2859f751fc2cd P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.060012 10697 tablet_replica.cc:333] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.060685 10697 raft_consensus.cc:2243] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.061678 10697 raft_consensus.cc:2272] T 9ff67aad7c28488cbcaa11428b8d0954 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.064030 10697 tablet_replica.cc:333] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.064680 10697 raft_consensus.cc:2243] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.065238 10697 raft_consensus.cc:2272] T a1d0a2103114406e9d43b045cd4acfe0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.067472 10697 tablet_replica.cc:333] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.068106 10697 raft_consensus.cc:2243] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.069237 10697 raft_consensus.cc:2272] T eba16e46f4d34fb7a53a7a797485a99c P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.071592 10697 tablet_replica.cc:333] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.072254 10697 raft_consensus.cc:2243] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.072803 10697 raft_consensus.cc:2272] T 8bcc1200587447cb913298cc7ed8c931 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.075167 10697 tablet_replica.cc:333] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.075839 10697 raft_consensus.cc:2243] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.077134 10697 raft_consensus.cc:2272] T f845a1dd30e04dccb21da2a17ebf1415 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.079494 10697 tablet_replica.cc:333] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.080341 10697 raft_consensus.cc:2243] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.081625 10697 raft_consensus.cc:2272] T 0061f3d1f1a748729a1af7a6da2ecbb2 P 46f08e8ff3774f25acad18252e5cd57d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.084120 10697 tablet_replica.cc:333] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.084751 10697 raft_consensus.cc:2243] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.085444 10697 raft_consensus.cc:2272] T f18a923a6db4400eb4027dc16134d310 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.087813 10697 tablet_replica.cc:333] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.088454 10697 raft_consensus.cc:2243] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.089896 10697 raft_consensus.cc:2272] T 0feb55752b27445c8dee19903f9e6d41 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.093293 10697 tablet_replica.cc:333] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.094493 10697 raft_consensus.cc:2243] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.096037 10697 raft_consensus.cc:2272] T 8673bd187fa94b98baa982f36c6d2102 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.102128 10697 tablet_replica.cc:333] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.103056 10697 raft_consensus.cc:2243] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.104259 10697 raft_consensus.cc:2272] T 92c36db79b9b44bf9225011eaecc17c4 P 46f08e8ff3774f25acad18252e5cd57d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.108228 10697 tablet_replica.cc:333] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.109258 10697 raft_consensus.cc:2243] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.111240 10697 raft_consensus.cc:2272] T ecd86af74b304d58a84939321319d52b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.114833 10697 tablet_replica.cc:333] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.115669 10697 raft_consensus.cc:2243] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.116442 10697 raft_consensus.cc:2272] T 4755afb6a253477badd7f673bff77faa P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.119122 10697 tablet_replica.cc:333] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.119840 10697 raft_consensus.cc:2243] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.121184 10697 raft_consensus.cc:2272] T 0a5cd0fe2cf34ab5817d4b21dcbec80c P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.124073 10697 tablet_replica.cc:333] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.124789 10697 raft_consensus.cc:2243] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.126394 10697 raft_consensus.cc:2272] T d10ddce6896a49a8a2a9ec09702f3ec1 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.134020 10697 tablet_replica.cc:333] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.136152 10697 raft_consensus.cc:2243] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.137969 10697 raft_consensus.cc:2272] T be722abe8c2249e0862fd29352eed5da P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.141086 10697 tablet_replica.cc:333] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
W20260709 12:12:59.142429 12577 consensus_peers.cc:597] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.143373 10697 raft_consensus.cc:2243] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.144244 10697 raft_consensus.cc:2272] T f4f2784828ee4269bb9bb741533de573 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.149569 10697 tablet_replica.cc:333] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.152181 10697 raft_consensus.cc:2243] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.154131 10697 raft_consensus.cc:2272] T 6e6c59801bf644679a9e155c914bbc97 P 46f08e8ff3774f25acad18252e5cd57d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.157187 10697 tablet_replica.cc:333] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.158145 10697 raft_consensus.cc:2243] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.159322 10697 raft_consensus.cc:2272] T c21839ab34e84260a341ab0c1eeab564 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.162000 10697 tablet_replica.cc:333] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.162945 10697 raft_consensus.cc:2243] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.165874 10697 pending_rounds.cc:70] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Trying to abort 1 pending ops.
I20260709 12:12:59.166236 10697 pending_rounds.cc:77] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305622204115779584 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "198dd765f8a54a299a0558eccc0f684f" old_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } } }
I20260709 12:12:59.167491 10697 raft_consensus.cc:2917] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Aborting config change with OpId 19.14: Aborted: Op aborted
I20260709 12:12:59.169106 10697 raft_consensus.cc:2889] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:12:59.169621 10697 raft_consensus.cc:2272] T 198dd765f8a54a299a0558eccc0f684f P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.174080 10697 tablet_replica.cc:333] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.175153 10697 raft_consensus.cc:2243] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.177301 10697 raft_consensus.cc:2272] T c3402a9e1fa24f56be441155ae895d98 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.180707 10697 tablet_replica.cc:333] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.182593 19358 raft_consensus.cc:493] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:12:59.181828 10697 raft_consensus.cc:2243] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.183151 19358 raft_consensus.cc:515] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:12:59.183732 10697 raft_consensus.cc:2272] T 3e361e6345864efa81f207f2a9dafda0 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.185818 19358 leader_election.cc:290] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
I20260709 12:12:59.187350 10697 tablet_replica.cc:333] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.188443 10697 raft_consensus.cc:2243] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.190464 10697 raft_consensus.cc:2272] T 628666a2024d4a61831835e7dee5737a P 46f08e8ff3774f25acad18252e5cd57d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.193914 10697 tablet_replica.cc:333] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.196269 10697 raft_consensus.cc:2243] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.203091 10697 raft_consensus.cc:2272] T 246d42c8e70c46dca72a4d8848a218d7 P 46f08e8ff3774f25acad18252e5cd57d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.206923 10697 tablet_replica.cc:333] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.208645 10697 raft_consensus.cc:2243] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.209589 10697 raft_consensus.cc:2272] T 7ee46b14be8c4a1a99faf37e6697390a P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.213150 10697 tablet_replica.cc:333] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.214579 10697 raft_consensus.cc:2243] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.216411 10697 raft_consensus.cc:2272] T b6b73f446b5a4a9891731cc5f2c0877f P 46f08e8ff3774f25acad18252e5cd57d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.220122 10697 tablet_replica.cc:333] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.221158 10697 raft_consensus.cc:2243] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.222748 10697 raft_consensus.cc:2272] T 7f4f6fbe75cb413188e56f5338fb4c05 P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.225983 10697 tablet_replica.cc:333] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.226920 10697 raft_consensus.cc:2243] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.227972 10697 raft_consensus.cc:2272] T f35e2d3e5b034ad6adcc494a92b92886 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:59.230782 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:12:59.230854 10697 tablet_replica.cc:333] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.232386 10697 raft_consensus.cc:2243] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.233083 10697 raft_consensus.cc:2272] T b76f90dd7ad649d99cfdaddca2c38694 P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.236250 10697 tablet_replica.cc:333] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
W20260709 12:12:59.236840 12577 leader_election.cc:336] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:12:59.238386 10697 raft_consensus.cc:2243] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.238504 12577 leader_election.cc:304] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:12:59.239661 19358 raft_consensus.cc:2749] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:59.239316 10697 raft_consensus.cc:2272] T 54f6b4dc8b6a484da6aa10c1562ab511 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.244607 10697 tablet_replica.cc:333] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.246446 10697 raft_consensus.cc:2243] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:59.247056 12577 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.247797 10697 raft_consensus.cc:2272] T f31959fa0f994ee8a9587eb78cb124b3 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.251178 10697 tablet_replica.cc:333] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
W20260709 12:12:59.251507 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:59.252045 10697 raft_consensus.cc:2243] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:59.252569 12577 consensus_peers.cc:597] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.252779 10697 raft_consensus.cc:2272] T 2c70a3c0cc664c8cb6b298c2c4ab5441 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.256870 10697 tablet_replica.cc:333] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.258033 10697 raft_consensus.cc:2243] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.259104 10697 raft_consensus.cc:2272] T a431e9f3bc6146ccbaa801baac0eeb37 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.261822 10697 tablet_replica.cc:333] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.262452 10697 raft_consensus.cc:2243] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.263079 10697 raft_consensus.cc:2272] T 99ffb9377dca4ebd94a32fd00a581fb5 P 46f08e8ff3774f25acad18252e5cd57d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.266222 10697 tablet_replica.cc:333] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.267040 10697 raft_consensus.cc:2243] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.268366 10697 raft_consensus.cc:2272] T bf27a0b964974f51bc07dec427f3a190 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.272645 10697 tablet_replica.cc:333] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.273481 10697 raft_consensus.cc:2243] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.274869 10697 raft_consensus.cc:2272] T 72e0c467da954999a14a9ba2a9af25b9 P 46f08e8ff3774f25acad18252e5cd57d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.278137 10697 tablet_replica.cc:333] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.278995 10697 raft_consensus.cc:2243] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.280704 10697 raft_consensus.cc:2272] T 1867813aeb8b457984895a6ccb759346 P 46f08e8ff3774f25acad18252e5cd57d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.284356 10697 tablet_replica.cc:333] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.285169 10697 raft_consensus.cc:2243] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.286141 10697 raft_consensus.cc:2272] T c0a71dd6e2e74227b7e93c1026aa2e8d P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.289458 10697 tablet_replica.cc:333] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.290338 10697 raft_consensus.cc:2243] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.291404 10697 raft_consensus.cc:2272] T eb3e790dfc8a4be2938233d59465f7b8 P 46f08e8ff3774f25acad18252e5cd57d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.294520 10697 tablet_replica.cc:333] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.295290 10697 raft_consensus.cc:2243] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.296494 10697 raft_consensus.cc:2272] T 854cd8d1c97d4fff9b7c0600dd83259b P 46f08e8ff3774f25acad18252e5cd57d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.299985 10697 tablet_replica.cc:333] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.300563 10697 raft_consensus.cc:2243] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:59.301679 10697 pending_rounds.cc:70] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Trying to abort 1 pending ops.
I20260709 12:12:59.302016 10697 pending_rounds.cc:77] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d: Aborting op as it isn't in flight: id { term: 19 index: 10 } timestamp: 7305622193218920448 op_type: NO_OP noop_request { }
I20260709 12:12:59.302362 10697 raft_consensus.cc:2889] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:59.302796 10697 raft_consensus.cc:2272] T 6ed1e68af58741ceb833c997cabb45a3 P 46f08e8ff3774f25acad18252e5cd57d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.305233 10697 tablet_replica.cc:333] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d: stopping tablet replica
I20260709 12:12:59.305922 10697 raft_consensus.cc:2243] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.306488 10697 raft_consensus.cc:2272] T 1ae562d279c44236883cb0e50643fa9c P 46f08e8ff3774f25acad18252e5cd57d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:59.327663 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:59.380620 12577 consensus_peers.cc:597] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.454567 12632 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9aa0 after lost signal to thread 10700
W20260709 12:12:59.456027 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800370ea0 after lost signal to thread 11805
W20260709 12:12:59.458885 12632 debug-util.cc:398] Leaking SignalData structure 0x7b0800271340 after lost signal to thread 12635
W20260709 12:12:59.459379 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.526115 12577 consensus_peers.cc:597] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:59.528532 12577 consensus_peers.cc:597] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.629607 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.746058 12577 consensus_peers.cc:597] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:59.835438 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.931128 12577 consensus_peers.cc:597] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:59.931871 12577 consensus_peers.cc:597] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:00.045069 12577 consensus_peers.cc:597] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:00.046031 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:00.074515 12577 consensus_peers.cc:597] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:00.112061 12577 consensus_peers.cc:597] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:00.141412 19358 raft_consensus.cc:493] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.142084 19358 raft_consensus.cc:515] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.144222 19358 leader_election.cc:290] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.154304 12577 leader_election.cc:336] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.155138 12577 leader_election.cc:336] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.155566 12577 leader_election.cc:304] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.156387 19358 raft_consensus.cc:2749] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:00.236131 19358 raft_consensus.cc:493] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.236678 19358 raft_consensus.cc:515] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.238682 19358 leader_election.cc:290] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.249272 12577 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.250144 12577 leader_election.cc:336] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.250617 12577 leader_election.cc:304] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.251504 19358 raft_consensus.cc:2749] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:00.260440 19358 raft_consensus.cc:493] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.261106 19358 raft_consensus.cc:515] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.263718 19358 leader_election.cc:290] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:13:00.272998 19394 raft_consensus.cc:493] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.273797 19394 raft_consensus.cc:515] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.276026 19394 leader_election.cc:290] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.287061 12577 leader_election.cc:336] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.289186 12577 leader_election.cc:336] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:13:00.289819 12577 leader_election.cc:304] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.292863 19394 raft_consensus.cc:2749] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:00.294436 12577 leader_election.cc:336] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
W20260709 12:13:00.318095 12577 leader_election.cc:336] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.319077 19394 raft_consensus.cc:493] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.319660 19394 raft_consensus.cc:515] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.322109 19394 leader_election.cc:290] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.325685 12577 leader_election.cc:336] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:13:00.326309 12577 leader_election.cc:304] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.327109 19394 raft_consensus.cc:2749] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:00.339278 19394 raft_consensus.cc:493] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.339872 19394 raft_consensus.cc:515] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.342216 19394 leader_election.cc:290] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.356396 12577 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:13:00.358179 19394 raft_consensus.cc:493] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.358781 19394 raft_consensus.cc:515] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.360927 19394 leader_election.cc:290] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:13:00.364660 19394 raft_consensus.cc:493] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:13:00.365257 19394 raft_consensus.cc:515] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.369159 19394 leader_election.cc:290] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:13:00.369859 12577 leader_election.cc:336] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.370405 12577 leader_election.cc:304] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.371224 19394 raft_consensus.cc:2749] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:00.388309 12577 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.389426 12577 leader_election.cc:336] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.389931 12577 leader_election.cc:304] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.392479 19394 raft_consensus.cc:2749] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:00.397564 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:13:00.408815 12577 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.409631 12577 leader_election.cc:336] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:13:00.410068 12577 leader_election.cc:304] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.410866 19394 raft_consensus.cc:2749] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:00.412250 12577 leader_election.cc:336] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.412727 12577 leader_election.cc:304] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.413507 19394 raft_consensus.cc:2749] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:00.430588 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:00.473780 19358 raft_consensus.cc:493] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.474417 19358 raft_consensus.cc:515] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.476411 19358 leader_election.cc:290] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:13:00.476837 19358 raft_consensus.cc:493] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.477309 19358 raft_consensus.cc:515] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.480237 19358 leader_election.cc:290] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.502296 12577 leader_election.cc:336] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:13:00.504293 12577 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:13:00.505118 12577 leader_election.cc:336] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.505573 12577 leader_election.cc:304] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.507880 19358 raft_consensus.cc:2749] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:00.508996 12577 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.509469 12577 leader_election.cc:304] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.510249 19358 raft_consensus.cc:2749] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:00.512554 12577 leader_election.cc:336] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:13:00.515538 19358 raft_consensus.cc:493] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.516095 19358 raft_consensus.cc:515] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.522308 19358 leader_election.cc:290] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
I20260709 12:13:00.525627 19358 raft_consensus.cc:493] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.526161 19358 raft_consensus.cc:515] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.528015 19358 leader_election.cc:290] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.550336 12577 consensus_peers.cc:597] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:00.555841 12577 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
W20260709 12:13:00.560998 12577 leader_election.cc:336] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.561645 12577 leader_election.cc:304] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.562474 19358 raft_consensus.cc:2749] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:00.563635 12577 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
W20260709 12:13:00.567440 12577 leader_election.cc:336] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:13:00.567983 12577 leader_election.cc:304] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.568783 19358 raft_consensus.cc:2749] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.605070 19358 raft_consensus.cc:493] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 46f08e8ff3774f25acad18252e5cd57d)
I20260709 12:13:00.605716 19358 raft_consensus.cc:515] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.607833 19358 leader_election.cc:290] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161)
W20260709 12:13:00.617494 12577 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.618382 12577 leader_election.cc:336] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111)
I20260709 12:13:00.618839 12577 leader_election.cc:304] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 46f08e8ff3774f25acad18252e5cd57d, 4d7b7ec0a2604d808698037dbd6fa1ef
I20260709 12:13:00.619632 19358 raft_consensus.cc:2749] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:00.713282 19358 raft_consensus.cc:493] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b7d9b5a12ef4a6cb097df86b95e5bfa)
I20260709 12:13:00.713951 19358 raft_consensus.cc:515] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } }
I20260709 12:13:00.716210 19358 leader_election.cc:290] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113), 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949)
W20260709 12:13:00.731467 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
W20260709 12:13:00.734365 12577 leader_election.cc:336] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111)
I20260709 12:13:00.736428 12577 leader_election.cc:304] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 189a165e6619406382914fe3075dd436; no voters: 4d7b7ec0a2604d808698037dbd6fa1ef, 6b7d9b5a12ef4a6cb097df86b95e5bfa
I20260709 12:13:00.737334 19358 raft_consensus.cc:2749] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:00.744414 12577 consensus_peers.cc:597] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:00.781968 12577 consensus_peers.cc:597] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:00.801041 12577 consensus_peers.cc:597] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 -> Peer 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): Couldn't send request to peer 4d7b7ec0a2604d808698037dbd6fa1ef. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:00.884895 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
W20260709 12:13:00.886888 12577 consensus_peers.cc:597] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 -> Peer 6b7d9b5a12ef4a6cb097df86b95e5bfa (127.10.114.66:45949): Couldn't send request to peer 6b7d9b5a12ef4a6cb097df86b95e5bfa. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:45949: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:01.046151 10697 tablet_server.cc:179] TabletServer@127.10.114.68:0 shutting down...
I20260709 12:13:01.120491 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:01.121524 10697 tablet_replica.cc:333] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.122639 10697 raft_consensus.cc:2243] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.123286 10697 pending_rounds.cc:70] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Trying to abort 1 pending ops.
I20260709 12:13:01.123576 10697 pending_rounds.cc:77] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305622204115779584 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "198dd765f8a54a299a0558eccc0f684f" old_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } attrs { replace: true } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } } }
I20260709 12:13:01.124802 10697 raft_consensus.cc:2917] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Aborting config change with OpId 19.14: Aborted: Op aborted
I20260709 12:13:01.125277 10697 raft_consensus.cc:2889] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:01.125684 10697 raft_consensus.cc:2272] T 198dd765f8a54a299a0558eccc0f684f P 189a165e6619406382914fe3075dd436 [term 19 LEARNER]: Raft consensus is shut down!
I20260709 12:13:01.129379 10697 tablet_replica.cc:333] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.130589 10697 raft_consensus.cc:2243] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.131631 10697 raft_consensus.cc:2272] T 854cd8d1c97d4fff9b7c0600dd83259b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.135273 10697 tablet_replica.cc:333] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.136219 10697 raft_consensus.cc:2243] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.137126 10697 raft_consensus.cc:2272] T b1bb8ee4e7b34277ac74a869a9f66f97 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.140419 10697 tablet_replica.cc:333] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.141291 10697 raft_consensus.cc:2243] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.141825 10697 pending_rounds.cc:70] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Trying to abort 1 pending ops.
I20260709 12:13:01.142045 10697 pending_rounds.cc:77] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305622207015321600 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "0cb26c79d86d449786430b604fee9561" old_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: NON_VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: true } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "4d7b7ec0a2604d808698037dbd6fa1ef" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 39113 } } peers { permanent_uuid: "6b7d9b5a12ef4a6cb097df86b95e5bfa" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45949 } attrs { replace: true } } peers { permanent_uuid: "46f08e8ff3774f25acad18252e5cd57d" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 37161 } } peers { permanent_uuid: "189a165e6619406382914fe3075dd436" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 39553 } attrs { promote: false } } } }
I20260709 12:13:01.143229 10697 raft_consensus.cc:2917] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Aborting config change with OpId 18.14: Aborted: Op aborted
I20260709 12:13:01.143615 10697 raft_consensus.cc:2889] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:01.143956 10697 raft_consensus.cc:2272] T 0cb26c79d86d449786430b604fee9561 P 189a165e6619406382914fe3075dd436 [term 18 LEARNER]: Raft consensus is shut down!
I20260709 12:13:01.147166 10697 tablet_replica.cc:333] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.148204 10697 raft_consensus.cc:2243] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.148917 10697 raft_consensus.cc:2272] T efa456bf4db9474f84e2e5a51c919032 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.152163 10697 tablet_replica.cc:333] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.153031 10697 raft_consensus.cc:2243] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.154336 10697 raft_consensus.cc:2272] T ecd86af74b304d58a84939321319d52b P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.157573 10697 tablet_replica.cc:333] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.158535 10697 raft_consensus.cc:2243] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.159772 10697 raft_consensus.cc:2272] T e3e68fbb001a46d6af7bd0fc3e94e9ec P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.162837 10697 tablet_replica.cc:333] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.163756 10697 raft_consensus.cc:2243] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.165758 10697 raft_consensus.cc:2272] T 6dded4de56124928b0b4c23213e34af4 P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.168149 10697 tablet_replica.cc:333] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.168829 10697 raft_consensus.cc:2243] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.169912 10697 raft_consensus.cc:2272] T 1ae562d279c44236883cb0e50643fa9c P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.172274 10697 tablet_replica.cc:333] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.172901 10697 raft_consensus.cc:2243] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.173849 10697 raft_consensus.cc:2272] T 3e361e6345864efa81f207f2a9dafda0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.176208 10697 tablet_replica.cc:333] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.176841 10697 raft_consensus.cc:2243] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.177866 10697 raft_consensus.cc:2272] T b93a2cf326204d8e89e4fe76ead348c5 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.180419 10697 tablet_replica.cc:333] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.181156 10697 raft_consensus.cc:2243] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.181944 10697 raft_consensus.cc:2272] T 7f4f6fbe75cb413188e56f5338fb4c05 P 189a165e6619406382914fe3075dd436 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.184504 10697 tablet_replica.cc:333] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.185195 10697 raft_consensus.cc:2243] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.186443 10697 raft_consensus.cc:2272] T 72e0c467da954999a14a9ba2a9af25b9 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.189181 10697 tablet_replica.cc:333] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.189968 10697 raft_consensus.cc:2243] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.191004 10697 raft_consensus.cc:2272] T 005405ff7b534db6b4c6be122c445915 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.193421 10697 tablet_replica.cc:333] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.194083 10697 raft_consensus.cc:2243] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.195094 10697 raft_consensus.cc:2272] T b76f90dd7ad649d99cfdaddca2c38694 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.197289 10697 tablet_replica.cc:333] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.197893 10697 raft_consensus.cc:2243] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.198578 10697 raft_consensus.cc:2272] T b00e47b0acb44843a177246087e87ffd P 189a165e6619406382914fe3075dd436 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.201001 10697 tablet_replica.cc:333] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.201650 10697 raft_consensus.cc:2243] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.202164 10697 raft_consensus.cc:2272] T 246d42c8e70c46dca72a4d8848a218d7 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.204520 10697 tablet_replica.cc:333] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.205483 10697 raft_consensus.cc:2243] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.206885 10697 raft_consensus.cc:2272] T f35e2d3e5b034ad6adcc494a92b92886 P 189a165e6619406382914fe3075dd436 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.209836 10697 tablet_replica.cc:333] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.210758 10697 raft_consensus.cc:2243] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.211656 10697 raft_consensus.cc:2272] T d10ddce6896a49a8a2a9ec09702f3ec1 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.214782 10697 tablet_replica.cc:333] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.215538 10697 raft_consensus.cc:2243] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.217391 10697 raft_consensus.cc:2272] T f4f2784828ee4269bb9bb741533de573 P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:01.218149 12577 consensus_peers.cc:597] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 -> Peer 46f08e8ff3774f25acad18252e5cd57d (127.10.114.67:37161): Couldn't send request to peer 46f08e8ff3774f25acad18252e5cd57d. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.67:37161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:01.220085 10697 tablet_replica.cc:333] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.220793 10697 raft_consensus.cc:2243] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.221355 10697 raft_consensus.cc:2272] T f845a1dd30e04dccb21da2a17ebf1415 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.223672 10697 tablet_replica.cc:333] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.224442 10697 raft_consensus.cc:2243] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.225423 10697 raft_consensus.cc:2272] T e4f11d66c6904b2bb34a6291c444fbcd P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.227599 10697 tablet_replica.cc:333] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.228197 10697 raft_consensus.cc:2243] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.229110 10697 raft_consensus.cc:2272] T c0a71dd6e2e74227b7e93c1026aa2e8d P 189a165e6619406382914fe3075dd436 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.231158 10697 tablet_replica.cc:333] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.231763 10697 raft_consensus.cc:2243] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.232671 10697 raft_consensus.cc:2272] T eb3e790dfc8a4be2938233d59465f7b8 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.234804 10697 tablet_replica.cc:333] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.235363 10697 raft_consensus.cc:2243] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.236316 10697 raft_consensus.cc:2272] T 0bace639158f425898b2859f751fc2cd P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.238658 10697 tablet_replica.cc:333] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.239243 10697 raft_consensus.cc:2243] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.240109 10697 raft_consensus.cc:2272] T a1d0a2103114406e9d43b045cd4acfe0 P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.242233 10697 tablet_replica.cc:333] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.242817 10697 raft_consensus.cc:2243] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:01.243692 10697 raft_consensus.cc:2272] T 8bcc1200587447cb913298cc7ed8c931 P 189a165e6619406382914fe3075dd436 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.245887 10697 tablet_replica.cc:333] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.246495 10697 raft_consensus.cc:2243] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.247202 10697 raft_consensus.cc:2272] T cbba5e6f295144a79461c5afc2e273ae P 189a165e6619406382914fe3075dd436 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.249446 10697 tablet_replica.cc:333] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.250078 10697 raft_consensus.cc:2243] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.250619 10697 raft_consensus.cc:2272] T bf27a0b964974f51bc07dec427f3a190 P 189a165e6619406382914fe3075dd436 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.252688 10697 tablet_replica.cc:333] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.253324 10697 raft_consensus.cc:2243] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.253846 10697 raft_consensus.cc:2272] T 3cd3b75a5fa040ba872559d73e67a565 P 189a165e6619406382914fe3075dd436 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.255995 10697 tablet_replica.cc:333] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.256634 10697 raft_consensus.cc:2243] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.257349 10697 raft_consensus.cc:2272] T 0feb55752b27445c8dee19903f9e6d41 P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.259904 10697 tablet_replica.cc:333] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.260470 10697 raft_consensus.cc:2243] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.261009 10697 raft_consensus.cc:2272] T eba16e46f4d34fb7a53a7a797485a99c P 189a165e6619406382914fe3075dd436 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.263047 10697 tablet_replica.cc:333] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.263597 10697 raft_consensus.cc:2243] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.264148 10697 raft_consensus.cc:2272] T be722abe8c2249e0862fd29352eed5da P 189a165e6619406382914fe3075dd436 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.266417 10697 tablet_replica.cc:333] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.266940 10697 raft_consensus.cc:2243] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.267488 10697 raft_consensus.cc:2272] T 6a334a018a5045c29f59fb1e4e5119ae P 189a165e6619406382914fe3075dd436 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.269523 10697 tablet_replica.cc:333] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436: stopping tablet replica
I20260709 12:13:01.270087 10697 raft_consensus.cc:2243] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.270619 10697 raft_consensus.cc:2272] T b2c1fe07352d4472a01fce46f98ce1a6 P 189a165e6619406382914fe3075dd436 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.756901 10697 tablet_server.cc:196] TabletServer@127.10.114.68:0 shutdown complete.
I20260709 12:13:01.837513 10697 master.cc:562] Master@127.10.114.126:46571 shutting down...
W20260709 12:13:01.893190 11819 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:13:01.893625 11819 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:01.893875 11819 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:04.351392 11758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111) [suppressed 331 similar messages]
W20260709 12:13:04.355402 11758 catalog_manager.cc:4755] TS 4d7b7ec0a2604d808698037dbd6fa1ef (127.10.114.65:39113): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7f4f6fbe75cb413188e56f5338fb4c05: Network error: Client connection negotiation failed: client connection to 127.10.114.65:39113: connect: Connection refused (error 111)
I20260709 12:13:04.778424 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.779762 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.780273 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5830ee4e61e44665868e20af26f32046: stopping tablet replica
I20260709 12:13:05.002452 10697 master.cc:584] Master@127.10.114.126:46571 shutdown complete.
I20260709 12:13:05.067373 10697 test_util.cc:182] -----------------------------------------------
I20260709 12:13:05.067651 10697 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894049046-10697-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (230463 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:13:05.071899 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:40525
I20260709 12:13:05.073211 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.079865 19399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.079942 19400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.080885 19402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.081887 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:05.085366 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.085681 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.085866 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599185085831 us; error 0 us; skew 500 ppm
I20260709 12:13:05.086529 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.089465 10697 webserver.cc:533] Webserver started at http://127.10.114.126:43709/ using document root <none> and password file <none>
I20260709 12:13:05.090160 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.090359 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.090698 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.092170 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "9e8bcb5182084eb8bb15313c92b4db2c"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.097249 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:13:05.101380 19407 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.102375 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:05.102742 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "9e8bcb5182084eb8bb15313c92b4db2c"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.103098 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.113703 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.115248 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.162644 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:40525
I20260709 12:13:05.162760 19458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:40525 every 8 connection(s)
I20260709 12:13:05.167443 19459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:05.180181 19459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Bootstrap starting.
I20260709 12:13:05.186113 19459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.191311 19459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: No bootstrap required, opened a new log
I20260709 12:13:05.194425 19459 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER }
I20260709 12:13:05.194926 19459 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.195113 19459 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8bcb5182084eb8bb15313c92b4db2c, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.195681 19459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER }
I20260709 12:13:05.196134 19459 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:05.196349 19459 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:05.196580 19459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.202369 19459 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER }
I20260709 12:13:05.202945 19459 leader_election.cc:304] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e8bcb5182084eb8bb15313c92b4db2c; no voters: 
I20260709 12:13:05.204456 19459 leader_election.cc:290] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:05.205057 19462 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.209555 19459 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:05.209439 19462 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 1 LEADER]: Becoming Leader. State: Replica: 9e8bcb5182084eb8bb15313c92b4db2c, State: Running, Role: LEADER
I20260709 12:13:05.210659 19462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER }
I20260709 12:13:05.218164 19464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e8bcb5182084eb8bb15313c92b4db2c. Latest consensus state: current_term: 1 leader_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER } }
I20260709 12:13:05.218357 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8bcb5182084eb8bb15313c92b4db2c" member_type: VOTER } }
I20260709 12:13:05.219081 19464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:05.219101 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:05.227149 19469 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:05.233256 19469 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:05.234575 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:05.244246 19469 catalog_manager.cc:1383] Generated new cluster ID: 1b039578bb2c4cb6856007ff85357ef0
I20260709 12:13:05.244642 19469 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:05.280369 19469 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:05.282094 19469 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:05.295284 19469 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Generated new TSK 0
I20260709 12:13:05.296067 19469 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:05.301788 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.309553 19480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.310357 19481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.313431 19483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.314041 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:05.316944 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.317207 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.317394 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599185317363 us; error 0 us; skew 500 ppm
I20260709 12:13:05.318041 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.320895 10697 webserver.cc:533] Webserver started at http://127.10.114.65:33695/ using document root <none> and password file <none>
I20260709 12:13:05.321441 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.321718 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.322016 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.323423 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "572e5980055c424db2e88348b978bd27"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.329000 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:05.333431 19488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.335212 10697 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:05.335511 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "572e5980055c424db2e88348b978bd27"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.335809 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.362530 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.364100 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.365888 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.368911 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.369113 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.369467 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.369678 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:13:05.419533 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:46269
I20260709 12:13:05.419641 19550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:46269 every 8 connection(s)
I20260709 12:13:05.425848 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.435169 19555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.435683 19556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.439071 19558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.441483 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:05.442665 19551 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40525
I20260709 12:13:05.443156 19551 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.444176 19551 heartbeater.cc:507] Master 127.10.114.126:40525 requested a full tablet report, sending...
I20260709 12:13:05.444882 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.445159 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.445389 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599185445365 us; error 0 us; skew 500 ppm
I20260709 12:13:05.446168 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.447073 19424 ts_manager.cc:194] Registered new tserver with Master: 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:05.449311 10697 webserver.cc:533] Webserver started at http://127.10.114.66:44017/ using document root <none> and password file <none>
I20260709 12:13:05.449958 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.450205 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.450167 19424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39108
I20260709 12:13:05.450781 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.452589 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "3fead653f118481bbe2fd33fc1357863"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.458079 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:05.462342 19563 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.463213 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:05.463614 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "3fead653f118481bbe2fd33fc1357863"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.463954 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.491559 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.493214 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.495078 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.497917 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.498208 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.498479 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.498667 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.548954 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:45319
I20260709 12:13:05.549078 19625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:45319 every 8 connection(s)
I20260709 12:13:05.554867 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.564877 19629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.567893 19630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.569005 10697 server_base.cc:1061] running on GCE node
W20260709 12:13:05.569730 19632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.570976 19626 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40525
I20260709 12:13:05.571362 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:13:05.571458 19626 heartbeater.cc:461] Registering TS with master...
W20260709 12:13:05.571722 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.571949 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599185571930 us; error 0 us; skew 500 ppm
I20260709 12:13:05.572618 19626 heartbeater.cc:507] Master 127.10.114.126:40525 requested a full tablet report, sending...
I20260709 12:13:05.572913 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.575489 19424 ts_manager.cc:194] Registered new tserver with Master: 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:05.576766 10697 webserver.cc:533] Webserver started at http://127.10.114.67:38723/ using document root <none> and password file <none>
I20260709 12:13:05.577598 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.577739 19424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39122
I20260709 12:13:05.577868 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.578372 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.580276 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "4d030f5782db4855b3dc85fc01917a47"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.585726 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:13:05.589869 19637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.590847 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:05.591207 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "4d030f5782db4855b3dc85fc01917a47"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.591621 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.606025 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.607509 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.609010 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.611722 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.611982 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.612238 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.612430 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.661805 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:46579
I20260709 12:13:05.661931 19699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:46579 every 8 connection(s)
I20260709 12:13:05.667794 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.676259 19703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.676489 19704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.680068 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:05.680939 19700 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40525
W20260709 12:13:05.681187 19707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.681370 19700 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.682302 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.682557 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.682502 19700 heartbeater.cc:507] Master 127.10.114.126:40525 requested a full tablet report, sending...
I20260709 12:13:05.682940 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599185682913 us; error 0 us; skew 500 ppm
I20260709 12:13:05.683655 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.685130 19424 ts_manager.cc:194] Registered new tserver with Master: 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:05.686794 10697 webserver.cc:533] Webserver started at http://127.10.114.68:42365/ using document root <none> and password file <none>
I20260709 12:13:05.686805 19424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39130
I20260709 12:13:05.687460 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.687713 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.688019 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.689363 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-3-root/instance:
uuid: "df754e24c604440998ec5ed4153e9925"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.694751 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:13:05.699313 19711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.700460 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:13:05.700846 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
uuid: "df754e24c604440998ec5ed4153e9925"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:05.701220 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.727231 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.728806 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.730676 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.733038 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.733304 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.733626 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.733816 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.781874 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.68:40141
I20260709 12:13:05.781970 19773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.68:40141 every 8 connection(s)
I20260709 12:13:05.797629 19774 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40525
I20260709 12:13:05.798173 19774 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.799127 19774 heartbeater.cc:507] Master 127.10.114.126:40525 requested a full tablet report, sending...
I20260709 12:13:05.801874 19424 ts_manager.cc:194] Registered new tserver with Master: df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:05.803020 10697 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017547048s
I20260709 12:13:05.803720 19424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39136
I20260709 12:13:05.834582 19424 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39140:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:13:06.100670 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac728d3e6f7413194553b8493db9ad8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:06.103050 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac728d3e6f7413194553b8493db9ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.114008 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 1941144d30204ecf9a3dd3587b1d7fce (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:06.116513 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1941144d30204ecf9a3dd3587b1d7fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.127426 19663 tablet_service.cc:1511] Processing CreateTablet for tablet ea6702a791d14f5986fb8d9f62527a1b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:06.130033 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6702a791d14f5986fb8d9f62527a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.144986 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 97e2ee4873a445579d2a95e3cb490114 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:06.147408 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e2ee4873a445579d2a95e3cb490114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.157068 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 925588a0372f4594bbbffa180cc7ab38 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:06.159540 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925588a0372f4594bbbffa180cc7ab38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.167284 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 41f29b5fa12a4b79b10b5115c86d8915 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:06.169111 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f29b5fa12a4b79b10b5115c86d8915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.184482 19659 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa2642f7104207a8efe0e665a3b269 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:06.186864 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa2642f7104207a8efe0e665a3b269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.199478 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 9d159542ccac45e9b41498d3b8d8855e (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:06.201270 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d159542ccac45e9b41498d3b8d8855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.205060 19657 tablet_service.cc:1511] Processing CreateTablet for tablet da5953336e18402bac805e4d1e79cbfc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:06.212229 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5953336e18402bac805e4d1e79cbfc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:06.229686 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:06.238339 19656 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfa19e6ee804f05badf77fafb8aaede (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:06.240144 19794 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:06.240240 19656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfa19e6ee804f05badf77fafb8aaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.244335 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac728d3e6f7413194553b8493db9ad8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:06.246076 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac728d3e6f7413194553b8493db9ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.267712 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb9c640288454589feb69100b7fc08 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:06.269690 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb9c640288454589feb69100b7fc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.278205 19516 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac728d3e6f7413194553b8493db9ad8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:06.280087 19516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac728d3e6f7413194553b8493db9ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.279673 19737 tablet_service.cc:1511] Processing CreateTablet for tablet ea6702a791d14f5986fb8d9f62527a1b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:06.281278 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6702a791d14f5986fb8d9f62527a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.282934 19515 tablet_service.cc:1511] Processing CreateTablet for tablet 1941144d30204ecf9a3dd3587b1d7fce (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:06.284602 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1941144d30204ecf9a3dd3587b1d7fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.284296 19509 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7b8d5106e4679be8e8f50d28f2adc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:06.286929 19514 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb9c640288454589feb69100b7fc08 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:06.288252 19507 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfa19e6ee804f05badf77fafb8aaede (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:06.289561 19513 tablet_service.cc:1511] Processing CreateTablet for tablet 97e2ee4873a445579d2a95e3cb490114 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:06.286929 19508 tablet_service.cc:1511] Processing CreateTablet for tablet 9d159542ccac45e9b41498d3b8d8855e (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:06.282940 19510 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa2642f7104207a8efe0e665a3b269 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:06.291859 19512 tablet_service.cc:1511] Processing CreateTablet for tablet bacfce93aefc4889a06015b277ff1b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:06.294433 19511 tablet_service.cc:1511] Processing CreateTablet for tablet 925588a0372f4594bbbffa180cc7ab38 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:06.296129 19509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7b8d5106e4679be8e8f50d28f2adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.296947 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa2642f7104207a8efe0e665a3b269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.299998 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 8399862a368c4cc485d207717c3e484f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:06.302121 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8399862a368c4cc485d207717c3e484f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.302963 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 85bddd172e9b48829a3a0e923ecf94a7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:06.304545 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bddd172e9b48829a3a0e923ecf94a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.304836 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 925588a0372f4594bbbffa180cc7ab38 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:06.306361 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925588a0372f4594bbbffa180cc7ab38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.306638 19665 tablet_service.cc:1511] Processing CreateTablet for tablet f4dcbe812aef4998990804a1ed2af372 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:06.307924 19664 tablet_service.cc:1511] Processing CreateTablet for tablet b05afddf2c6c406b81d2a504e08b994d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:06.309255 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 41f29b5fa12a4b79b10b5115c86d8915 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:06.308326 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff9f6251ac44db9b2768886ba30f320 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:06.310813 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f29b5fa12a4b79b10b5115c86d8915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.300004 19663 tablet_service.cc:1511] Processing CreateTablet for tablet 13720c08f1984c45a3a13db51fb4b552 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:06.313199 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7b8d5106e4679be8e8f50d28f2adc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:06.314836 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7b8d5106e4679be8e8f50d28f2adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.319048 19732 tablet_service.cc:1511] Processing CreateTablet for tablet 9d159542ccac45e9b41498d3b8d8855e (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:06.320734 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d159542ccac45e9b41498d3b8d8855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.322131 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacfce93aefc4889a06015b277ff1b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.322949 19514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb9c640288454589feb69100b7fc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.324448 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dcbe812aef4998990804a1ed2af372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.301086 19736 tablet_service.cc:1511] Processing CreateTablet for tablet bacfce93aefc4889a06015b277ff1b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:06.350188 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff9f6251ac44db9b2768886ba30f320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.328534 19731 tablet_service.cc:1511] Processing CreateTablet for tablet da5953336e18402bac805e4d1e79cbfc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:06.330070 19730 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca90458485a4134b58207db6d06437c (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:06.333813 19511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925588a0372f4594bbbffa180cc7ab38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.354734 19513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e2ee4873a445579d2a95e3cb490114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.438776 19586 tablet_service.cc:1511] Processing CreateTablet for tablet 41f29b5fa12a4b79b10b5115c86d8915 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:06.439966 19583 tablet_service.cc:1511] Processing CreateTablet for tablet da5953336e18402bac805e4d1e79cbfc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:06.440496 19586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f29b5fa12a4b79b10b5115c86d8915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.355077 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05afddf2c6c406b81d2a504e08b994d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.442951 19583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5953336e18402bac805e4d1e79cbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.444447 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13720c08f1984c45a3a13db51fb4b552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.444295 19584 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7b8d5106e4679be8e8f50d28f2adc (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:06.445865 19584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7b8d5106e4679be8e8f50d28f2adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.423156 19657 tablet_service.cc:1511] Processing CreateTablet for tablet fa021c2a57f94b72b6f4e27aadcb0d94 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:06.418318 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 1941144d30204ecf9a3dd3587b1d7fce (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:06.447055 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa021c2a57f94b72b6f4e27aadcb0d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.447410 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1941144d30204ecf9a3dd3587b1d7fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.450053 19508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d159542ccac45e9b41498d3b8d8855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.431520 19589 tablet_service.cc:1511] Processing CreateTablet for tablet ea6702a791d14f5986fb8d9f62527a1b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:06.433272 19588 tablet_service.cc:1511] Processing CreateTablet for tablet 97e2ee4873a445579d2a95e3cb490114 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:06.430274 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 07a0f8f7464e49748ac20bb80dde66b7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:06.451530 19589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6702a791d14f5986fb8d9f62527a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.452152 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a0f8f7464e49748ac20bb80dde66b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.433851 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 88072bf4089a469889379d666c797134 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:06.442881 19582 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfa19e6ee804f05badf77fafb8aaede (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:06.454319 19551 heartbeater.cc:499] Master 127.10.114.126:40525 was elected leader, sending a full tablet report...
I20260709 12:13:06.455128 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88072bf4089a469889379d666c797134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.455338 19582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfa19e6ee804f05badf77fafb8aaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.428656 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 8aeb9c640288454589feb69100b7fc08 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:06.458849 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aeb9c640288454589feb69100b7fc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.442885 19585 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa2642f7104207a8efe0e665a3b269 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:06.436722 19587 tablet_service.cc:1511] Processing CreateTablet for tablet bacfce93aefc4889a06015b277ff1b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:06.460801 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa2642f7104207a8efe0e665a3b269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.461735 19587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacfce93aefc4889a06015b277ff1b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.465492 19588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e2ee4873a445579d2a95e3cb490114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.466475 19507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfa19e6ee804f05badf77fafb8aaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.467906 19794 tablet_bootstrap.cc:700] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Time spent opening tablet: real 0.125s	user 0.001s	sys 0.001s
I20260709 12:13:06.468884 19794 tablet_bootstrap.cc:654] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.435101 19515 tablet_service.cc:1511] Processing CreateTablet for tablet 13720c08f1984c45a3a13db51fb4b552 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:06.350656 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacfce93aefc4889a06015b277ff1b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.525235 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5953336e18402bac805e4d1e79cbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.530045 19730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca90458485a4134b58207db6d06437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.530295 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13720c08f1984c45a3a13db51fb4b552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.531692 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 41b302db5638420a9a5c34f1a2016ae7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:06.533390 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b302db5638420a9a5c34f1a2016ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.567932 19512 tablet_service.cc:1511] Processing CreateTablet for tablet 85bddd172e9b48829a3a0e923ecf94a7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:06.581357 19626 heartbeater.cc:499] Master 127.10.114.126:40525 was elected leader, sending a full tablet report...
I20260709 12:13:06.582451 19656 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9c0649834fdfb63ddf5de8171790 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:06.584087 19656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9c0649834fdfb63ddf5de8171790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.586633 19659 tablet_service.cc:1511] Processing CreateTablet for tablet f4b761cf2b4a4e1b94d77f416ca88f91 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:06.588141 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b761cf2b4a4e1b94d77f416ca88f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.577749 19795 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:06.580349 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 13720c08f1984c45a3a13db51fb4b552 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:06.604233 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13720c08f1984c45a3a13db51fb4b552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.604465 19794 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:06.605149 19794 ts_tablet_manager.cc:1403] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.365s	user 0.009s	sys 0.005s
I20260709 12:13:06.609225 19794 raft_consensus.cc:359] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:06.610009 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bddd172e9b48829a3a0e923ecf94a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.614086 19794 raft_consensus.cc:385] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.626580 19796 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:06.626017 19794 raft_consensus.cc:740] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.641683 19514 tablet_service.cc:1511] Processing CreateTablet for tablet a29a6ca896c346c288f2435cd3621579 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:06.656311 19514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29a6ca896c346c288f2435cd3621579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.667585 19738 tablet_service.cc:1511] Processing CreateTablet for tablet f4dcbe812aef4998990804a1ed2af372 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:06.670915 19798 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:06.659142 19739 tablet_service.cc:1511] Processing CreateTablet for tablet a29a6ca896c346c288f2435cd3621579 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:06.656950 19794 consensus_queue.cc:260] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:06.651105 19586 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca90458485a4134b58207db6d06437c (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:06.678911 19586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca90458485a4134b58207db6d06437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.680122 19795 tablet_bootstrap.cc:654] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.673134 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff9f6251ac44db9b2768886ba30f320 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:06.682138 19516 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca90458485a4134b58207db6d06437c (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:06.683720 19516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca90458485a4134b58207db6d06437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.682204 19510 tablet_service.cc:1511] Processing CreateTablet for tablet b07ebcb794f547e59406e697d62764da (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:06.687271 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ebcb794f547e59406e697d62764da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.687955 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 8399862a368c4cc485d207717c3e484f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:06.689903 19700 heartbeater.cc:499] Master 127.10.114.126:40525 was elected leader, sending a full tablet report...
I20260709 12:13:06.695391 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dcbe812aef4998990804a1ed2af372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.699786 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 9c322c0a8eff47689b5f8ce4ec0ff377 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:06.705271 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29a6ca896c346c288f2435cd3621579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.708070 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff9f6251ac44db9b2768886ba30f320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.710050 19584 tablet_service.cc:1511] Processing CreateTablet for tablet 8399862a368c4cc485d207717c3e484f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:06.711921 19584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8399862a368c4cc485d207717c3e484f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.731693 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8399862a368c4cc485d207717c3e484f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:06.731997 19409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 53850.2us
I20260709 12:13:06.701527 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c322c0a8eff47689b5f8ce4ec0ff377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.733738 19796 tablet_bootstrap.cc:654] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.699855 19733 tablet_service.cc:1511] Processing CreateTablet for tablet b07ebcb794f547e59406e697d62764da (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:06.755053 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 07a0f8f7464e49748ac20bb80dde66b7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:06.756564 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ebcb794f547e59406e697d62764da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.758806 19732 tablet_service.cc:1511] Processing CreateTablet for tablet f4b761cf2b4a4e1b94d77f416ca88f91 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:06.760301 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b761cf2b4a4e1b94d77f416ca88f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.746243 19799 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.749755 19583 tablet_service.cc:1511] Processing CreateTablet for tablet 85bddd172e9b48829a3a0e923ecf94a7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:06.751374 19736 tablet_service.cc:1511] Processing CreateTablet for tablet fa021c2a57f94b72b6f4e27aadcb0d94 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:06.751778 19794 ts_tablet_manager.cc:1434] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.146s	user 0.010s	sys 0.005s
I20260709 12:13:06.784839 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a0f8f7464e49748ac20bb80dde66b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.786212 19507 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff9f6251ac44db9b2768886ba30f320 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:06.797020 19515 tablet_service.cc:1511] Processing CreateTablet for tablet fa021c2a57f94b72b6f4e27aadcb0d94 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:06.810467 19774 heartbeater.cc:499] Master 127.10.114.126:40525 was elected leader, sending a full tablet report...
I20260709 12:13:06.779748 19799 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:06.811038 19583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bddd172e9b48829a3a0e923ecf94a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.821719 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa021c2a57f94b72b6f4e27aadcb0d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.824105 19663 tablet_service.cc:1511] Processing CreateTablet for tablet af5924755bd54b58b1ffc3f0d229730b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:06.833621 19794 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:06.834653 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa021c2a57f94b72b6f4e27aadcb0d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.837481 19798 tablet_bootstrap.cc:700] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: Time spent opening tablet: real 0.108s	user 0.005s	sys 0.000s
I20260709 12:13:06.838307 19798 tablet_bootstrap.cc:654] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.834260 19508 tablet_service.cc:1511] Processing CreateTablet for tablet b05afddf2c6c406b81d2a504e08b994d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:06.843567 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 868515b0534a4a8abf8679260fa290bd (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:06.847255 19795 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:06.848872 19660 tablet_service.cc:1511] Processing CreateTablet for tablet e853e43f31754497af8a31670524bf48 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:06.849817 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5924755bd54b58b1ffc3f0d229730b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.859382 19588 tablet_service.cc:1511] Processing CreateTablet for tablet f4dcbe812aef4998990804a1ed2af372 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:06.859903 19591 tablet_service.cc:1511] Processing CreateTablet for tablet b05afddf2c6c406b81d2a504e08b994d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:06.861033 19507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff9f6251ac44db9b2768886ba30f320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.870564 19509 tablet_service.cc:1511] Processing CreateTablet for tablet 88072bf4089a469889379d666c797134 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:06.872040 19509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88072bf4089a469889379d666c797134. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:06.864152 19411 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 60057.6us
I20260709 12:13:06.864287 19795 ts_tablet_manager.cc:1403] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.307s	user 0.033s	sys 0.007s
I20260709 12:13:06.864602 19585 tablet_service.cc:1511] Processing CreateTablet for tablet a29a6ca896c346c288f2435cd3621579 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 12:13:06.864928 19409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 58195.4us
I20260709 12:13:06.865830 19799 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:06.883121 19508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05afddf2c6c406b81d2a504e08b994d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.892047 19731 tablet_service.cc:1511] Processing CreateTablet for tablet 41b302db5638420a9a5c34f1a2016ae7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:06.883919 19588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dcbe812aef4998990804a1ed2af372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.928092 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b302db5638420a9a5c34f1a2016ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.918089 19796 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:06.943542 19590 tablet_service.cc:1511] Processing CreateTablet for tablet f4b761cf2b4a4e1b94d77f416ca88f91 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:06.950930 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b761cf2b4a4e1b94d77f416ca88f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.954094 19589 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9c0649834fdfb63ddf5de8171790 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:06.955581 19589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9c0649834fdfb63ddf5de8171790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.949637 19796 ts_tablet_manager.cc:1403] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.326s	user 0.023s	sys 0.027s
I20260709 12:13:06.959123 19664 tablet_service.cc:1511] Processing CreateTablet for tablet d88a723a68914de697e0cfeecbe67feb (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:06.960532 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88a723a68914de697e0cfeecbe67feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.953341 19510 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb173ec27e04352b94a70d12816f13f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:06.905483 19582 tablet_service.cc:1511] Processing CreateTablet for tablet 07a0f8f7464e49748ac20bb80dde66b7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 12:13:06.919239 19701 tablet.cc:2406] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:06.960990 19796 raft_consensus.cc:359] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:06.967226 19796 raft_consensus.cc:385] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.967645 19796 raft_consensus.cc:740] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.965068 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29a6ca896c346c288f2435cd3621579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.963544 19657 tablet_service.cc:1511] Processing CreateTablet for tablet f89165741a8b41d0981531ad0cfb5b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:06.909413 19730 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb173ec27e04352b94a70d12816f13f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:06.970578 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89165741a8b41d0981531ad0cfb5b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.970763 19730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb173ec27e04352b94a70d12816f13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.972116 19794 tablet_bootstrap.cc:654] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.920280 19795 raft_consensus.cc:359] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:06.973918 19795 raft_consensus.cc:385] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.974339 19795 raft_consensus.cc:740] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.974772 19656 tablet_service.cc:1511] Processing CreateTablet for tablet c344a86e8d03425aaead9ea7d59b338a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:06.975494 19795 consensus_queue.cc:260] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:06.976379 19656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c344a86e8d03425aaead9ea7d59b338a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.833312 19511 tablet_service.cc:1511] Processing CreateTablet for tablet 41b302db5638420a9a5c34f1a2016ae7 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:06.966820 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb173ec27e04352b94a70d12816f13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.984335 19511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b302db5638420a9a5c34f1a2016ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.957381 19512 tablet_service.cc:1511] Processing CreateTablet for tablet 66354051e3784a78b453ce8d710d547d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:06.987301 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354051e3784a78b453ce8d710d547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.989905 19796 consensus_queue.cc:260] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:06.992508 19409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 50234.8us
I20260709 12:13:06.985250 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:07.014643 19583 tablet_service.cc:1511] Processing CreateTablet for tablet 88072bf4089a469889379d666c797134 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:07.006765 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e43f31754497af8a31670524bf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.976814 19513 tablet_service.cc:1511] Processing CreateTablet for tablet 9c322c0a8eff47689b5f8ce4ec0ff377 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:07.012878 19584 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb173ec27e04352b94a70d12816f13f (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:07.020661 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868515b0534a4a8abf8679260fa290bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.020766 19513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c322c0a8eff47689b5f8ce4ec0ff377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.022161 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 66354051e3784a78b453ce8d710d547d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:07.022163 19514 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9c0649834fdfb63ddf5de8171790 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:07.025897 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.034402 19587 tablet_service.cc:1511] Processing CreateTablet for tablet b07ebcb794f547e59406e697d62764da (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:07.006178 19582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a0f8f7464e49748ac20bb80dde66b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.045953 19583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88072bf4089a469889379d666c797134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.049932 19584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb173ec27e04352b94a70d12816f13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.052752 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05afddf2c6c406b81d2a504e08b994d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.027673 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354051e3784a78b453ce8d710d547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.064692 19514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9c0649834fdfb63ddf5de8171790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:07.057435 19409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 59867.1us
I20260709 12:13:07.086925 19736 tablet_service.cc:1511] Processing CreateTablet for tablet af5924755bd54b58b1ffc3f0d229730b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:07.089659 19587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ebcb794f547e59406e697d62764da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.100019 19665 tablet_service.cc:1511] Processing CreateTablet for tablet a881b97f3de4486698fd614567764d79 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:07.101238 19511 tablet_service.cc:1511] Processing CreateTablet for tablet 868515b0534a4a8abf8679260fa290bd (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:07.103844 19511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868515b0534a4a8abf8679260fa290bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.110159 19515 tablet_service.cc:1511] Processing CreateTablet for tablet e853e43f31754497af8a31670524bf48 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:07.111770 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e43f31754497af8a31670524bf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.090880 19588 tablet_service.cc:1511] Processing CreateTablet for tablet 66354051e3784a78b453ce8d710d547d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:07.101001 19512 tablet_service.cc:1511] Processing CreateTablet for tablet 8f525b72ac964395b5d6eeb9d9056795 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:07.137220 19798 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:07.143129 19796 ts_tablet_manager.cc:1434] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.185s	user 0.017s	sys 0.009s
I20260709 12:13:07.157678 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a881b97f3de4486698fd614567764d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.122905 19589 tablet_service.cc:1511] Processing CreateTablet for tablet af5924755bd54b58b1ffc3f0d229730b (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:07.160028 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5924755bd54b58b1ffc3f0d229730b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.136171 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:07.063731 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 9c322c0a8eff47689b5f8ce4ec0ff377 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 12:13:07.170508 19641 leader_election.cc:343] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.172166 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c322c0a8eff47689b5f8ce4ec0ff377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.164697 19798 ts_tablet_manager.cc:1403] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.494s	user 0.017s	sys 0.028s
I20260709 12:13:07.146319 19657 tablet_service.cc:1511] Processing CreateTablet for tablet a652f7acae11499b8631edbb9126b6d4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:07.176961 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a652f7acae11499b8631edbb9126b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.128566 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 8f525b72ac964395b5d6eeb9d9056795 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:07.179744 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f525b72ac964395b5d6eeb9d9056795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.135804 19513 tablet_service.cc:1511] Processing CreateTablet for tablet f89165741a8b41d0981531ad0cfb5b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:07.181349 19513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89165741a8b41d0981531ad0cfb5b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.175420 19732 tablet_service.cc:1511] Processing CreateTablet for tablet e853e43f31754497af8a31670524bf48 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:07.185817 19588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354051e3784a78b453ce8d710d547d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.186524 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:07.188601 19640 leader_election.cc:343] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.189165 19640 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:07.190562 19799 raft_consensus.cc:2749] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.190598 19510 tablet_service.cc:1511] Processing CreateTablet for tablet a908ea554d7e491cb92f45b6bea563fe (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:07.192181 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e853e43f31754497af8a31670524bf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.192658 19661 tablet_service.cc:1511] Processing CreateTablet for tablet d5727af21d244c4e9a1553f6cbd29dd4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:07.194252 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5727af21d244c4e9a1553f6cbd29dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.196156 19798 raft_consensus.cc:359] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:07.197074 19798 raft_consensus.cc:385] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.202706 19585 tablet_service.cc:1511] Processing CreateTablet for tablet 868515b0534a4a8abf8679260fa290bd (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:07.196718 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f525b72ac964395b5d6eeb9d9056795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.207751 19731 tablet_service.cc:1511] Processing CreateTablet for tablet a908ea554d7e491cb92f45b6bea563fe (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:07.270659 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a908ea554d7e491cb92f45b6bea563fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.275502 19658 tablet_service.cc:1511] Processing CreateTablet for tablet d555f82bd1764821a44971e502c2f604 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:07.277261 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d555f82bd1764821a44971e502c2f604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.277832 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 56dd21d8f0714b5e9855a7b741f56cf8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:07.279275 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56dd21d8f0714b5e9855a7b741f56cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.275518 19662 tablet_service.cc:1511] Processing CreateTablet for tablet e3e9c841139946a1a52d0c744d8be4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:07.283818 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e9c841139946a1a52d0c744d8be4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.217417 19735 tablet_service.cc:1511] Processing CreateTablet for tablet d88a723a68914de697e0cfeecbe67feb (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:07.219380 19513 tablet_service.cc:1511] Processing CreateTablet for tablet c344a86e8d03425aaead9ea7d59b338a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:07.285068 19513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c344a86e8d03425aaead9ea7d59b338a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.222692 19796 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:07.290735 19730 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:07.292407 19730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.293707 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a908ea554d7e491cb92f45b6bea563fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.222749 19795 ts_tablet_manager.cc:1434] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.341s	user 0.013s	sys 0.005s
I20260709 12:13:07.226475 19582 tablet_service.cc:1511] Processing CreateTablet for tablet 8f525b72ac964395b5d6eeb9d9056795 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:07.228120 19589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5924755bd54b58b1ffc3f0d229730b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.229846 19508 tablet_service.cc:1511] Processing CreateTablet for tablet ea8f0895419f44028178397e52ffe4ed (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:13:07.232975 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:07.299391 19508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8f0895419f44028178397e52ffe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.300820 19582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f525b72ac964395b5d6eeb9d9056795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.150002 19663 tablet_service.cc:1511] Processing CreateTablet for tablet c784ec6891b74c94b92d9c582a90b4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:07.303153 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868515b0534a4a8abf8679260fa290bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.304034 19795 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:07.322710 19507 tablet_service.cc:1511] Processing CreateTablet for tablet d5727af21d244c4e9a1553f6cbd29dd4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:07.324409 19507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5727af21d244c4e9a1553f6cbd29dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.322290 19658 tablet_service.cc:1511] Processing CreateTablet for tablet a344ca7b35de49269ba122ad135ff08d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:07.283847 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 5d765db7288b4a1f86414e48476ffbab (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:07.327052 19739 tablet_service.cc:1511] Processing CreateTablet for tablet a881b97f3de4486698fd614567764d79 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:07.328576 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a881b97f3de4486698fd614567764d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.261001 19514 tablet_service.cc:1511] Processing CreateTablet for tablet a652f7acae11499b8631edbb9126b6d4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:07.262210 19586 tablet_service.cc:1511] Processing CreateTablet for tablet f89165741a8b41d0981531ad0cfb5b20 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:07.245234 19737 tablet_service.cc:1511] Processing CreateTablet for tablet ec016e46aa0b42909cc2783d5a41af25 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:07.334160 19514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a652f7acae11499b8631edbb9126b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.334910 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec016e46aa0b42909cc2783d5a41af25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.263782 19590 tablet_service.cc:1511] Processing CreateTablet for tablet a908ea554d7e491cb92f45b6bea563fe (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:07.336807 19795 tablet_bootstrap.cc:654] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.241015 19656 tablet_service.cc:1511] Processing CreateTablet for tablet 7998edb98a1a43b78e23e41850537ec2 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:07.239288 19798 raft_consensus.cc:740] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.208891 19516 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:07.358533 19516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbdfddcaeb249b0a188ce6aa6240f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.358940 19798 consensus_queue.cc:260] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:07.313783 19796 tablet_bootstrap.cc:654] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.358445 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c784ec6891b74c94b92d9c582a90b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.362710 19656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7998edb98a1a43b78e23e41850537ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.260774 19587 tablet_service.cc:1511] Processing CreateTablet for tablet d88a723a68914de697e0cfeecbe67feb (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:07.330108 19512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 25) took 1035 ms. Trace:
I20260709 12:13:07.332492 19794 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:07.283494 19732 tablet_service.cc:1511] Processing CreateTablet for tablet 56dd21d8f0714b5e9855a7b741f56cf8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:07.334160 19586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89165741a8b41d0981531ad0cfb5b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.368342 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a908ea554d7e491cb92f45b6bea563fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.337917 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88a723a68914de697e0cfeecbe67feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.362710 19660 tablet_service.cc:1511] Processing CreateTablet for tablet fe94d451da2a4b8e976fbbb83fef20c0 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:07.370949 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56dd21d8f0714b5e9855a7b741f56cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.336619 19731 tablet_service.cc:1511] Processing CreateTablet for tablet ea8f0895419f44028178397e52ffe4ed (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:07.338147 19733 tablet_service.cc:1511] Processing CreateTablet for tablet a652f7acae11499b8631edbb9126b6d4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:07.345134 19808 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.378026 19808 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:07.378530 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a652f7acae11499b8631edbb9126b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.381135 19808 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:07.384042 19794 ts_tablet_manager.cc:1403] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.581s	user 0.015s	sys 0.008s
I20260709 12:13:07.400424 19587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88a723a68914de697e0cfeecbe67feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.365805 19512 rpcz_store.cc:276] 0709 12:13:06.294421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.099916 (+805495us) service_pool.cc:224] Handling call
0709 12:13:07.166081 (+ 66165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.169577 (+  3496us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.291109 (+121532us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.329386 (+ 38277us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.330023 (+   637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.403702 19512 tablet_service.cc:1511] Processing CreateTablet for tablet 00dcab19c6084c678008d8f7f05a6247 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:07.405171 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dcab19c6084c678008d8f7f05a6247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.414894 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8f0895419f44028178397e52ffe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.417160 19736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 23) took 1078 ms. Trace:
I20260709 12:13:07.417676 19736 rpcz_store.cc:276] 0709 12:13:06.338349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.085773 (+747424us) service_pool.cc:224] Handling call
0709 12:13:07.091907 (+  6134us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.092021 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.250577 (+158556us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.397166 (+146589us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.417078 (+ 19912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.420079 19736 tablet_service.cc:1511] Processing CreateTablet for tablet c784ec6891b74c94b92d9c582a90b4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:07.422237 19509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 18) took 1138 ms. Trace:
I20260709 12:13:07.422693 19509 rpcz_store.cc:276] 0709 12:13:06.283735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.868151 (+584416us) service_pool.cc:224] Handling call
0709 12:13:06.871507 (+  3356us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:06.871610 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.298627 (+427017us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.390296 (+ 91669us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.422169 (+ 31873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.424948 19509 tablet_service.cc:1511] Processing CreateTablet for tablet 7998edb98a1a43b78e23e41850537ec2 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:07.391803 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a344ca7b35de49269ba122ad135ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.382117 19511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 24) took 1088 ms. Trace:
I20260709 12:13:07.423168 19794 raft_consensus.cc:359] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.421468 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c784ec6891b74c94b92d9c582a90b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.434971 19584 tablet_service.cc:1511] Processing CreateTablet for tablet a881b97f3de4486698fd614567764d79 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:07.410280 19515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 26) took 1115 ms. Trace:
I20260709 12:13:07.428202 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 3762e9a9190d4cc78877b5e3c924edf1 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:07.455672 19794 raft_consensus.cc:385] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.463884 19584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a881b97f3de4486698fd614567764d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.455868 19513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 30) took 1130 ms. Trace:
I20260709 12:13:07.458626 19515 rpcz_store.cc:276] 0709 12:13:06.294831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.109026 (+814195us) service_pool.cc:224] Handling call
0709 12:13:07.111188 (+  2162us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.111308 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.287385 (+176077us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.409634 (+122249us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.410204 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2252}
I20260709 12:13:07.484869 19589 tablet_service.cc:1511] Processing CreateTablet for tablet c344a86e8d03425aaead9ea7d59b338a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:07.464237 19809 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.486541 19515 tablet_service.cc:1511] Processing CreateTablet for tablet d555f82bd1764821a44971e502c2f604 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:07.486439 19809 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:07.459403 19590 tablet_service.cc:1511] Processing CreateTablet for tablet ea8f0895419f44028178397e52ffe4ed (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:07.477046 19795 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:07.482623 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3762e9a9190d4cc78877b5e3c924edf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.482136 19513 rpcz_store.cc:276] 0709 12:13:06.318482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.218368 (+899886us) service_pool.cc:224] Handling call
0709 12:13:07.284562 (+ 66194us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.284662 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.354749 (+ 70087us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.424007 (+ 69258us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.449069 (+ 25062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.499955 19583 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 18) took 1002 ms. Trace:
I20260709 12:13:07.500509 19591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 15) took 1004 ms. Trace:
I20260709 12:13:07.448815 19511 rpcz_store.cc:276] 0709 12:13:06.293997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.098695 (+804698us) service_pool.cc:224] Handling call
0709 12:13:07.103306 (+  4611us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.103425 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.270744 (+167319us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.333373 (+ 62629us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.382040 (+ 48667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9261}
I20260709 12:13:07.502434 19738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 21) took 1167 ms. Trace:
I20260709 12:13:07.502669 19508 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 31) took 1166 ms. Trace:
I20260709 12:13:07.512964 19509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7998edb98a1a43b78e23e41850537ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.503571 19734 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 24) took 1164 ms. Trace:
I20260709 12:13:07.478329 19794 raft_consensus.cc:740] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.523350 19794 consensus_queue.cc:260] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.527752 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe94d451da2a4b8e976fbbb83fef20c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.527271 19582 tablet_service.cc:1511] Processing CreateTablet for tablet c784ec6891b74c94b92d9c582a90b4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:07.529078 19514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 32) took 1189 ms. Trace:
I20260709 12:13:07.530705 19513 tablet_service.cc:1511] Processing CreateTablet for tablet 56dd21d8f0714b5e9855a7b741f56cf8 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:07.532008 19511 tablet_service.cc:1511] Processing CreateTablet for tablet ec016e46aa0b42909cc2783d5a41af25 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:07.533922 19794 ts_tablet_manager.cc:1434] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 12:13:07.535132 19794 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:07.521050 19734 rpcz_store.cc:276] 0709 12:13:06.338706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.127514 (+788808us) service_pool.cc:224] Handling call
0709 12:13:07.179154 (+ 51640us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.179338 (+   184us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.344798 (+165460us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.502903 (+158105us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.503503 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.539887 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 00dcab19c6084c678008d8f7f05a6247 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:07.512583 19583 rpcz_store.cc:276] 0709 12:13:06.497770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.006217 (+508447us) service_pool.cc:224] Handling call
0709 12:13:07.015662 (+  9445us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.015781 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.262403 (+246622us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.499222 (+236819us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.499878 (+   656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5436}
I20260709 12:13:07.545251 19583 tablet_service.cc:1511] Processing CreateTablet for tablet d5727af21d244c4e9a1553f6cbd29dd4 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:07.554033 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d765db7288b4a1f86414e48476ffbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.541417 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dcab19c6084c678008d8f7f05a6247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.559975 19516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 29) took 1250 ms. Trace:
I20260709 12:13:07.517202 19738 rpcz_store.cc:276] 0709 12:13:06.335680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.021012 (+685332us) service_pool.cc:224] Handling call
0709 12:13:07.027110 (+  6098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.027231 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.234305 (+207074us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.501814 (+267509us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.502365 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.546248 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8f0895419f44028178397e52ffe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.504961 19809 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:07.519622 19508 rpcz_store.cc:276] 0709 12:13:06.336594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.228749 (+892155us) service_pool.cc:224] Handling call
0709 12:13:07.298910 (+ 70161us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.299001 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.322777 (+ 23776us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.465672 (+142895us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.502280 (+ 36608us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b58007dc498. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890f1a2 00007f1f21850889 00007f1f20981d88 00007f1f20a48973 00007f1f20a4470f 00007f1f20a44ecd 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82
0709 12:13:07.502603 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4427008}
I20260709 12:13:07.514078 19591 rpcz_store.cc:276] 0709 12:13:06.496510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.858953 (+362443us) service_pool.cc:224] Handling call
0709 12:13:06.999131 (+140178us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b5800004598. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a67831 00007f1f20a44ac3 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82 00007f1f19e789b1
0709 12:13:06.999331 (+   200us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:06.999450 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.261341 (+261891us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.491930 (+230589us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.500434 (+  8504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18045184}
I20260709 12:13:07.570137 19511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec016e46aa0b42909cc2783d5a41af25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.511935 19795 ts_tablet_manager.cc:1403] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.007s
I20260709 12:13:07.595989 19589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c344a86e8d03425aaead9ea7d59b338a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.598666 19735 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 26) took 1259 ms. Trace:
I20260709 12:13:07.599244 19735 rpcz_store.cc:276] 0709 12:13:06.339414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.216303 (+876889us) service_pool.cc:224] Handling call
0709 12:13:07.337375 (+121072us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.337476 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.433081 (+ 95605us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.598121 (+165040us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.598592 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.576175 19732 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 37) took 1152 ms. Trace:
I20260709 12:13:07.576702 19657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 31) took 1031 ms. Trace:
I20260709 12:13:07.579921 19739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 29) took 1159 ms. Trace:
I20260709 12:13:07.580818 19585 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 24) took 1081 ms. Trace:
I20260709 12:13:07.591490 19508 tablet_service.cc:1511] Processing CreateTablet for tablet fe94d451da2a4b8e976fbbb83fef20c0 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:07.590994 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 7998edb98a1a43b78e23e41850537ec2 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:07.595535 19515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d555f82bd1764821a44971e502c2f604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.608805 19794 tablet_bootstrap.cc:654] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.601023 19591 tablet_service.cc:1511] Processing CreateTablet for tablet ec016e46aa0b42909cc2783d5a41af25 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:07.613406 19732 rpcz_store.cc:276] 0709 12:13:06.423663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.282438 (+858775us) service_pool.cc:224] Handling call
0709 12:13:07.367355 (+ 84917us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.367468 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.427801 (+ 60333us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.575502 (+147701us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.576095 (+   593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.585108 19516 rpcz_store.cc:276] 0709 12:13:06.309945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.207753 (+897808us) service_pool.cc:224] Handling call
0709 12:13:07.358007 (+150254us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.358116 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.401190 (+ 43074us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.559195 (+158005us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.559874 (+   679us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.620941 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7998edb98a1a43b78e23e41850537ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.626053 19737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 36) took 1202 ms. Trace:
I20260709 12:13:07.614565 19739 rpcz_store.cc:276] 0709 12:13:06.420779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.325971 (+905192us) service_pool.cc:224] Handling call
0709 12:13:07.328026 (+  2055us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.328134 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.460228 (+132094us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.579347 (+119119us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.579836 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.626588 19732 tablet_service.cc:1511] Processing CreateTablet for tablet 5d765db7288b4a1f86414e48476ffbab (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:07.599556 19795 raft_consensus.cc:359] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.613077 19657 rpcz_store.cc:276] 0709 12:13:06.544879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.145072 (+600193us) service_pool.cc:224] Handling call
0709 12:13:07.176388 (+ 31316us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.176502 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.460150 (+283648us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.537095 (+ 76945us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.576629 (+ 39534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.629667 19739 tablet_service.cc:1511] Processing CreateTablet for tablet dae9718b125b4fa8bffa5181c27d1e55 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:07.626572 19737 rpcz_store.cc:276] 0709 12:13:06.423242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.244205 (+820963us) service_pool.cc:224] Handling call
0709 12:13:07.334378 (+ 90173us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.334497 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.407811 (+ 73314us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.589034 (+181223us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.625978 (+ 36944us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.621616 19733 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 31) took 1200 ms. Trace:
I20260709 12:13:07.629667 19516 tablet_service.cc:1511] Processing CreateTablet for tablet dae9718b125b4fa8bffa5181c27d1e55 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:07.529524 19514 rpcz_store.cc:276] 0709 12:13:06.339891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.253213 (+913322us) service_pool.cc:224] Handling call
0709 12:13:07.333607 (+ 80394us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.333720 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.377061 (+ 43341us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.528475 (+151414us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.529008 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.633342 19795 raft_consensus.cc:385] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.634570 19582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c784ec6891b74c94b92d9c582a90b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.617637 19588 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 22) took 1115 ms. Trace:
I20260709 12:13:07.633668 19733 rpcz_store.cc:276] 0709 12:13:06.421440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.336956 (+915516us) service_pool.cc:224] Handling call
0709 12:13:07.377973 (+ 41017us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.378111 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.498633 (+120522us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.615612 (+116979us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.621510 (+  5898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.635591 19657 tablet_service.cc:1511] Processing CreateTablet for tablet 247f50197bf344b88a8e8bea4eac96af (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:07.647251 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247f50197bf344b88a8e8bea4eac96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.648535 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 247f50197bf344b88a8e8bea4eac96af (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:07.642566 19795 raft_consensus.cc:740] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.651997 19795 consensus_queue.cc:260] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.620790 19735 tablet_service.cc:1511] Processing CreateTablet for tablet e3e9c841139946a1a52d0c744d8be4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:07.655498 19795 ts_tablet_manager.cc:1434] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:13:07.655617 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 3762e9a9190d4cc78877b5e3c924edf1 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:07.657050 19795 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:07.659492 19514 tablet_service.cc:1511] Processing CreateTablet for tablet 3762e9a9190d4cc78877b5e3c924edf1 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:07.663409 19798 ts_tablet_manager.cc:1434] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.471s	user 0.006s	sys 0.018s
I20260709 12:13:07.664685 19798 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:07.664850 19796 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:07.665484 19796 ts_tablet_manager.cc:1403] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.443s	user 0.005s	sys 0.026s
I20260709 12:13:07.599440 19661 tablet_service.cc:1511] Processing CreateTablet for tablet ac84a47779154a7db8a00ff0d0412204 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:07.667186 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac84a47779154a7db8a00ff0d0412204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.673696 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:07.675876 19713 leader_election.cc:343] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.678635 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:07.680475 19715 leader_election.cc:343] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.681017 19715 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:07.614977 19585 rpcz_store.cc:276] 0709 12:13:06.499888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.164696 (+664808us) service_pool.cc:224] Handling call
0709 12:13:07.265904 (+101208us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.266012 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.514459 (+248447us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.580294 (+ 65835us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.580756 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.645303 19588 rpcz_store.cc:276] 0709 12:13:06.499132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.089797 (+590665us) service_pool.cc:224] Handling call
0709 12:13:07.164578 (+ 74781us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.169300 (+  4722us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.277462 (+108162us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.516961 (+239499us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.614774 (+ 97813us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1781}
I20260709 12:13:07.641745 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d765db7288b4a1f86414e48476ffbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.682366 19808 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.683349 19585 tablet_service.cc:1511] Processing CreateTablet for tablet 00dcab19c6084c678008d8f7f05a6247 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:07.683835 19588 tablet_service.cc:1511] Processing CreateTablet for tablet e3e9c841139946a1a52d0c744d8be4ad (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:07.688732 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247f50197bf344b88a8e8bea4eac96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.669066 19796 raft_consensus.cc:359] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:07.690712 19796 raft_consensus.cc:385] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.691742 19796 raft_consensus.cc:740] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.694145 19586 tablet_service.cc:1511] Processing CreateTablet for tablet d555f82bd1764821a44971e502c2f604 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:07.691083 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae9718b125b4fa8bffa5181c27d1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.696241 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e9c841139946a1a52d0c744d8be4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.698515 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3762e9a9190d4cc78877b5e3c924edf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.699859 19513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56dd21d8f0714b5e9855a7b741f56cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.700698 19516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae9718b125b4fa8bffa5181c27d1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.703437 19508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe94d451da2a4b8e976fbbb83fef20c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.706053 19811 raft_consensus.cc:493] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.707175 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec016e46aa0b42909cc2783d5a41af25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.706944 19811 raft_consensus.cc:515] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:07.724417 19583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5727af21d244c4e9a1553f6cbd29dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.734906 19585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dcab19c6084c678008d8f7f05a6247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.725636 19514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3762e9a9190d4cc78877b5e3c924edf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.751190 19586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d555f82bd1764821a44971e502c2f604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.760994 19662 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 35) took 1123 ms. Trace:
I20260709 12:13:07.761781 19662 rpcz_store.cc:276] 0709 12:13:06.638075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.274393 (+636318us) service_pool.cc:224] Handling call
0709 12:13:07.283296 (+  8903us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.283408 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.408161 (+124753us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.744675 (+336514us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.760834 (+ 16159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.764231 19588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e9c841139946a1a52d0c744d8be4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.773797 19796 consensus_queue.cc:260] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:07.811064 19731 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 30) took 1390 ms. Trace:
W20260709 12:13:07.784639 19411 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 86887.8us
I20260709 12:13:07.796862 19510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 28) took 1501 ms. Trace:
I20260709 12:13:07.813689 19731 rpcz_store.cc:276] 0709 12:13:06.421134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.335538 (+914404us) service_pool.cc:224] Handling call
0709 12:13:07.390976 (+ 55438us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.399327 (+  8351us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.488791 (+ 89464us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.810478 (+321687us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.810983 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.814494 19510 rpcz_store.cc:276] 0709 12:13:06.295583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.189476 (+893893us) service_pool.cc:224] Handling call
0709 12:13:07.191608 (+  2132us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.191723 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.495999 (+304276us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.796225 (+300226us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.796783 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.775031 19811 leader_election.cc:290] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:07.804859 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:07.806438 19794 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:07.818498 19794 ts_tablet_manager.cc:1403] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.284s	user 0.005s	sys 0.012s
W20260709 12:13:07.819175 19491 leader_election.cc:343] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.817060 19510 tablet_service.cc:1511] Processing CreateTablet for tablet ac84a47779154a7db8a00ff0d0412204 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:07.821049 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac84a47779154a7db8a00ff0d0412204. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:07.810056 19409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 91403.3us
I20260709 12:13:07.813174 19587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 26) took 1184 ms. Trace:
I20260709 12:13:07.821658 19587 rpcz_store.cc:276] 0709 12:13:06.673862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.259696 (+585834us) service_pool.cc:224] Handling call
0709 12:13:07.366732 (+107036us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.366858 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.535051 (+168193us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.812660 (+277609us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.813106 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.822279 19736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 32) took 1400 ms. Trace:
I20260709 12:13:07.822743 19736 rpcz_store.cc:276] 0709 12:13:06.421836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.418976 (+997140us) service_pool.cc:224] Handling call
0709 12:13:07.420940 (+  1964us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.421040 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.592993 (+171953us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.807166 (+214173us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.822208 (+ 15042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.823374 19734 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 33) took 1401 ms. Trace:
I20260709 12:13:07.824182 19587 tablet_service.cc:1511] Processing CreateTablet for tablet 5d765db7288b4a1f86414e48476ffbab (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:07.824764 19736 tablet_service.cc:1511] Processing CreateTablet for tablet a344ca7b35de49269ba122ad135ff08d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:07.825971 19587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d765db7288b4a1f86414e48476ffbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.823820 19734 rpcz_store.cc:276] 0709 12:13:06.422146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.538793 (+1116647us) service_pool.cc:224] Handling call
0709 12:13:07.540827 (+  2034us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.540951 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.648994 (+108043us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.822796 (+173802us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.823306 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.796993 19663 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 32) took 1186 ms. Trace:
I20260709 12:13:07.847314 19730 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 28) took 1507 ms. Trace:
I20260709 12:13:07.847824 19584 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 29) took 1142 ms. Trace:
I20260709 12:13:07.847886 19730 rpcz_store.cc:276] 0709 12:13:06.340098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.213463 (+873365us) service_pool.cc:224] Handling call
0709 12:13:07.291794 (+ 78331us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.291917 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.572765 (+280848us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.846689 (+273924us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.847233 (+   544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.848393 19584 rpcz_store.cc:276] 0709 12:13:06.705839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.383172 (+677333us) service_pool.cc:224] Handling call
0709 12:13:07.463197 (+ 80025us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.463332 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.577072 (+113740us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.847274 (+270202us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.847758 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.835201 19663 rpcz_store.cc:276] 0709 12:13:06.610842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.148854 (+538012us) service_pool.cc:224] Handling call
0709 12:13:07.303117 (+154263us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.303218 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.627213 (+323995us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.796413 (+169200us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.796920 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.857707 19796 ts_tablet_manager.cc:1434] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.192s	user 0.015s	sys 0.006s
I20260709 12:13:07.858464 19584 tablet_service.cc:1511] Processing CreateTablet for tablet d6697ba38fa643d2829f82139140437a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:07.859035 19796 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:07.859936 19584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6697ba38fa643d2829f82139140437a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.870756 19507 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 33) took 1505 ms. Trace:
I20260709 12:13:07.871035 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:07.871301 19507 rpcz_store.cc:276] 0709 12:13:06.365098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.321772 (+956674us) service_pool.cc:224] Handling call
0709 12:13:07.323824 (+  2052us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.323948 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.781764 (+457816us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.870085 (+ 88321us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.870654 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.872522 19656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 34) took 1242 ms. Trace:
W20260709 12:13:07.873189 19490 leader_election.cc:343] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.873672 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a344ca7b35de49269ba122ad135ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.873811 19490 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:07.874830 19809 raft_consensus.cc:2749] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.875924 19507 tablet_service.cc:1511] Processing CreateTablet for tablet d6697ba38fa643d2829f82139140437a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:07.877640 19507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6697ba38fa643d2829f82139140437a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.879706 19664 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 37) took 1223 ms. Trace:
I20260709 12:13:07.880194 19664 rpcz_store.cc:276] 0709 12:13:06.656010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.276743 (+620733us) service_pool.cc:224] Handling call
0709 12:13:07.278774 (+  2031us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.278889 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.558992 (+280103us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.853361 (+294369us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.879635 (+ 26274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.882496 19794 raft_consensus.cc:359] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:07.883363 19794 raft_consensus.cc:385] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.883700 19794 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.884531 19794 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:07.887825 19795 tablet_bootstrap.cc:654] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.890069 19809 raft_consensus.cc:493] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.872978 19656 rpcz_store.cc:276] 0709 12:13:06.630330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.239936 (+609606us) service_pool.cc:224] Handling call
0709 12:13:07.357304 (+117368us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.357424 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.636408 (+278984us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.871914 (+235506us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.872452 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.893154 19809 raft_consensus.cc:515] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.895898 19809 leader_election.cc:290] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:07.900710 19512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 34) took 1528 ms. Trace:
I20260709 12:13:07.904182 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:07.906723 19490 leader_election.cc:343] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.912578 19511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 37) took 1502 ms. Trace:
I20260709 12:13:07.891620 19738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 34) took 1468 ms. Trace:
I20260709 12:13:07.924243 19799 raft_consensus.cc:493] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.960233 19799 raft_consensus.cc:515] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:07.929840 19589 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 30) took 1194 ms. Trace:
I20260709 12:13:07.961627 19589 rpcz_store.cc:276] 0709 12:13:06.737350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.429288 (+691938us) service_pool.cc:224] Handling call
0709 12:13:07.522618 (+ 93330us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5800004598. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a67831 00007f1f20a44ac3 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82 00007f1f19e789b1
0709 12:13:07.550250 (+ 27632us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.550352 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.879448 (+329096us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.929223 (+ 49775us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.929766 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13115648}
I20260709 12:13:07.963521 19799 leader_election.cc:290] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:07.964146 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:07.964529 19589 tablet_service.cc:1511] Processing CreateTablet for tablet fe94d451da2a4b8e976fbbb83fef20c0 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:07.964964 19526 raft_consensus.cc:2468] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:07.934398 19796 tablet_bootstrap.cc:654] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.966519 19641 leader_election.cc:304] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:07.917826 19511 rpcz_store.cc:276] 0709 12:13:06.410156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.519437 (+1109281us) service_pool.cc:224] Handling call
0709 12:13:07.532840 (+ 13403us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.532942 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.679968 (+147026us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.911842 (+231874us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.912481 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.930168 19731 tablet_service.cc:1511] Processing CreateTablet for tablet d6697ba38fa643d2829f82139140437a (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:07.974511 19589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe94d451da2a4b8e976fbbb83fef20c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.943617 19794 ts_tablet_manager.cc:1434] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 12:13:07.924451 19738 rpcz_store.cc:276] 0709 12:13:06.422495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.589857 (+1167362us) service_pool.cc:224] Handling call
0709 12:13:07.620328 (+ 30471us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.620474 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.679657 (+ 59183us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.850782 (+171125us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.890535 (+ 39753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:07.966544 19798 tablet_bootstrap.cc:654] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.975461 19661 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 42) took 1084 ms. Trace:
I20260709 12:13:07.983861 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6697ba38fa643d2829f82139140437a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.984609 19794 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:07.937156 19659 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 38) took 1280 ms. Trace:
I20260709 12:13:07.972640 19799 raft_consensus.cc:2804] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.901284 19512 rpcz_store.cc:276] 0709 12:13:06.372216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.402630 (+1030414us) service_pool.cc:224] Handling call
0709 12:13:07.404605 (+  1975us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.404722 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.590756 (+186034us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.900105 (+309349us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.900637 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.006083 19511 tablet_service.cc:1511] Processing CreateTablet for tablet a344ca7b35de49269ba122ad135ff08d (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:08.007926 19795 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.008081 19511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a344ca7b35de49269ba122ad135ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.008970 19795 ts_tablet_manager.cc:1403] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.352s	user 0.023s	sys 0.033s
I20260709 12:13:08.012024 19657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50694 (request call id 41) took 1123 ms. Trace:
I20260709 12:13:08.012706 19657 rpcz_store.cc:276] 0709 12:13:06.888277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.630321 (+742044us) service_pool.cc:224] Handling call
0709 12:13:07.646750 (+ 16429us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.646847 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.814099 (+167252us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.972511 (+158412us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.000246 (+ 27735us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b580006f098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890f1a2 00007f1f21850889 00007f1f20981d88 00007f1f20a48973 00007f1f20a4470f 00007f1f20a44ecd 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82
0709 12:13:08.011924 (+ 11678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4856576}
I20260709 12:13:07.992633 19799 raft_consensus.cc:493] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.019297 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.020087 19808 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.034834 19808 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.034987 19795 raft_consensus.cc:359] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.036187 19795 raft_consensus.cc:385] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.989874 19659 rpcz_store.cc:276] 0709 12:13:06.657130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.282880 (+625750us) service_pool.cc:224] Handling call
0709 12:13:07.328978 (+ 46098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.329777 (+   799us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.679819 (+350042us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.936536 (+256717us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.937081 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.030148 19590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 31) took 1269 ms. Trace:
W20260709 12:13:08.044852 19566 leader_election.cc:343] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.042702 19799 raft_consensus.cc:3060] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:08.095450 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 50851.7us
I20260709 12:13:08.046007 19808 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.047902 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.049295 19796 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.098486 19796 ts_tablet_manager.cc:1403] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.011s
I20260709 12:13:08.099095 19515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 36) took 1706 ms. Trace:
I20260709 12:13:08.099578 19515 rpcz_store.cc:276] 0709 12:13:06.392669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.485446 (+1092777us) service_pool.cc:224] Handling call
0709 12:13:07.487462 (+  2016us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.487570 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.046962 (+559392us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.098402 (+ 51440us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.099016 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.036633 19795 raft_consensus.cc:740] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.101797 19795 consensus_queue.cc:260] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.102988 19526 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:08.104635 19795 ts_tablet_manager.cc:1434] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 12:13:07.983486 19661 rpcz_store.cc:276] 0709 12:13:06.889149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.598352 (+709203us) service_pool.cc:224] Handling call
0709 12:13:07.666641 (+ 68289us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.666752 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.885711 (+218959us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.963262 (+ 77551us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:07.973046 (+  9784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.052934 19514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 41) took 1449 ms. Trace:
I20260709 12:13:08.106516 19514 rpcz_store.cc:276] 0709 12:13:06.603453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.658348 (+1054895us) service_pool.cc:224] Handling call
0709 12:13:07.660538 (+  2190us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.660639 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.898170 (+237531us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.052174 (+154004us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.052846 (+   672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.107357 19795 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.109258 19715 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:08.090849 19590 rpcz_store.cc:276] 0709 12:13:06.776842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.454242 (+677400us) service_pool.cc:224] Handling call
0709 12:13:07.501499 (+ 47257us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800004598. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a67831 00007f1f20a44ac3 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82 00007f1f19e789b1
0709 12:13:07.516528 (+ 15029us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.545787 (+ 29259us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.771075 (+225288us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.991856 (+220781us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.030064 (+ 38208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12360576}
I20260709 12:13:08.111389 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:08.110309 19808 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.055604 19588 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 35) took 1199 ms. Trace:
I20260709 12:13:08.082115 19739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 39) took 1561 ms. Trace:
I20260709 12:13:08.113986 19808 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.102159 19796 raft_consensus.cc:359] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.114493 19808 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:08.121573 19565 leader_election.cc:343] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.122231 19565 leader_election.cc:304] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:08.123193 19811 raft_consensus.cc:2749] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.124399 19587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 38) took 1267 ms. Trace:
I20260709 12:13:08.126982 19587 rpcz_store.cc:276] 0709 12:13:06.857285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.822938 (+965653us) service_pool.cc:224] Handling call
0709 12:13:07.825260 (+  2322us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.825446 (+   186us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.014361 (+188915us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.123598 (+109237us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.124327 (+   729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.135389 19587 tablet_service.cc:1511] Processing CreateTablet for tablet dae9718b125b4fa8bffa5181c27d1e55 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:08.137243 19587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae9718b125b4fa8bffa5181c27d1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.142194 19513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 38) took 1719 ms. Trace:
I20260709 12:13:08.114152 19588 rpcz_store.cc:276] 0709 12:13:06.856334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.682759 (+826425us) service_pool.cc:224] Handling call
0709 12:13:07.684771 (+  2012us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.684948 (+   177us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.901225 (+216277us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.054934 (+153709us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.055529 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.142892 19513 rpcz_store.cc:276] 0709 12:13:06.422794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.529677 (+1106883us) service_pool.cc:224] Handling call
0709 12:13:07.531591 (+  1914us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.531697 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.030929 (+499232us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.141357 (+110428us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.142097 (+   740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.145946 19588 tablet_service.cc:1511] Processing CreateTablet for tablet 247f50197bf344b88a8e8bea4eac96af (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:08.147692 19588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247f50197bf344b88a8e8bea4eac96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.126447 19591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 37) took 1269 ms. Trace:
I20260709 12:13:08.148209 19591 rpcz_store.cc:276] 0709 12:13:06.856974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.599890 (+742916us) service_pool.cc:224] Handling call
0709 12:13:07.622958 (+ 23068us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.626631 (+  3673us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.882871 (+256240us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.125852 (+242981us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.126375 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.131429 19590 tablet_service.cc:1511] Processing CreateTablet for tablet ac84a47779154a7db8a00ff0d0412204 (DEFAULT_TABLE table=test-workload [id=aee8ad2553aa4f6b9a5d7b5781806be6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:08.132208 19737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 40) took 1559 ms. Trace:
I20260709 12:13:08.151494 19737 rpcz_store.cc:276] 0709 12:13:06.572856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.654492 (+1081636us) service_pool.cc:224] Handling call
0709 12:13:07.656720 (+  2228us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.656826 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.034991 (+378165us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.131507 (+ 96516us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.132136 (+   629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.114902 19796 raft_consensus.cc:385] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.152554 19732 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 38) took 1718 ms. Trace:
I20260709 12:13:08.152782 19796 raft_consensus.cc:740] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.153982 19796 consensus_queue.cc:260] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.154347 19516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 40) took 1619 ms. Trace:
I20260709 12:13:08.118647 19794 tablet_bootstrap.cc:654] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.155337 19799 raft_consensus.cc:515] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.156566 19516 rpcz_store.cc:276] 0709 12:13:06.535366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.628570 (+1093204us) service_pool.cc:224] Handling call
0709 12:13:07.640507 (+ 11937us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.646398 (+  5891us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.883394 (+236996us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.125321 (+241927us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.154257 (+ 28936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.159166 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac84a47779154a7db8a00ff0d0412204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.092291 19509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 35) took 1689 ms. Trace:
I20260709 12:13:08.137364 19795 tablet_bootstrap.cc:654] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.114312 19739 rpcz_store.cc:276] 0709 12:13:06.520633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.628570 (+1107937us) service_pool.cc:224] Handling call
0709 12:13:07.630590 (+  2020us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.630695 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.870300 (+239605us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:07.994537 (+124237us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.082022 (+ 87485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.162938 19799 leader_election.cc:290] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.153069 19732 rpcz_store.cc:276] 0709 12:13:06.433876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.624930 (+1191054us) service_pool.cc:224] Handling call
0709 12:13:07.629785 (+  4855us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.630486 (+   701us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.947876 (+317390us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.151743 (+203867us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.152484 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.174750 19735 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 35) took 1751 ms. Trace:
I20260709 12:13:08.180825 19735 rpcz_store.cc:276] 0709 12:13:06.422872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.600758 (+1177886us) service_pool.cc:224] Handling call
0709 12:13:07.654145 (+ 53387us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.654259 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.952469 (+298210us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.157887 (+205418us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.174676 (+ 16789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.185209 19584 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 43) took 1273 ms. Trace:
I20260709 12:13:08.185851 19584 rpcz_store.cc:276] 0709 12:13:06.917895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.854367 (+936472us) service_pool.cc:224] Handling call
0709 12:13:07.859386 (+  5019us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.859490 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.096919 (+237429us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.184530 (+ 87611us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.185130 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.191402 19798 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.191401 19736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 43) took 1229 ms. Trace:
I20260709 12:13:08.166209 19509 rpcz_store.cc:276] 0709 12:13:06.380106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.423842 (+1043736us) service_pool.cc:224] Handling call
0709 12:13:07.467872 (+ 44030us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.473164 (+  5292us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.926822 (+453658us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.068827 (+142005us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.069501 (+   674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.198573 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:08.218771 19526 raft_consensus.cc:3060] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.218362 19736 rpcz_store.cc:276] 0709 12:13:06.962075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.823796 (+861721us) service_pool.cc:224] Handling call
0709 12:13:07.836517 (+ 12721us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.851210 (+ 14693us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.050371 (+199161us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.190763 (+140392us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.191327 (+   564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.203284 19798 ts_tablet_manager.cc:1403] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.539s	user 0.026s	sys 0.043s
I20260709 12:13:08.203931 19508 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 39) took 1766 ms. Trace:
I20260709 12:13:08.205099 19796 ts_tablet_manager.cc:1434] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.106s	user 0.018s	sys 0.018s
I20260709 12:13:08.205796 19733 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 41) took 1597 ms. Trace:
I20260709 12:13:08.208122 19586 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 36) took 1351 ms. Trace:
I20260709 12:13:08.230755 19796 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.235821 19808 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.208963 19582 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 32) took 1404 ms. Trace:
I20260709 12:13:08.211942 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.213204 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.213423 19585 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 34) took 1357 ms. Trace:
I20260709 12:13:08.216687 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:08.217818 19510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 42) took 1607 ms. Trace:
I20260709 12:13:08.222640 19508 rpcz_store.cc:276] 0709 12:13:06.437388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.590568 (+1153180us) service_pool.cc:224] Handling call
0709 12:13:07.621799 (+ 31231us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.621907 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.885431 (+263524us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.178952 (+293521us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.203851 (+ 24899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.224221 19733 rpcz_store.cc:276] 0709 12:13:06.608828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.647016 (+1038188us) service_pool.cc:224] Handling call
0709 12:13:07.657815 (+ 10799us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.657955 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.905699 (+247744us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.178487 (+272788us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.205719 (+ 27232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.228451 19798 raft_consensus.cc:359] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.237475 19731 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53174 (request call id 42) took 1507 ms. Trace:
I20260709 12:13:08.229683 19586 rpcz_store.cc:276] 0709 12:13:06.856664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.692912 (+836248us) service_pool.cc:224] Handling call
0709 12:13:07.695450 (+  2538us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.695600 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.946608 (+251008us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.185413 (+238805us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.208040 (+ 22627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.241473 19582 rpcz_store.cc:276] 0709 12:13:06.812672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.526027 (+713355us) service_pool.cc:224] Handling call
0709 12:13:07.549623 (+ 23596us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800004598. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a67831 00007f1f20a44ac3 00007f1f209f3400 00007f1f19e78af4 00007f1f19e78a82 00007f1f19e789b1
0709 12:13:07.550621 (+   998us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.550720 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.997194 (+446474us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.199484 (+202290us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.208885 (+  9401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1779,"spinlock_wait_cycles":47640448}
I20260709 12:13:08.255595 19731 rpcz_store.cc:276] 0709 12:13:06.730546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.814845 (+1084299us) service_pool.cc:224] Handling call
0709 12:13:07.983233 (+168388us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.983396 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.202022 (+218626us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.236765 (+ 34743us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.237383 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.247033 19583 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 33) took 1391 ms. Trace:
I20260709 12:13:08.245349 19585 rpcz_store.cc:276] 0709 12:13:06.856012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.682203 (+826191us) service_pool.cc:224] Handling call
0709 12:13:07.684476 (+  2273us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.684638 (+   162us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.018446 (+333808us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.212792 (+194346us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.213354 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.258195 19583 rpcz_store.cc:276] 0709 12:13:06.855653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.544203 (+688550us) service_pool.cc:224] Handling call
0709 12:13:07.549963 (+  5760us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.551318 (+  1355us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:07.970512 (+419194us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.226050 (+255538us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.246959 (+ 20909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35201}
I20260709 12:13:08.242292 19675 raft_consensus.cc:2393] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:08.259681 19796 tablet_bootstrap.cc:654] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:08.241326 19639 leader_election.cc:343] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.254308 19526 raft_consensus.cc:2468] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
W20260709 12:13:08.261068 19639 leader_election.cc:343] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.262362 19490 leader_election.cc:304] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.245222 19798 raft_consensus.cc:385] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.263839 19798 raft_consensus.cc:740] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.264231 19795 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.264367 19641 leader_election.cc:304] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:08.264863 19795 ts_tablet_manager.cc:1403] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.021s
I20260709 12:13:08.264709 19798 consensus_queue.cc:260] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.265736 19809 raft_consensus.cc:2749] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.265895 19799 raft_consensus.cc:2804] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.267114 19798 ts_tablet_manager.cc:1434] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:13:08.268291 19798 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.269728 19795 raft_consensus.cc:359] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.245287 19510 rpcz_store.cc:276] 0709 12:13:06.610196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.815930 (+1205734us) service_pool.cc:224] Handling call
0709 12:13:07.820465 (+  4535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.820586 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.051047 (+230461us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.217215 (+166168us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.217737 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.272063 19587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 40) took 1361 ms. Trace:
I20260709 12:13:08.246505 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:08.240401 19511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 44) took 1348 ms. Trace:
I20260709 12:13:08.278709 19587 rpcz_store.cc:276] 0709 12:13:06.910917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.134151 (+1223234us) service_pool.cc:224] Handling call
0709 12:13:08.136570 (+  2419us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:08.136692 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.263208 (+126516us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.271522 (+  8314us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.271998 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.279317 19674 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:08.280212 19511 rpcz_store.cc:276] 0709 12:13:06.891579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.976462 (+1084883us) service_pool.cc:224] Handling call
0709 12:13:08.007229 (+ 30767us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:08.007378 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.199875 (+192497us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.239643 (+ 39768us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.240311 (+   668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.270609 19795 raft_consensus.cc:385] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.250377 19589 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 39) took 1340 ms. Trace:
I20260709 12:13:08.283526 19589 rpcz_store.cc:276] 0709 12:13:06.910419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.963283 (+1052864us) service_pool.cc:224] Handling call
0709 12:13:07.965520 (+  2237us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.972414 (+  6894us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.139163 (+166749us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.249742 (+110579us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.250304 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16978}
I20260709 12:13:08.285015 19808 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.285246 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:08.282713 19795 raft_consensus.cc:740] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.286100 19674 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.286234 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:08.286964 19795 consensus_queue.cc:260] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.288101 19507 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48174 (request call id 43) took 1518 ms. Trace:
I20260709 12:13:08.288851 19794 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.288520 19507 rpcz_store.cc:276] 0709 12:13:06.770405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.872423 (+1102018us) service_pool.cc:224] Handling call
0709 12:13:07.877064 (+  4641us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:07.877178 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.187772 (+310594us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.253296 (+ 65524us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.288029 (+ 34733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.286999 19526 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.291606 19795 ts_tablet_manager.cc:1434] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 12:13:08.294770 19795 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.295408 19674 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:08.298250 19713 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:08.299347 19808 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.299898 19808 raft_consensus.cc:697] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
W20260709 12:13:08.301306 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:08.301105 19808 consensus_queue.cc:237] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.293660 19798 tablet_bootstrap.cc:654] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.304785 19799 raft_consensus.cc:697] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:08.306526 19588 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 41) took 1395 ms. Trace:
I20260709 12:13:08.306201 19799 consensus_queue.cc:237] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.301110 19794 ts_tablet_manager.cc:1403] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.317s	user 0.036s	sys 0.011s
I20260709 12:13:08.310513 19590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32830 (request call id 42) took 1399 ms. Trace:
I20260709 12:13:08.307144 19588 rpcz_store.cc:276] 0709 12:13:06.911240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.144633 (+1233393us) service_pool.cc:224] Handling call
0709 12:13:08.147087 (+  2454us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:08.147214 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.247469 (+100255us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.305793 (+ 58324us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.306436 (+   643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.310602 19795 tablet_bootstrap.cc:654] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.315730 19794 raft_consensus.cc:359] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.316581 19794 raft_consensus.cc:385] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.316910 19794 raft_consensus.cc:740] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.315438 19590 rpcz_store.cc:276] 0709 12:13:06.911526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.111846 (+1200320us) service_pool.cc:224] Handling call
0709 12:13:08.150920 (+ 39074us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:08.151057 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:08.249884 (+ 98827us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:08.309917 (+ 60033us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:08.310436 (+   519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:08.317860 19794 consensus_queue.cc:260] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.322948 19424 catalog_manager.cc:5697] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.324218 19794 ts_tablet_manager.cc:1434] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:13:08.325469 19794 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.330127 19798 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.330715 19795 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.331259 19798 ts_tablet_manager.cc:1403] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.005s
I20260709 12:13:08.331254 19795 ts_tablet_manager.cc:1403] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.001s
I20260709 12:13:08.335135 19798 raft_consensus.cc:359] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.335315 19795 raft_consensus.cc:359] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.335927 19794 tablet_bootstrap.cc:654] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.336042 19798 raft_consensus.cc:385] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.336539 19798 raft_consensus.cc:740] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.336942 19795 raft_consensus.cc:385] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.337373 19798 consensus_queue.cc:260] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.338340 19795 raft_consensus.cc:740] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.339831 19795 consensus_queue.cc:260] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.342763 19795 ts_tablet_manager.cc:1434] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:08.344092 19526 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:08.341400 19423 catalog_manager.cc:5697] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.345525 19795 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.348681 19798 ts_tablet_manager.cc:1434] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 12:13:08.356858 19798 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.358048 19795 tablet_bootstrap.cc:654] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.333395 19796 tablet_bootstrap.cc:492] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.367121 19796 ts_tablet_manager.cc:1403] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.015s
I20260709 12:13:08.369024 19798 tablet_bootstrap.cc:654] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.371021 19795 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.371778 19795 ts_tablet_manager.cc:1403] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 12:13:08.373425 19809 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.374029 19809 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.371155 19796 raft_consensus.cc:359] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.375676 19796 raft_consensus.cc:385] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.375991 19796 raft_consensus.cc:740] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.376626 19809 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.376096 19795 raft_consensus.cc:359] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.376981 19796 consensus_queue.cc:260] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.377463 19795 raft_consensus.cc:385] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.374536 19794 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.378515 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.379379 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:08.380244 19490 leader_election.cc:343] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.378554 19794 ts_tablet_manager.cc:1403] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.023s
W20260709 12:13:08.381052 19490 leader_election.cc:343] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.381448 19490 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.381520 19796 ts_tablet_manager.cc:1434] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:13:08.382349 19809 raft_consensus.cc:2749] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.383627 19796 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.378011 19795 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.385950 19794 raft_consensus.cc:359] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.386864 19794 raft_consensus.cc:385] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.387267 19794 raft_consensus.cc:740] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.388136 19794 consensus_queue.cc:260] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.389242 19798 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.389907 19798 ts_tablet_manager.cc:1403] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 12:13:08.390784 19794 ts_tablet_manager.cc:1434] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:13:08.392045 19794 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.386487 19795 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.394857 19795 ts_tablet_manager.cc:1434] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:13:08.393465 19798 raft_consensus.cc:359] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.396019 19798 raft_consensus.cc:385] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.396405 19798 raft_consensus.cc:740] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.396836 19799 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.397248 19796 tablet_bootstrap.cc:654] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.397375 19799 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.398639 19798 consensus_queue.cc:260] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.401177 19794 tablet_bootstrap.cc:654] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.402580 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:08.404784 19640 leader_election.cc:343] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.406787 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.408821 19809 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.409394 19809 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.411617 19811 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.412156 19809 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.412357 19811 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.409780 19798 ts_tablet_manager.cc:1434] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.006s
I20260709 12:13:08.413836 19799 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.414371 19795 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.416998 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:08.413301 19641 leader_election.cc:343] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.417898 19641 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:08.419008 19491 leader_election.cc:343] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.415385 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:08.421265 19490 leader_election.cc:343] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.421947 19490 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:08.423637 19799 raft_consensus.cc:2749] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.424959 19809 raft_consensus.cc:2749] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.426609 19798 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.433367 19794 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.434042 19794 ts_tablet_manager.cc:1403] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.019s
I20260709 12:13:08.435844 19795 tablet_bootstrap.cc:654] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.437754 19794 raft_consensus.cc:359] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.438633 19794 raft_consensus.cc:385] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.438927 19794 raft_consensus.cc:740] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.433979 19796 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.440263 19796 ts_tablet_manager.cc:1403] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.008s
I20260709 12:13:08.440426 19794 consensus_queue.cc:260] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.443291 19811 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.444859 19794 ts_tablet_manager.cc:1434] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:08.444713 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:08.446190 19794 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
W20260709 12:13:08.446636 19565 leader_election.cc:343] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.448061 19796 raft_consensus.cc:359] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.449054 19796 raft_consensus.cc:385] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.449465 19796 raft_consensus.cc:740] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.450567 19796 consensus_queue.cc:260] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.451997 19798 tablet_bootstrap.cc:654] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.454764 19796 ts_tablet_manager.cc:1434] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:13:08.455611 19794 tablet_bootstrap.cc:654] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.457006 19796 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.468915 19795 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.468945 19798 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.470145 19795 ts_tablet_manager.cc:1403] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.011s
I20260709 12:13:08.470220 19798 ts_tablet_manager.cc:1403] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.008s
I20260709 12:13:08.473745 19795 raft_consensus.cc:359] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.474076 19798 raft_consensus.cc:359] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.474783 19795 raft_consensus.cc:385] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.475059 19798 raft_consensus.cc:385] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.475318 19794 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.475768 19798 raft_consensus.cc:740] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.476078 19794 ts_tablet_manager.cc:1403] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.003s
I20260709 12:13:08.477232 19796 tablet_bootstrap.cc:654] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.476881 19798 consensus_queue.cc:260] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.479728 19794 raft_consensus.cc:359] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.480273 19798 ts_tablet_manager.cc:1434] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:08.480624 19794 raft_consensus.cc:385] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.491925 19799 raft_consensus.cc:493] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.498004 19798 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.498457 19799 raft_consensus.cc:515] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.497779 19794 raft_consensus.cc:740] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.502277 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.502436 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.502372 19794 consensus_queue.cc:260] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.503217 19600 raft_consensus.cc:2468] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:08.503324 19749 raft_consensus.cc:2468] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:08.504855 19639 leader_election.cc:304] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:08.475170 19795 raft_consensus.cc:740] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.506286 19835 raft_consensus.cc:2804] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.506724 19835 raft_consensus.cc:493] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.507073 19835 raft_consensus.cc:3060] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.501245 19799 leader_election.cc:290] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.508740 19794 ts_tablet_manager.cc:1434] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 12:13:08.510253 19794 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.506946 19795 consensus_queue.cc:260] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.514634 19798 tablet_bootstrap.cc:654] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.516098 19795 ts_tablet_manager.cc:1434] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.046s	user 0.011s	sys 0.004s
I20260709 12:13:08.519418 19809 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.519625 19796 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.520035 19809 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.520438 19796 ts_tablet_manager.cc:1403] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.000s
I20260709 12:13:08.524784 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.524871 19809 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.524784 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.526199 19749 raft_consensus.cc:2468] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:08.526921 19798 tablet_bootstrap.cc:492] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.526921 19796 raft_consensus.cc:359] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.527886 19796 raft_consensus.cc:385] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.527709 19491 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:08.528221 19796 raft_consensus.cc:740] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
W20260709 12:13:08.528811 19490 leader_election.cc:343] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.529085 19796 consensus_queue.cc:260] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.528795 19809 raft_consensus.cc:2804] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.530157 19809 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.530577 19809 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.527698 19798 ts_tablet_manager.cc:1403] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.023s
I20260709 12:13:08.534031 19794 tablet_bootstrap.cc:654] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.536542 19835 raft_consensus.cc:515] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.536927 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.539448 19526 raft_consensus.cc:2468] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:08.539791 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.540413 19600 raft_consensus.cc:3060] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.541076 19567 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.541698 19796 ts_tablet_manager.cc:1434] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:13:08.542549 19811 raft_consensus.cc:2804] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.542969 19796 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.543001 19811 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.543690 19811 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.544314 19809 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.537305 19798 raft_consensus.cc:359] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.546201 19798 raft_consensus.cc:385] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.546517 19798 raft_consensus.cc:740] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.547399 19798 consensus_queue.cc:260] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.549701 19799 raft_consensus.cc:493] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.550249 19799 raft_consensus.cc:515] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.551925 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:08.552150 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.552515 19799 leader_election.cc:290] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.552634 19749 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:08.553797 19490 leader_election.cc:343] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.556954 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.557880 19601 raft_consensus.cc:2468] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:08.559957 19795 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.562462 19639 leader_election.cc:304] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:08.557106 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.564085 19799 raft_consensus.cc:2804] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.564527 19799 raft_consensus.cc:493] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.564440 19749 raft_consensus.cc:2468] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
W20260709 12:13:08.564929 19640 leader_election.cc:343] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.566095 19491 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:08.566605 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:08.567286 19748 raft_consensus.cc:3060] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.565039 19799 raft_consensus.cc:3060] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.569643 19811 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.572849 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:08.562475 19600 raft_consensus.cc:2468] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:08.573575 19526 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.574957 19639 leader_election.cc:304] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:08.564987 19809 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.579231 19835 leader_election.cc:290] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.582923 19526 raft_consensus.cc:2468] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:08.583593 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:08.584270 19567 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
W20260709 12:13:08.585175 19565 leader_election.cc:343] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.589444 19856 raft_consensus.cc:2804] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.591981 19856 raft_consensus.cc:697] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:08.579470 19809 raft_consensus.cc:2804] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.592756 19809 raft_consensus.cc:697] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:08.593086 19856 consensus_queue.cc:237] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.582233 19811 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.593730 19809 consensus_queue.cc:237] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.582625 19748 raft_consensus.cc:2468] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:08.597955 19795 tablet_bootstrap.cc:654] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.598275 19798 ts_tablet_manager.cc:1434] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.006s
I20260709 12:13:08.599747 19798 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.599431 19808 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.598959 19835 raft_consensus.cc:2804] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.608330 19808 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.552542 19796 tablet_bootstrap.cc:654] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.619311 19794 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.620146 19794 ts_tablet_manager.cc:1403] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.009s
I20260709 12:13:08.610210 19835 raft_consensus.cc:697] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:08.625916 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.627028 19600 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:08.629345 19713 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:08.630878 19831 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.631487 19831 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.631925 19831 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.630206 19835 consensus_queue.cc:237] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.632983 19799 raft_consensus.cc:515] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.638404 19799 leader_election.cc:290] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.639983 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
W20260709 12:13:08.642190 19640 leader_election.cc:343] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.642597 19808 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.644443 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:08.645176 19674 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:08.644934 19423 catalog_manager.cc:5697] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.637830 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.647953 19600 raft_consensus.cc:3060] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.656520 19798 tablet_bootstrap.cc:654] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.657733 19799 raft_consensus.cc:493] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.658774 19799 raft_consensus.cc:515] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.666488 19799 leader_election.cc:290] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:08.665374 19794 raft_consensus.cc:359] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.667600 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.668577 19794 raft_consensus.cc:385] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.669085 19794 raft_consensus.cc:740] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.670171 19794 consensus_queue.cc:260] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.671911 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:08.672569 19641 leader_election.cc:343] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.672607 19601 raft_consensus.cc:2468] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:08.675335 19639 leader_election.cc:304] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:08.676409 19799 raft_consensus.cc:2804] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.676805 19799 raft_consensus.cc:493] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.679764 19794 ts_tablet_manager.cc:1434] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 12:13:08.679754 19799 raft_consensus.cc:3060] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.680141 19831 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.681052 19794 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.682438 19831 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.683614 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:08.684280 19674 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.679422 19796 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.686422 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.690418 19601 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.688216 19424 catalog_manager.cc:5697] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.694655 19600 raft_consensus.cc:2468] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:08.679172 19421 catalog_manager.cc:5697] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.696429 19639 leader_election.cc:304] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:08.697075 19674 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:08.697793 19835 raft_consensus.cc:2804] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.698525 19835 raft_consensus.cc:697] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:08.699700 19835 consensus_queue.cc:237] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.689875 19796 ts_tablet_manager.cc:1403] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.004s
I20260709 12:13:08.708999 19601 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:08.711695 19713 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:08.713276 19831 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.713778 19831 raft_consensus.cc:697] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:08.714653 19831 consensus_queue.cc:237] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.715631 19794 tablet_bootstrap.cc:654] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.719159 19795 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.719652 19795 ts_tablet_manager.cc:1403] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.160s	user 0.034s	sys 0.023s
I20260709 12:13:08.724396 19799 raft_consensus.cc:515] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.726055 19795 raft_consensus.cc:359] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.726787 19795 raft_consensus.cc:385] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.728942 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:08.731057 19641 leader_election.cc:343] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.730943 19424 catalog_manager.cc:5697] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.727073 19795 raft_consensus.cc:740] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.734377 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:08.735117 19601 raft_consensus.cc:3060] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.735235 19798 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.737110 19798 ts_tablet_manager.cc:1403] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.025s
I20260709 12:13:08.738166 19795 consensus_queue.cc:260] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.739593 19859 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.740163 19859 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.740970 19798 raft_consensus.cc:359] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.741675 19795 ts_tablet_manager.cc:1434] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:13:08.741851 19798 raft_consensus.cc:385] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.742305 19798 raft_consensus.cc:740] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.743147 19795 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.744835 19794 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.745082 19796 raft_consensus.cc:359] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.750568 19796 raft_consensus.cc:385] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.750926 19796 raft_consensus.cc:740] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.745460 19794 ts_tablet_manager.cc:1403] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 12:13:08.756899 19601 raft_consensus.cc:2468] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:08.760627 19639 leader_election.cc:304] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:08.761778 19835 raft_consensus.cc:2804] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.762349 19835 raft_consensus.cc:697] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:08.763290 19835 consensus_queue.cc:237] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.764122 19796 consensus_queue.cc:260] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.769105 19809 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.747437 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.769845 19809 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.770584 19748 raft_consensus.cc:2468] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:08.747735 19859 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.745827 19798 consensus_queue.cc:260] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.747978 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.772917 19809 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:08.773833 19566 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:08.774590 19567 leader_election.cc:343] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.774833 19859 raft_consensus.cc:2804] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.747795 19799 leader_election.cc:290] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:08.775353 19859 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.775753 19859 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.776870 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:08.778374 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:08.787665 19490 leader_election.cc:343] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.788141 19831 raft_consensus.cc:493] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.788693 19831 raft_consensus.cc:515] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.785153 19798 ts_tablet_manager.cc:1434] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
W20260709 12:13:08.789237 19490 leader_election.cc:343] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.789814 19490 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.790530 19798 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.790925 19796 ts_tablet_manager.cc:1434] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.002s
I20260709 12:13:08.792042 19796 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.780747 19421 catalog_manager.cc:5697] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.793781 19809 raft_consensus.cc:2749] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.797237 19794 raft_consensus.cc:359] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.797941 19423 catalog_manager.cc:5697] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.799862 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:08.801429 19713 leader_election.cc:343] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.785625 19859 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.804941 19831 leader_election.cc:290] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.805179 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:08.805908 19748 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.797979 19794 raft_consensus.cc:385] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.806488 19794 raft_consensus.cc:740] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.807179 19859 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.808532 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:08.810228 19567 leader_election.cc:343] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.808743 19798 tablet_bootstrap.cc:654] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.811306 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.812045 19526 raft_consensus.cc:2468] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:08.813246 19715 leader_election.cc:304] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.807224 19794 consensus_queue.cc:260] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.814677 19831 raft_consensus.cc:2804] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.815169 19831 raft_consensus.cc:493] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.815578 19831 raft_consensus.cc:3060] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.817749 19748 raft_consensus.cc:2468] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:08.819082 19835 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.819538 19566 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:08.819736 19835 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.821004 19859 raft_consensus.cc:2804] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.821617 19859 raft_consensus.cc:697] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:08.822621 19798 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.822808 19796 tablet_bootstrap.cc:654] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.822698 19859 consensus_queue.cc:237] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:08.824873 19795 tablet_bootstrap.cc:654] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.827392 19794 ts_tablet_manager.cc:1434] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 12:13:08.835659 19794 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.835345 19799 consensus_queue.cc:1048] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:08.836825 19798 ts_tablet_manager.cc:1403] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.001s
I20260709 12:13:08.840207 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.840117 19798 raft_consensus.cc:359] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:08.840890 19798 raft_consensus.cc:385] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.841199 19798 raft_consensus.cc:740] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
W20260709 12:13:08.841652 19640 leader_election.cc:343] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.842140 19798 consensus_queue.cc:260] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:08.842648 19639 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.844792 19798 ts_tablet_manager.cc:1434] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:08.845880 19798 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:08.847640 19794 tablet_bootstrap.cc:654] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.855096 19835 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.861335 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:08.862032 19794 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:08.862591 19794 ts_tablet_manager.cc:1403] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.010s
I20260709 12:13:08.863842 19798 tablet_bootstrap.cc:654] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.865300 19831 raft_consensus.cc:515] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.865823 19794 raft_consensus.cc:359] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.866477 19794 raft_consensus.cc:385] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.866788 19794 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.865404 19423 catalog_manager.cc:5697] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:08.867640 19641 leader_election.cc:343] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.867640 19794 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.868700 19641 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:08.869659 19835 raft_consensus.cc:2749] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.875631 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
W20260709 12:13:08.877736 19713 leader_election.cc:343] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.890264 19831 leader_election.cc:290] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:08.905216 19794 ts_tablet_manager.cc:1434] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.016s
I20260709 12:13:08.906404 19795 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:08.907002 19796 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:08.907806 19795 ts_tablet_manager.cc:1403] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.008s
I20260709 12:13:08.907924 19796 ts_tablet_manager.cc:1403] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.116s	user 0.028s	sys 0.009s
I20260709 12:13:08.910421 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:08.916074 19525 raft_consensus.cc:3060] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.916172 19831 consensus_queue.cc:1048] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:08.917292 19795 raft_consensus.cc:359] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.911902 19796 raft_consensus.cc:359] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.929111 19796 raft_consensus.cc:385] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.929515 19796 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.930277 19796 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.930377 19835 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.932757 19796 ts_tablet_manager.cc:1434] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:13:08.932158 19835 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:08.919127 19794 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:08.935977 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:08.937891 19639 leader_election.cc:343] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.938409 19795 raft_consensus.cc:385] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.938732 19795 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.939606 19795 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.938088 19796 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:08.944169 19794 tablet_bootstrap.cc:654] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.947273 19795 ts_tablet_manager.cc:1434] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:13:08.948275 19808 consensus_queue.cc:1048] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:08.950589 19795 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:08.956511 19525 raft_consensus.cc:2468] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:08.960747 19715 leader_election.cc:304] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:08.962205 19831 raft_consensus.cc:2804] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.962709 19831 raft_consensus.cc:697] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:08.963551 19835 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:08.964289 19798 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:08.963575 19831 consensus_queue.cc:237] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:08.964967 19798 ts_tablet_manager.cc:1403] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.002s
I20260709 12:13:08.966177 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:08.968894 19795 tablet_bootstrap.cc:654] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:08.971732 19640 leader_election.cc:343] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.972292 19640 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
W20260709 12:13:08.967535 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 50289.2us
I20260709 12:13:08.973785 19835 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.987319 19601 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.998632 19809 consensus_queue.cc:1048] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.000327 19794 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.000952 19794 ts_tablet_manager.cc:1403] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.009s
I20260709 12:13:09.003324 19798 raft_consensus.cc:359] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.004393 19794 raft_consensus.cc:359] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.005275 19794 raft_consensus.cc:385] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.008247 19794 raft_consensus.cc:740] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.010542 19794 consensus_queue.cc:260] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.013772 19796 tablet_bootstrap.cc:654] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.018795 19795 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.019018 19794 ts_tablet_manager.cc:1434] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.005s
I20260709 12:13:09.019407 19795 ts_tablet_manager.cc:1403] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.023s
I20260709 12:13:09.004392 19798 raft_consensus.cc:385] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.020269 19798 raft_consensus.cc:740] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.020386 19794 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.021028 19798 consensus_queue.cc:260] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.027725 19675 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.031332 19859 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.031951 19859 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.036463 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.037832 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.038851 19856 consensus_queue.cc:1048] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.037206 19859 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:09.040266 19857 consensus_queue.cc:1048] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.041836 19794 tablet_bootstrap.cc:654] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.044207 19566 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.038544 19809 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.046629 19809 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.053937 19795 raft_consensus.cc:359] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.054497 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.054839 19795 raft_consensus.cc:385] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:09.056296 19491 leader_election.cc:343] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.057585 19809 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:09.058573 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.059324 19674 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:09.060587 19490 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.062880 19794 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.063493 19794 ts_tablet_manager.cc:1403] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.013s
I20260709 12:13:09.063922 19809 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.064433 19809 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.064771 19809 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.062884 19798 ts_tablet_manager.cc:1434] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 12:13:09.067049 19798 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:09.066706 19794 raft_consensus.cc:359] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.069039 19794 raft_consensus.cc:385] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.069344 19794 raft_consensus.cc:740] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.070194 19794 consensus_queue.cc:260] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.055141 19795 raft_consensus.cc:740] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.073101 19794 ts_tablet_manager.cc:1434] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:13:09.073200 19795 consensus_queue.cc:260] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.074146 19794 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.075573 19856 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:09.080588 19795 ts_tablet_manager.cc:1434] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:13:09.081220 19794 tablet_bootstrap.cc:654] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.081758 19795 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.083657 19835 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.084182 19835 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.087230 19835 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.088977 19795 tablet_bootstrap.cc:654] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.089394 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:09.091424 19639 leader_election.cc:343] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.093253 19794 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.093062 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.093861 19794 ts_tablet_manager.cc:1403] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
W20260709 12:13:09.095130 19641 leader_election.cc:343] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.095623 19641 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:09.097007 19794 raft_consensus.cc:359] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.097750 19794 raft_consensus.cc:385] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.098038 19794 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.098201 19835 raft_consensus.cc:2749] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.098995 19794 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.100528 19796 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.101104 19796 ts_tablet_manager.cc:1403] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.163s	user 0.006s	sys 0.008s
I20260709 12:13:09.101660 19794 ts_tablet_manager.cc:1434] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 12:13:09.102042 19640 consensus_peers.cc:597] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 -> Peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Couldn't send request to peer df754e24c604440998ec5ed4153e9925. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.104101 19856 consensus_queue.cc:1048] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.111295 19794 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.111470 19795 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.112347 19795 ts_tablet_manager.cc:1403] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 12:13:09.115998 19795 raft_consensus.cc:359] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.116801 19795 raft_consensus.cc:385] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.117100 19795 raft_consensus.cc:740] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.117935 19795 consensus_queue.cc:260] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.119020 19794 tablet_bootstrap.cc:654] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.120525 19795 ts_tablet_manager.cc:1434] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:09.121819 19795 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.128921 19795 tablet_bootstrap.cc:654] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.131541 19808 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.132360 19808 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.133616 19856 raft_consensus.cc:493] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.134395 19856 raft_consensus.cc:515] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.137130 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.137390 19808 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:09.138094 19673 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:09.137121 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.140012 19525 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:09.141356 19715 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:09.142620 19877 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.143142 19877 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.143564 19877 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.143433 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.126133 19796 raft_consensus.cc:359] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.146575 19796 raft_consensus.cc:385] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.147006 19796 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.155472 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.159413 19565 leader_election.cc:304] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:09.160802 19859 raft_consensus.cc:2749] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.162106 19856 leader_election.cc:290] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.169117 19808 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.171377 19799 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.171687 19796 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.171945 19799 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.183427 19422 catalog_manager.cc:5697] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.203148 19799 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.204087 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.204282 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.204826 19526 raft_consensus.cc:2468] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:09.184419 19877 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:09.205832 19639 leader_election.cc:343] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.206489 19641 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:09.207690 19799 raft_consensus.cc:2804] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.208062 19799 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.208309 19796 ts_tablet_manager.cc:1434] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.005s
I20260709 12:13:09.208396 19799 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.209511 19796 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.211516 19877 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:09.197877 19795 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.234707 19795 ts_tablet_manager.cc:1403] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.053s
I20260709 12:13:09.197690 19857 raft_consensus.cc:493] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.235908 19857 raft_consensus.cc:515] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.238322 19857 leader_election.cc:290] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.238109 19795 raft_consensus.cc:359] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.199084 19798 tablet_bootstrap.cc:654] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.200133 19835 consensus_queue.cc:1048] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.238761 19900 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.200791 19809 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.245383 19799 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.247761 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.247808 19799 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.248462 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:09.249497 19749 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.251117 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:09.252048 19524 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.256047 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:09.256834 19794 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.256989 19674 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.257476 19794 ts_tablet_manager.cc:1403] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.146s	user 0.046s	sys 0.049s
I20260709 12:13:09.261258 19794 raft_consensus.cc:359] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.262106 19794 raft_consensus.cc:385] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.262426 19794 raft_consensus.cc:740] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.263227 19794 consensus_queue.cc:260] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.266060 19794 ts_tablet_manager.cc:1434] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:09.267191 19794 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.269191 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:09.270334 19809 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:09.272038 19639 leader_election.cc:343] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.221083 19877 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.274001 19877 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.275388 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.225265 19856 consensus_queue.cc:1048] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:09.232340 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:09.276365 19600 raft_consensus.cc:2393] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:09.276854 19526 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.278088 19490 leader_election.cc:304] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:09.276393 19877 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.279636 19809 raft_consensus.cc:3060] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.281196 19856 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.281786 19856 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.282620 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.283414 19525 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:09.284169 19856 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:09.238910 19795 raft_consensus.cc:385] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.284759 19795 raft_consensus.cc:740] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.284957 19715 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:09.285571 19795 consensus_queue.cc:260] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.286737 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.287137 19857 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.217749 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:09.287539 19795 ts_tablet_manager.cc:1434] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:13:09.287834 19673 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.287669 19857 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.288839 19795 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.285972 19877 raft_consensus.cc:2804] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.290046 19877 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.272643 19799 consensus_queue.cc:1048] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.290434 19877 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.293399 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.294195 19525 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:09.287513 19600 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:09.295527 19567 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:09.301091 19799 consensus_queue.cc:1048] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.302080 19856 raft_consensus.cc:2804] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.302579 19856 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.304463 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.304651 19524 raft_consensus.cc:2468] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:09.306725 19856 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.308187 19641 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:09.308817 19795 tablet_bootstrap.cc:654] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.310127 19858 raft_consensus.cc:2804] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.310680 19858 raft_consensus.cc:697] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:09.311684 19858 consensus_queue.cc:237] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.224011 19796 tablet_bootstrap.cc:654] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.317184 19526 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:09.325848 19715 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:09.327080 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.328339 19900 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.329180 19900 raft_consensus.cc:697] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:09.330910 19673 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:09.330579 19900 consensus_queue.cc:237] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.345409 19857 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.357194 19674 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:09.345922 19799 consensus_queue.cc:1048] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:13:09.370261 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.371080 19490 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
W20260709 12:13:09.368083 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:09.376806 19490 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.383888 19887 raft_consensus.cc:2749] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.384538 19856 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.387645 19856 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:09.388859 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:09.389494 19524 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.389772 19794 tablet_bootstrap.cc:654] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.391112 19877 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.392513 19746 raft_consensus.cc:2393] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:09.389243 19798 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:09.393379 19798 ts_tablet_manager.cc:1403] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.327s	user 0.021s	sys 0.003s
I20260709 12:13:09.400264 19809 raft_consensus.cc:2749] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.401902 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:09.402792 19745 raft_consensus.cc:2393] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:09.378022 19857 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.408253 19798 raft_consensus.cc:359] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.409288 19798 raft_consensus.cc:385] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.409639 19601 raft_consensus.cc:3060] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.412441 19798 raft_consensus.cc:740] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.420791 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:09.421871 19600 raft_consensus.cc:2393] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:09.422788 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:09.423967 19877 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.420863 19523 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.424691 19798 consensus_queue.cc:260] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.427309 19798 ts_tablet_manager.cc:1434] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:13:09.428399 19798 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:09.434393 19749 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:09.441732 19831 consensus_queue.cc:1048] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.444300 19798 tablet_bootstrap.cc:654] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.447443 19811 consensus_queue.cc:1048] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.460662 19715 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:09.461966 19831 raft_consensus.cc:2749] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.462910 19524 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:09.432983 19857 raft_consensus.cc:697] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:09.470878 19567 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.472507 19811 raft_consensus.cc:2804] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.473150 19811 raft_consensus.cc:697] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:09.474025 19795 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.474593 19795 ts_tablet_manager.cc:1403] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.008s
I20260709 12:13:09.474310 19811 consensus_queue.cc:237] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.477072 19796 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.477615 19796 ts_tablet_manager.cc:1403] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.016s
I20260709 12:13:09.478231 19795 raft_consensus.cc:359] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.479108 19795 raft_consensus.cc:385] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.479485 19795 raft_consensus.cc:740] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.483086 19795 consensus_queue.cc:260] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.501107 19795 ts_tablet_manager.cc:1434] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:13:09.501372 19799 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.502318 19795 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.501950 19799 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.504266 19799 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:09.508437 19796 raft_consensus.cc:359] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.509223 19796 raft_consensus.cc:385] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.509497 19796 raft_consensus.cc:740] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.510296 19796 consensus_queue.cc:260] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.512948 19796 ts_tablet_manager.cc:1434] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:13:09.514055 19796 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.515297 19795 tablet_bootstrap.cc:654] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.538584 19912 consensus_queue.cc:1048] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 12:13:09.542696 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.544867 19423 catalog_manager.cc:5697] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:09.544732 19640 leader_election.cc:343] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.546857 19796 tablet_bootstrap.cc:654] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.549451 19794 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.549978 19794 ts_tablet_manager.cc:1403] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.283s	user 0.012s	sys 0.008s
I20260709 12:13:09.522634 19857 consensus_queue.cc:237] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.562177 19420 catalog_manager.cc:5697] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.581074 19798 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:09.582024 19798 ts_tablet_manager.cc:1403] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.154s	user 0.025s	sys 0.005s
I20260709 12:13:09.593410 19798 raft_consensus.cc:359] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.594455 19798 raft_consensus.cc:385] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.594743 19798 raft_consensus.cc:740] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.598940 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.601104 19798 consensus_queue.cc:260] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.603288 19794 raft_consensus.cc:359] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.604125 19794 raft_consensus.cc:385] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.604981 19794 raft_consensus.cc:740] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.606168 19798 ts_tablet_manager.cc:1434] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
W20260709 12:13:09.607908 19639 leader_election.cc:343] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.608451 19639 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.608731 19798 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:09.607178 19424 catalog_manager.cc:5697] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.609308 19858 raft_consensus.cc:2749] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.606349 19794 consensus_queue.cc:260] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.614701 19675 raft_consensus.cc:3060] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.632210 19887 raft_consensus.cc:493] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.632941 19887 raft_consensus.cc:515] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.635440 19887 leader_election.cc:290] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.638916 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:09.640841 19490 leader_election.cc:343] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.638916 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.642632 19794 ts_tablet_manager.cc:1434] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.000s
W20260709 12:13:09.642840 19491 leader_election.cc:343] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.643461 19491 leader_election.cc:304] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.644609 19794 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.644845 19887 raft_consensus.cc:2749] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.645325 19809 raft_consensus.cc:493] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.666930 19809 raft_consensus.cc:515] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.670969 19809 leader_election.cc:290] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.673238 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:09.672224 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:09.675036 19491 leader_election.cc:343] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:09.675643 19490 leader_election.cc:343] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.676159 19490 leader_election.cc:304] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:09.681170 19796 tablet_bootstrap.cc:492] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.681718 19887 raft_consensus.cc:2749] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.681951 19796 ts_tablet_manager.cc:1403] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.168s	user 0.031s	sys 0.061s
I20260709 12:13:09.684651 19808 consensus_queue.cc:1048] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.688658 19795 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.689396 19795 ts_tablet_manager.cc:1403] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.015s
I20260709 12:13:09.689215 19796 raft_consensus.cc:359] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.690121 19796 raft_consensus.cc:385] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.690550 19796 raft_consensus.cc:740] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.691541 19796 consensus_queue.cc:260] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.692999 19798 tablet_bootstrap.cc:654] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.693197 19795 raft_consensus.cc:359] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.694171 19795 raft_consensus.cc:385] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.694537 19795 raft_consensus.cc:740] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.695541 19795 consensus_queue.cc:260] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.698127 19795 ts_tablet_manager.cc:1434] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:09.699617 19795 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.703562 19424 catalog_manager.cc:5697] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.698424 19794 tablet_bootstrap.cc:654] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.710264 19795 tablet_bootstrap.cc:654] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.710484 19908 consensus_queue.cc:1048] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.716445 19798 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:09.717283 19796 ts_tablet_manager.cc:1434] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:13:09.721649 19798 ts_tablet_manager.cc:1403] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.007s
I20260709 12:13:09.723685 19794 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.721659 19795 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.724228 19794 ts_tablet_manager.cc:1403] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.001s
I20260709 12:13:09.724422 19795 ts_tablet_manager.cc:1403] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.001s
I20260709 12:13:09.727623 19794 raft_consensus.cc:359] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.728400 19794 raft_consensus.cc:385] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.728682 19794 raft_consensus.cc:740] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.729578 19794 consensus_queue.cc:260] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.731694 19857 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.731896 19794 ts_tablet_manager.cc:1434] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:09.732331 19857 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.718737 19808 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.734469 19808 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.735116 19857 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.736541 19795 raft_consensus.cc:359] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.729668 19798 raft_consensus.cc:359] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.737784 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.738125 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.740430 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.721599 19796 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.740818 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.741572 19599 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
W20260709 12:13:09.741787 19715 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.740310 19795 raft_consensus.cc:385] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.742600 19795 raft_consensus.cc:740] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
W20260709 12:13:09.742654 19713 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.742913 19490 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:09.743505 19713 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:09.744001 19857 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.743767 19795 consensus_queue.cc:260] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.744459 19857 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.744539 19900 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.744913 19857 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.746908 19795 ts_tablet_manager.cc:1434] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:09.741798 19798 raft_consensus.cc:385] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.747653 19798 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.748744 19798 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.740309 19808 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:09.740880 19674 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:09.752693 19599 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.753660 19857 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.755506 19794 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.762141 19796 tablet_bootstrap.cc:654] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.763368 19794 tablet_bootstrap.cc:654] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.763659 19798 ts_tablet_manager.cc:1434] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 12:13:09.768116 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:09.768793 19601 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.769402 19798 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:09.776140 19795 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.780840 19794 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.781421 19794 ts_tablet_manager.cc:1403] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:13:09.787523 19859 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.788313 19859 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.789783 19794 raft_consensus.cc:359] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.790521 19794 raft_consensus.cc:385] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.790799 19794 raft_consensus.cc:740] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.791640 19794 consensus_queue.cc:260] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.792783 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:09.783576 19601 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:09.784629 19857 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.786502 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:09.794570 19675 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.797407 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.800266 19859 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.802295 19567 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:09.782797 19908 consensus_queue.cc:1048] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.804154 19859 raft_consensus.cc:2749] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:09.804006 19490 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:09.805066 19857 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.805653 19857 raft_consensus.cc:697] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:09.806444 19857 consensus_queue.cc:237] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.807885 19798 tablet_bootstrap.cc:654] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.809036 19795 tablet_bootstrap.cc:654] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.814369 19796 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.815068 19796 ts_tablet_manager.cc:1403] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.023s
I20260709 12:13:09.819186 19796 raft_consensus.cc:359] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.820017 19796 raft_consensus.cc:385] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.820309 19796 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.823338 19796 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.823781 19675 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:09.826386 19794 ts_tablet_manager.cc:1434] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:13:09.827402 19794 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.833654 19798 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:09.835183 19798 ts_tablet_manager.cc:1403] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.000s
I20260709 12:13:09.836390 19796 ts_tablet_manager.cc:1434] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:13:09.837792 19796 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.839790 19795 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.840456 19795 ts_tablet_manager.cc:1403] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.007s
I20260709 12:13:09.849239 19795 raft_consensus.cc:359] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.850152 19795 raft_consensus.cc:385] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.850459 19795 raft_consensus.cc:740] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.851217 19795 consensus_queue.cc:260] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.857367 19795 ts_tablet_manager.cc:1434] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:09.858507 19798 raft_consensus.cc:359] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.860235 19798 raft_consensus.cc:385] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.860553 19798 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.861510 19796 tablet_bootstrap.cc:654] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.862588 19795 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.861585 19798 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.867017 19794 tablet_bootstrap.cc:654] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.868284 19798 ts_tablet_manager.cc:1434] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:13:09.869525 19798 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:09.874104 19796 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.874768 19796 ts_tablet_manager.cc:1403] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.001s
I20260709 12:13:09.878485 19423 catalog_manager.cc:5697] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.879351 19796 raft_consensus.cc:359] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.880146 19796 raft_consensus.cc:385] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.880458 19796 raft_consensus.cc:740] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.881182 19796 consensus_queue.cc:260] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:09.882776 19795 tablet_bootstrap.cc:654] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.883499 19796 ts_tablet_manager.cc:1434] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:09.884610 19796 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.885692 19798 tablet_bootstrap.cc:654] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.889833 19808 raft_consensus.cc:493] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.890630 19808 raft_consensus.cc:515] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.892159 19796 tablet_bootstrap.cc:654] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.894853 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:09.898243 19808 leader_election.cc:290] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:09.898934 19794 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.899516 19794 ts_tablet_manager.cc:1403] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.001s
I20260709 12:13:09.903036 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.903134 19794 raft_consensus.cc:359] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.904011 19794 raft_consensus.cc:385] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.903716 19808 consensus_queue.cc:1048] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.904383 19794 raft_consensus.cc:740] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.905172 19794 consensus_queue.cc:260] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.906270 19713 leader_election.cc:304] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:09.907718 19900 raft_consensus.cc:2749] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.907943 19794 ts_tablet_manager.cc:1434] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:13:09.908756 19795 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.909332 19795 ts_tablet_manager.cc:1403] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.001s
I20260709 12:13:09.910326 19794 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.912761 19795 raft_consensus.cc:359] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.913554 19795 raft_consensus.cc:385] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.913555 19808 consensus_queue.cc:1048] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.914242 19795 raft_consensus.cc:740] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.915391 19795 consensus_queue.cc:260] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.918481 19795 ts_tablet_manager.cc:1434] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:13:09.918754 19794 tablet_bootstrap.cc:654] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.919865 19795 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:09.928525 19796 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:09.929070 19795 tablet_bootstrap.cc:654] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.931118 19796 ts_tablet_manager.cc:1403] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.002s
I20260709 12:13:09.935491 19796 raft_consensus.cc:359] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.936345 19796 raft_consensus.cc:385] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.936691 19796 raft_consensus.cc:740] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.937983 19796 consensus_queue.cc:260] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.947342 19796 ts_tablet_manager.cc:1434] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:13:09.949038 19796 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:09.949631 19811 consensus_queue.cc:1048] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.956352 19794 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:09.957026 19794 ts_tablet_manager.cc:1403] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.000s
I20260709 12:13:09.961110 19794 raft_consensus.cc:359] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.962611 19794 raft_consensus.cc:385] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.962941 19794 raft_consensus.cc:740] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.963805 19794 consensus_queue.cc:260] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.965113 19796 tablet_bootstrap.cc:654] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.967092 19794 ts_tablet_manager.cc:1434] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.006s
I20260709 12:13:09.968437 19794 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:09.970969 19798 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:09.971576 19798 ts_tablet_manager.cc:1403] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.014s
I20260709 12:13:09.974411 19795 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:09.975023 19795 ts_tablet_manager.cc:1403] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.013s
I20260709 12:13:09.976001 19857 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.975880 19794 tablet_bootstrap.cc:654] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.981523 19811 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.982196 19811 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:09.982478 19798 raft_consensus.cc:359] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.983198 19798 raft_consensus.cc:385] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.983577 19798 raft_consensus.cc:740] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.984362 19798 consensus_queue.cc:260] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:09.990761 19795 raft_consensus.cc:359] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.991623 19795 raft_consensus.cc:385] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.991907 19795 raft_consensus.cc:740] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.993980 19795 consensus_queue.cc:260] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:09.996994 19795 ts_tablet_manager.cc:1434] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:13:09.996795 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:09.997653 19675 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:09.998242 19795 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.000571 19565 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:10.001600 19856 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.002043 19856 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.002422 19796 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.003024 19796 ts_tablet_manager.cc:1403] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.002s
I20260709 12:13:10.002424 19856 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.006379 19798 ts_tablet_manager.cc:1434] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:13:10.006608 19796 raft_consensus.cc:359] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.007442 19796 raft_consensus.cc:385] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.007650 19798 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:10.007789 19796 raft_consensus.cc:740] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.008744 19796 consensus_queue.cc:260] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.012830 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.013842 19747 raft_consensus.cc:3060] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.014812 19566 leader_election.cc:343] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.984751 19811 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.015750 19798 tablet_bootstrap.cc:654] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.019110 19795 tablet_bootstrap.cc:654] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.020437 19856 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.029573 19953 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.032752 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.035801 19673 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.039779 19795 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:10.040412 19795 ts_tablet_manager.cc:1403] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.003s
I20260709 12:13:10.043465 19795 raft_consensus.cc:359] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.044185 19795 raft_consensus.cc:385] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.044485 19795 raft_consensus.cc:740] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.045823 19673 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.045994 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.047286 19565 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:10.029172 19811 consensus_queue.cc:1048] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.048046 19798 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
W20260709 12:13:10.048205 19566 leader_election.cc:343] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.048740 19798 ts_tablet_manager.cc:1403] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.006s
I20260709 12:13:10.051892 19798 raft_consensus.cc:359] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.052654 19798 raft_consensus.cc:385] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.052937 19798 raft_consensus.cc:740] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.055735 19795 consensus_queue.cc:260] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.056766 19953 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.057526 19856 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.058524 19796 ts_tablet_manager.cc:1434] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:13:10.058804 19795 ts_tablet_manager.cc:1434] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:13:10.060031 19795 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.060204 19796 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.061897 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:10.063642 19565 leader_election.cc:343] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.064109 19921 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.064682 19921 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.053794 19798 consensus_queue.cc:260] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.049935 19811 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.065310 19953 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.067377 19921 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.067845 19798 ts_tablet_manager.cc:1434] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:13:10.067924 19811 raft_consensus.cc:697] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:10.069154 19798 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:10.069018 19811 consensus_queue.cc:237] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.069603 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.070518 19748 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:10.072932 19491 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.073648 19856 raft_consensus.cc:493] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.074374 19856 raft_consensus.cc:515] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.075717 19921 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.076479 19921 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.077004 19921 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.079069 19856 leader_election.cc:290] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:10.075802 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.079849 19673 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:10.081595 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.082348 19523 raft_consensus.cc:2468] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:10.083588 19795 tablet_bootstrap.cc:654] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.083844 19567 leader_election.cc:304] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.087975 19953 raft_consensus.cc:2804] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.088383 19953 raft_consensus.cc:493] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.088738 19953 raft_consensus.cc:3060] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.090723 19908 raft_consensus.cc:493] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.091264 19908 raft_consensus.cc:515] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.099092 19795 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:10.099395 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.099800 19795 ts_tablet_manager.cc:1403] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
I20260709 12:13:10.099949 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.100643 19748 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
W20260709 12:13:10.101357 19641 leader_election.cc:343] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.102288 19908 leader_election.cc:290] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.103691 19795 raft_consensus.cc:359] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.104544 19795 raft_consensus.cc:385] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.104836 19795 raft_consensus.cc:740] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.082541 19798 tablet_bootstrap.cc:654] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.105459 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.105966 19795 consensus_queue.cc:260] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.106384 19748 raft_consensus.cc:2468] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:10.108713 19795 ts_tablet_manager.cc:1434] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:10.107828 19953 raft_consensus.cc:515] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.132541 19796 tablet_bootstrap.cc:654] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.133397 19795 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.109475 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.138101 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:10.120401 19887 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.143225 19887 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.125168 19857 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:13:10.146648 19795 tablet_bootstrap.cc:654] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.142455 19523 raft_consensus.cc:3060] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.108158 19921 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.155995 19921 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.157263 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.157982 19674 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.158638 19887 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.160658 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:10.162912 19491 leader_election.cc:343] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.163237 19908 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.163748 19908 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.164148 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.164625 19523 raft_consensus.cc:2468] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.110343 19566 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:10.166370 19856 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.166213 19567 leader_election.cc:304] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.166826 19856 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.167255 19856 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.167536 19949 raft_consensus.cc:2804] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.168048 19949 raft_consensus.cc:697] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:10.168854 19949 consensus_queue.cc:237] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.169898 19908 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.178905 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.179668 19749 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.184780 19490 leader_election.cc:343] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.185379 19490 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.186548 19674 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:10.186646 19857 raft_consensus.cc:2749] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.191265 19490 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.192118 19857 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.192626 19857 raft_consensus.cc:697] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:10.193490 19857 consensus_queue.cc:237] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.193976 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.194811 19856 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:10.195871 19641 leader_election.cc:343] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:10.173921 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 63716.8us
I20260709 12:13:10.195897 19749 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:10.200848 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.201501 19745 raft_consensus.cc:3060] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.205876 19856 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.212342 19798 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:10.212983 19798 ts_tablet_manager.cc:1403] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.144s	user 0.036s	sys 0.016s
W20260709 12:13:10.213117 19639 leader_election.cc:343] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.213204 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.216265 19798 raft_consensus.cc:359] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.217093 19798 raft_consensus.cc:385] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.142376 19953 leader_election.cc:290] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:10.217391 19798 raft_consensus.cc:740] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.217689 19799 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.217860 19565 leader_election.cc:343] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.218295 19799 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.219416 19798 consensus_queue.cc:260] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.222110 19798 ts_tablet_manager.cc:1434] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:13:10.214011 19639 leader_election.cc:304] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.229104 19799 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.216163 19745 raft_consensus.cc:2468] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.244629 19798 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:10.230903 19857 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.251147 19857 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.254199 19809 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.242997 19912 raft_consensus.cc:2749] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.254974 19857 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.254793 19809 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.257069 19809 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:10.257253 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.257954 19522 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:10.259033 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.254505 19811 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.264528 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.265405 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.266736 19796 tablet_bootstrap.cc:492] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.267264 19796 ts_tablet_manager.cc:1403] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.207s	user 0.028s	sys 0.046s
I20260709 12:13:10.268263 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.270282 19796 raft_consensus.cc:359] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.271000 19796 raft_consensus.cc:385] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.271278 19796 raft_consensus.cc:740] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.271293 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.272084 19675 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:10.272257 19796 consensus_queue.cc:260] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.273602 19490 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.274947 19796 ts_tablet_manager.cc:1434] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:10.275301 19921 raft_consensus.cc:2804] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.275727 19921 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.276051 19796 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.276094 19921 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.276544 19795 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:10.277055 19795 ts_tablet_manager.cc:1403] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.002s
W20260709 12:13:10.278352 19490 leader_election.cc:343] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.280187 19795 raft_consensus.cc:359] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.280900 19795 raft_consensus.cc:385] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.281176 19795 raft_consensus.cc:740] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
W20260709 12:13:10.284759 19639 leader_election.cc:343] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.275938 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.287241 19887 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:10.288662 19641 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:10.292657 19796 tablet_bootstrap.cc:654] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.293109 19857 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.293735 19912 raft_consensus.cc:2804] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.293678 19857 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.294255 19912 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.294629 19912 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.296113 19857 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:10.298890 19490 leader_election.cc:343] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.281988 19811 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.301323 19601 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:10.301365 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:10.304884 19491 leader_election.cc:343] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.306237 19491 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.306350 19423 catalog_manager.cc:5697] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.305657 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.283177 19795 consensus_queue.cc:260] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.307401 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:10.313683 19490 leader_election.cc:343] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.314851 19887 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.317354 19639 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.319533 19794 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:10.319970 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.320276 19794 ts_tablet_manager.cc:1403] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.352s	user 0.030s	sys 0.034s
I20260709 12:13:10.321219 19674 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:10.322535 19799 raft_consensus.cc:2804] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.317579 19795 ts_tablet_manager.cc:1434] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:13:10.309993 19811 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:10.326112 19567 leader_election.cc:343] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.324353 19799 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.326699 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.326771 19799 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.326839 19565 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.329181 19811 raft_consensus.cc:2804] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.307567 19809 raft_consensus.cc:2749] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.329656 19811 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.324282 19794 raft_consensus.cc:359] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.331096 19794 raft_consensus.cc:385] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.313252 19745 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.332542 19794 raft_consensus.cc:740] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.333899 19795 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.336107 19794 consensus_queue.cc:260] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.338896 19921 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.331574 19811 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.342514 19794 ts_tablet_manager.cc:1434] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 12:13:10.350025 19795 tablet_bootstrap.cc:654] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.353178 19794 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:10.353940 19424 catalog_manager.cc:5697] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.357966 19921 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:10.356526 19796 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.359157 19796 ts_tablet_manager.cc:1403] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.012s
I20260709 12:13:10.359283 19424 catalog_manager.cc:5697] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.370993 19949 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.371567 19949 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.376259 19949 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:10.369699 19491 leader_election.cc:343] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.377197 19491 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.371009 19798 tablet_bootstrap.cc:654] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.389683 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.390504 19749 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:10.395912 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.396667 19674 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:10.392257 19566 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.400460 19949 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.400944 19949 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.401350 19949 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.393643 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 68820.2us
I20260709 12:13:10.410411 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.380725 19921 raft_consensus.cc:2749] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.415113 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.421784 19796 raft_consensus.cc:359] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.422626 19796 raft_consensus.cc:385] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.422932 19796 raft_consensus.cc:740] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.423219 19808 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.423727 19808 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.426245 19808 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:10.427390 19912 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.428025 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.428735 19673 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:10.430464 19713 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.432448 19808 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.432559 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.433130 19808 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.433933 19808 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.423667 19796 consensus_queue.cc:260] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:10.438530 19715 leader_election.cc:343] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.440008 19921 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.440604 19921 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:10.440647 19490 leader_election.cc:343] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.446457 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.447211 19747 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:10.448580 19491 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.445775 19796 ts_tablet_manager.cc:1434] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.001s
I20260709 12:13:10.453467 19796 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.461655 19674 raft_consensus.cc:2393] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:10.478319 19794 tablet_bootstrap.cc:654] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.467347 19921 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.470147 19966 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.478374 19799 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.482991 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:10.483851 19522 raft_consensus.cc:2393] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:10.484789 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.487625 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:10.486372 19966 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.485808 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.484084 19799 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:10.493019 19641 leader_election.cc:343] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.493311 19796 tablet_bootstrap.cc:654] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:10.494153 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:10.492430 19811 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.507704 19600 raft_consensus.cc:2393] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:10.510113 19639 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.511405 19799 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.515383 19490 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:10.524433 19857 raft_consensus.cc:2749] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.525058 19799 raft_consensus.cc:493] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.525687 19799 raft_consensus.cc:515] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:10.526412 19490 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.527722 19798 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:10.528268 19798 ts_tablet_manager.cc:1403] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.305s	user 0.015s	sys 0.003s
I20260709 12:13:10.529780 19857 raft_consensus.cc:493] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.530290 19857 raft_consensus.cc:515] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.530681 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.531435 19747 raft_consensus.cc:2468] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:10.531567 19798 raft_consensus.cc:359] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.532306 19798 raft_consensus.cc:385] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.532588 19798 raft_consensus.cc:740] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.532918 19857 leader_election.cc:290] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.533298 19798 consensus_queue.cc:260] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.498852 19966 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.536229 19798 ts_tablet_manager.cc:1434] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:10.538275 19798 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:10.544570 19795 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:10.545318 19795 ts_tablet_manager.cc:1403] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.212s	user 0.032s	sys 0.029s
I20260709 12:13:10.536167 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.542433 19799 leader_election.cc:290] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.567345 19745 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.568588 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.570027 19566 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
W20260709 12:13:10.570703 19491 leader_election.cc:343] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.571879 19859 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.570734 19640 leader_election.cc:304] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.572523 19859 raft_consensus.cc:697] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:10.564424 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.573482 19859 consensus_queue.cc:237] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.560581 19808 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.575850 19794 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:10.576779 19809 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:10.576459 19794 ts_tablet_manager.cc:1403] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.226s	user 0.037s	sys 0.022s
I20260709 12:13:10.586062 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.588883 19794 raft_consensus.cc:359] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.589833 19794 raft_consensus.cc:385] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.590426 19794 raft_consensus.cc:740] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.577075 19808 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:10.579070 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.592392 19674 raft_consensus.cc:2393] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
W20260709 12:13:10.592748 19968 log.cc:927] Time spent T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:10.556638 19912 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.583405 19798 tablet_bootstrap.cc:654] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.591199 19794 consensus_queue.cc:260] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.577819 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.578682 19908 raft_consensus.cc:2804] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.581820 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:10.577886 19811 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:10.581156 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:10.582455 19639 leader_election.cc:343] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:10.591176 19490 leader_election.cc:343] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.601922 19908 raft_consensus.cc:493] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.593608 19953 consensus_queue.cc:1048] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:10.605327 19794 ts_tablet_manager.cc:1434] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:13:10.606976 19796 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.603375 19673 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.616226 19796 ts_tablet_manager.cc:1403] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.163s	user 0.027s	sys 0.026s
I20260709 12:13:10.616302 19794 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:10.610263 19908 raft_consensus.cc:3060] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.605510 19949 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:10.618090 19715 leader_election.cc:343] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:10.625003 19567 leader_election.cc:343] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.630440 19567 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.631179 19859 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.634923 19972 raft_consensus.cc:493] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.635589 19972 raft_consensus.cc:515] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.616633 19490 leader_election.cc:304] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.656900 19809 raft_consensus.cc:2749] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:10.663008 19566 consensus_peers.cc:597] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 -> Peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Couldn't send request to peer df754e24c604440998ec5ed4153e9925. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.664348 19795 raft_consensus.cc:359] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.665279 19795 raft_consensus.cc:385] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.665668 19795 raft_consensus.cc:740] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.666623 19795 consensus_queue.cc:260] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.673223 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89165741a8b41d0981531ad0cfb5b20" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:10.673712 19972 leader_election.cc:290] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.675098 19795 ts_tablet_manager.cc:1434] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.000s
I20260709 12:13:10.676074 19795 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.674108 19526 raft_consensus.cc:2468] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
W20260709 12:13:10.673326 19639 leader_election.cc:343] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.678649 19639 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.679150 19641 leader_election.cc:304] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.680043 19796 raft_consensus.cc:359] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.680877 19796 raft_consensus.cc:385] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.681133 19796 raft_consensus.cc:740] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
W20260709 12:13:10.670800 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 79668.9us
I20260709 12:13:10.684077 19796 consensus_queue.cc:260] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.686282 19796 ts_tablet_manager.cc:1434] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:13:10.686594 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:10.687198 19798 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:10.687963 19798 ts_tablet_manager.cc:1403] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.150s	user 0.028s	sys 0.010s
I20260709 12:13:10.688721 19949 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.689404 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.687314 19796 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.690091 19745 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.687137 19799 raft_consensus.cc:2804] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.691046 19799 raft_consensus.cc:493] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.691418 19799 raft_consensus.cc:3060] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.684224 19912 raft_consensus.cc:2749] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.693574 19953 consensus_queue.cc:1048] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.700258 19798 raft_consensus.cc:359] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.701088 19798 raft_consensus.cc:385] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.701421 19798 raft_consensus.cc:740] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.701149 19908 raft_consensus.cc:515] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.702183 19798 consensus_queue.cc:260] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.702628 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89165741a8b41d0981531ad0cfb5b20" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.687233 19674 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.704341 19745 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.705791 19566 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.707250 19859 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.707764 19859 raft_consensus.cc:697] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:10.708717 19859 consensus_queue.cc:237] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:10.718134 19973 log.cc:927] Time spent T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:13:10.725227 19794 tablet_bootstrap.cc:654] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.725435 19798 ts_tablet_manager.cc:1434] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:13:10.726758 19798 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:10.731043 19908 leader_election.cc:290] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:10.718233 19639 leader_election.cc:343] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.732045 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.732708 19748 raft_consensus.cc:3060] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.733516 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.721516 19420 catalog_manager.cc:5697] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.738224 19966 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.740291 19798 tablet_bootstrap.cc:654] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.742028 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.742712 19600 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.747176 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:10.747884 19747 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.750401 19796 tablet_bootstrap.cc:654] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.756371 19600 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:10.758080 19674 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:10.759430 19490 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.760766 19809 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.761240 19809 raft_consensus.cc:697] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:10.762173 19809 consensus_queue.cc:237] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.772042 19799 raft_consensus.cc:515] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.779811 19799 leader_election.cc:290] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.784061 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89165741a8b41d0981531ad0cfb5b20" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:10.786201 19526 raft_consensus.cc:3060] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.784951 19859 consensus_queue.cc:1048] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:10.749657 19966 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:10.802793 19423 catalog_manager.cc:5697] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.793486 19748 raft_consensus.cc:2468] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:10.813499 19526 raft_consensus.cc:2468] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:10.831631 19798 tablet_bootstrap.cc:492] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:10.832271 19798 ts_tablet_manager.cc:1403] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.031s
I20260709 12:13:10.833431 19640 leader_election.cc:304] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:10.834408 19794 tablet_bootstrap.cc:492] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:10.835050 19794 ts_tablet_manager.cc:1403] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.224s	user 0.022s	sys 0.001s
I20260709 12:13:10.837036 19673 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:10.838627 19713 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:10.839362 19747 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:10.839457 19808 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.840155 19808 raft_consensus.cc:697] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:10.840066 19641 leader_election.cc:304] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:10.841128 19972 raft_consensus.cc:2804] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.841212 19808 consensus_queue.cc:237] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:10.841815 19972 raft_consensus.cc:697] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:10.842684 19972 consensus_queue.cc:237] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.843237 19912 raft_consensus.cc:2804] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.843721 19795 tablet_bootstrap.cc:654] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.843823 19912 raft_consensus.cc:697] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:10.844810 19912 consensus_queue.cc:237] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.846015 19420 catalog_manager.cc:5697] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:10.847033 19639 leader_election.cc:343] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.849341 19798 raft_consensus.cc:359] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.851302 19798 raft_consensus.cc:385] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.851621 19798 raft_consensus.cc:740] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.853370 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89165741a8b41d0981531ad0cfb5b20" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:10.854480 19798 consensus_queue.cc:260] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.856046 19794 raft_consensus.cc:359] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.858144 19794 raft_consensus.cc:385] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.859028 19794 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.852530 19809 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:10.865269 19798 ts_tablet_manager.cc:1434] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 12:13:10.866597 19798 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
W20260709 12:13:10.871675 19639 leader_election.cc:343] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.875223 19794 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.888959 19794 ts_tablet_manager.cc:1434] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:13:10.891702 19794 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:10.907893 19794 tablet_bootstrap.cc:654] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.915423 19796 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.916038 19798 tablet_bootstrap.cc:654] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.916064 19796 ts_tablet_manager.cc:1403] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.229s	user 0.021s	sys 0.005s
I20260709 12:13:10.925451 19796 raft_consensus.cc:359] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.926229 19796 raft_consensus.cc:385] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.926509 19796 raft_consensus.cc:740] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.927284 19796 consensus_queue.cc:260] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:10.926537 19420 catalog_manager.cc:5697] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.919229 19795 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:10.930132 19796 ts_tablet_manager.cc:1434] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:10.930514 19795 ts_tablet_manager.cc:1403] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.255s	user 0.014s	sys 0.008s
I20260709 12:13:10.931253 19796 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.941855 19796 tablet_bootstrap.cc:654] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.936546 19795 raft_consensus.cc:359] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.943794 19795 raft_consensus.cc:385] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.944325 19795 raft_consensus.cc:740] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.945436 19795 consensus_queue.cc:260] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:10.947649 19795 ts_tablet_manager.cc:1434] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:13:10.948216 19794 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:10.948694 19795 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:10.948824 19794 ts_tablet_manager.cc:1403] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.013s
I20260709 12:13:10.958179 19811 raft_consensus.cc:493] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.958844 19811 raft_consensus.cc:515] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.959749 19798 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:10.958504 19794 raft_consensus.cc:359] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.960243 19794 raft_consensus.cc:385] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.960353 19798 ts_tablet_manager.cc:1403] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.001s
I20260709 12:13:10.960521 19799 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.961369 19811 leader_election.cc:290] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.960654 19794 raft_consensus.cc:740] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.962437 19794 consensus_queue.cc:260] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.962850 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.963685 19749 raft_consensus.cc:2393] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:10.964803 19794 ts_tablet_manager.cc:1434] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:13:10.965888 19794 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:10.961158 19799 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.968209 19799 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:10.968590 19796 tablet_bootstrap.cc:492] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:10.969115 19796 ts_tablet_manager.cc:1403] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 12:13:10.969913 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:10.971206 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:10.972199 19796 raft_consensus.cc:359] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.972898 19796 raft_consensus.cc:385] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.973162 19796 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.973850 19796 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:10.976086 19796 ts_tablet_manager.cc:1434] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:10.976194 19566 leader_election.cc:304] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.977075 19796 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:10.978204 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:10.979086 19749 raft_consensus.cc:2393] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:10.980382 19640 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:10.982934 19912 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.984400 19794 tablet_bootstrap.cc:654] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.984577 19953 raft_consensus.cc:3060] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.992610 19424 catalog_manager.cc:5697] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.994066 19796 tablet_bootstrap.cc:654] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.995173 19424 catalog_manager.cc:5697] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.011353 19798 raft_consensus.cc:359] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.015189 19798 raft_consensus.cc:385] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.015491 19798 raft_consensus.cc:740] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.016258 19798 consensus_queue.cc:260] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.012871 19912 raft_consensus.cc:2749] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.998523 19953 raft_consensus.cc:2749] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.020318 19794 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:11.020773 19798 ts_tablet_manager.cc:1434] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.005s
I20260709 12:13:11.020896 19794 ts_tablet_manager.cc:1403] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.003s
I20260709 12:13:11.030828 19794 raft_consensus.cc:359] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.032253 19794 raft_consensus.cc:385] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.032473 19798 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:11.032608 19794 raft_consensus.cc:740] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.033828 19953 raft_consensus.cc:493] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.033689 19794 consensus_queue.cc:260] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.034361 19953 raft_consensus.cc:515] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.036654 19953 leader_election.cc:290] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.038522 19794 ts_tablet_manager.cc:1434] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:13:11.039628 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.041013 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.041740 19522 raft_consensus.cc:2468] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:11.041937 19796 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:11.042459 19796 ts_tablet_manager.cc:1403] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.001s
I20260709 12:13:11.043289 19567 leader_election.cc:304] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.043812 19798 tablet_bootstrap.cc:654] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.044323 19953 raft_consensus.cc:2804] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.044739 19953 raft_consensus.cc:493] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.045076 19953 raft_consensus.cc:3060] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.045869 19796 raft_consensus.cc:359] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.046576 19796 raft_consensus.cc:385] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.046833 19796 raft_consensus.cc:740] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.047539 19796 consensus_queue.cc:260] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.049758 19796 ts_tablet_manager.cc:1434] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 12:13:11.050338 19566 leader_election.cc:343] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.050777 19796 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:11.031332 19795 tablet_bootstrap.cc:654] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.058259 19796 tablet_bootstrap.cc:654] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.059108 19811 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.065362 19798 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:11.067204 19798 ts_tablet_manager.cc:1403] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.011s
I20260709 12:13:11.068145 19949 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.070889 19795 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:11.070686 19798 raft_consensus.cc:359] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.071398 19795 ts_tablet_manager.cc:1403] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.004s
I20260709 12:13:11.071410 19798 raft_consensus.cc:385] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.072817 19798 raft_consensus.cc:740] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.073518 19798 consensus_queue.cc:260] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.075070 19949 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.075519 19949 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.078956 19798 ts_tablet_manager.cc:1434] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:11.080029 19798 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:11.084728 19949 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:11.079675 19795 raft_consensus.cc:359] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.085477 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.089128 19796 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:11.094695 19795 raft_consensus.cc:385] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.095064 19796 ts_tablet_manager.cc:1403] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.005s
I20260709 12:13:11.039633 19794 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:11.098045 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.091080 19798 tablet_bootstrap.cc:654] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.101747 19808 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.104873 19808 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.105887 19673 raft_consensus.cc:2468] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:11.077459 19953 raft_consensus.cc:515] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.107208 19565 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:11.108132 19811 raft_consensus.cc:2804] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.108325 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.108579 19811 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.109045 19811 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.109110 19674 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:11.110641 19713 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:11.111645 19877 raft_consensus.cc:2804] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.112135 19877 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.112469 19877 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.095032 19795 raft_consensus.cc:740] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.113493 19794 tablet_bootstrap.cc:654] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.114270 19795 consensus_queue.cc:260] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.119946 19795 ts_tablet_manager.cc:1434] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:13:11.121023 19795 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:11.123708 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:11.124677 19522 raft_consensus.cc:3060] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.124742 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:11.125495 19749 raft_consensus.cc:3060] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.133710 19953 leader_election.cc:290] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.134837 19808 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.136003 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.136780 19526 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:11.138123 19522 raft_consensus.cc:2468] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.147123 19567 leader_election.cc:304] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.148468 19953 raft_consensus.cc:2804] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.149029 19953 raft_consensus.cc:697] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:11.150324 19798 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:11.149948 19953 consensus_queue.cc:237] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.150898 19798 ts_tablet_manager.cc:1403] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.011s
I20260709 12:13:11.151604 19795 tablet_bootstrap.cc:654] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.139503 19877 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:11.141671 19566 leader_election.cc:343] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.154027 19798 raft_consensus.cc:359] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.154767 19798 raft_consensus.cc:385] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.155055 19798 raft_consensus.cc:740] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.143567 19749 raft_consensus.cc:2468] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.098330 19796 raft_consensus.cc:359] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.155680 19796 raft_consensus.cc:385] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.156015 19796 raft_consensus.cc:740] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.155764 19798 consensus_queue.cc:260] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.156500 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:11.157106 19674 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.156810 19796 consensus_queue.cc:260] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.158813 19798 ts_tablet_manager.cc:1434] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:11.160418 19796 ts_tablet_manager.cc:1434] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.001s
I20260709 12:13:11.161782 19796 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:11.163354 19794 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:11.163868 19794 ts_tablet_manager.cc:1403] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.009s
I20260709 12:13:11.139016 19811 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.167866 19794 raft_consensus.cc:359] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.168581 19794 raft_consensus.cc:385] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.168843 19794 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.169212 19796 tablet_bootstrap.cc:654] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.169225 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:11.169973 19673 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.169590 19794 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.178722 19798 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:11.186556 19798 tablet_bootstrap.cc:654] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.190959 19674 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:11.193866 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:11.195091 19713 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:11.178194 19673 raft_consensus.cc:2468] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.197413 19565 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:11.197957 19808 raft_consensus.cc:2804] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.199626 20001 raft_consensus.cc:2804] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.200177 20001 raft_consensus.cc:697] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:11.201103 20001 consensus_queue.cc:237] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.202576 19795 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:11.202869 19949 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.203276 19795 ts_tablet_manager.cc:1403] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.001s
W20260709 12:13:11.206028 19566 leader_election.cc:343] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.192713 19796 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:11.193732 19798 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:11.209527 19798 ts_tablet_manager.cc:1403] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 12:13:11.209302 19794 ts_tablet_manager.cc:1434] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:13:11.211452 19794 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:11.214586 19796 ts_tablet_manager.cc:1403] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.015s
I20260709 12:13:11.217875 19798 raft_consensus.cc:359] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.222499 19798 raft_consensus.cc:385] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.222980 19798 raft_consensus.cc:740] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.224802 19795 raft_consensus.cc:359] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.225870 19795 raft_consensus.cc:385] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.226145 19795 raft_consensus.cc:740] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.203438 19949 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.234078 19949 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.195091 19811 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:11.236680 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.235940 19795 consensus_queue.cc:260] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:11.238921 19567 leader_election.cc:343] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.240535 19795 ts_tablet_manager.cc:1434] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:13:11.217453 19859 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:13:11.242082 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.229286 19798 consensus_queue.cc:260] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.246075 19795 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:11.261085 19795 tablet_bootstrap.cc:654] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.261906 19859 raft_consensus.cc:493] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.262606 19859 raft_consensus.cc:515] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.266933 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.267915 19522 raft_consensus.cc:2468] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:11.268960 19748 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.269945 19567 leader_election.cc:304] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.272363 20001 raft_consensus.cc:2804] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.272845 20001 raft_consensus.cc:493] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.273247 20001 raft_consensus.cc:3060] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.277683 19639 consensus_peers.cc:597] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:11.282792 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.286099 19424 catalog_manager.cc:5697] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.299885 19877 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.300235 19796 raft_consensus.cc:359] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.300993 19796 raft_consensus.cc:385] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.301249 19796 raft_consensus.cc:740] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.301503 19877 raft_consensus.cc:493] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.288782 19859 leader_election.cc:290] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.306569 19798 ts_tablet_manager.cc:1434] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.000s
I20260709 12:13:11.314653 19798 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:11.309057 19794 tablet_bootstrap.cc:654] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.326246 19796 consensus_queue.cc:260] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.312409 19811 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:11.334466 19796 ts_tablet_manager.cc:1434] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 12:13:11.335660 19796 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:11.332620 19949 raft_consensus.cc:493] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.319917 19808 raft_consensus.cc:697] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:11.339111 19949 raft_consensus.cc:515] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.330344 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:11.326642 19566 leader_election.cc:343] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.322311 19877 raft_consensus.cc:515] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.352550 19522 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.369972 19808 consensus_queue.cc:237] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.352288 19566 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:11.376289 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 52340.5us
W20260709 12:13:11.377355 19566 leader_election.cc:343] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.378291 20013 consensus_queue.cc:1048] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.379415 19972 consensus_queue.cc:1048] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.401377 19798 tablet_bootstrap.cc:654] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.383412 19949 leader_election.cc:290] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.411298 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.428474 19526 raft_consensus.cc:2468] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:11.421583 19966 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.429703 19966 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.423115 19809 consensus_queue.cc:1048] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.432132 19795 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:11.387137 19859 raft_consensus.cc:2749] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.433789 19795 ts_tablet_manager.cc:1403] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.188s	user 0.027s	sys 0.013s
I20260709 12:13:11.441154 19796 tablet_bootstrap.cc:654] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.450327 19567 leader_election.cc:304] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.449036 19972 consensus_queue.cc:1048] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:11.451814 20001 raft_consensus.cc:515] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.452461 19420 catalog_manager.cc:5697] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.455241 19949 raft_consensus.cc:2804] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.455837 19949 raft_consensus.cc:493] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.456290 19949 raft_consensus.cc:3060] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.442896 19966 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:11.462004 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.463002 19745 raft_consensus.cc:2468] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:11.463327 19877 leader_election.cc:290] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:11.479063 20001 leader_election.cc:290] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.483443 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.484675 19673 raft_consensus.cc:2393] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:11.488688 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.489650 19600 raft_consensus.cc:2393] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:11.490602 19972 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.491982 19972 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.492255 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:11.494627 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:11.495175 19972 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:11.495311 19526 raft_consensus.cc:3060] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.514953 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:11.516851 19639 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:11.517760 19566 leader_election.cc:343] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:11.475347 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 46648.9us
W20260709 12:13:11.526157 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 47923.9us
I20260709 12:13:11.485312 19522 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:11.538209 19424 catalog_manager.cc:5697] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.534607 19526 raft_consensus.cc:2468] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.539161 20017 consensus_queue.cc:1048] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:11.554243 19567 leader_election.cc:304] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:11.555182 20019 raft_consensus.cc:2804] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.560560 20019 raft_consensus.cc:697] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:11.561591 20019 consensus_queue.cc:237] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.563987 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.562089 19798 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:11.566166 19798 ts_tablet_manager.cc:1403] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.252s	user 0.015s	sys 0.006s
I20260709 12:13:11.572556 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.574343 19798 raft_consensus.cc:359] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.575131 19798 raft_consensus.cc:385] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.575481 19798 raft_consensus.cc:740] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.576227 19798 consensus_queue.cc:260] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.578190 19795 raft_consensus.cc:359] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.579361 19795 raft_consensus.cc:385] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.579805 19795 raft_consensus.cc:740] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.583884 19912 consensus_queue.cc:1048] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:11.585033 19641 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.590090 19795 consensus_queue.cc:260] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.591356 20010 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:11.594298 20010 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.595803 19526 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.597506 20010 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:11.598191 19796 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:11.606071 19796 ts_tablet_manager.cc:1403] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.004s
I20260709 12:13:11.599655 20013 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.610193 20013 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.612555 20013 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.590888 19641 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:11.614464 19796 raft_consensus.cc:359] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.615967 19796 raft_consensus.cc:385] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.617592 19972 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.617764 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.623473 19490 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:11.626752 20017 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.627868 19809 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.632869 19809 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.635587 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.635860 20017 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.616196 19796 raft_consensus.cc:740] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.629745 20001 consensus_queue.cc:1048] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.631767 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.638581 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:11.641012 19713 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.643529 19798 ts_tablet_manager.cc:1434] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.002s
I20260709 12:13:11.645848 19794 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:11.650414 19794 ts_tablet_manager.cc:1403] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.439s	user 0.019s	sys 0.022s
I20260709 12:13:11.651755 19798 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:11.648182 19795 ts_tablet_manager.cc:1434] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.213s	user 0.006s	sys 0.001s
I20260709 12:13:11.648182 19713 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:11.642272 19949 raft_consensus.cc:515] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.654480 20010 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:11.644760 20017 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:11.645591 19796 consensus_queue.cc:260] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.656332 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:11.655870 19794 raft_consensus.cc:359] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.657673 19794 raft_consensus.cc:385] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.658120 19794 raft_consensus.cc:740] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.659101 19748 raft_consensus.cc:3060] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.659971 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:11.660656 19520 raft_consensus.cc:3060] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.664538 19794 consensus_queue.cc:260] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.668388 20010 consensus_queue.cc:1048] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.667034 19949 leader_election.cc:290] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.670946 19600 raft_consensus.cc:2393] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
W20260709 12:13:11.684132 19715 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.684892 19715 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:11.689893 19809 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:11.690270 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:11.692701 19794 ts_tablet_manager.cc:1434] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:13:11.693248 19796 ts_tablet_manager.cc:1434] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 12:13:11.694315 19794 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:11.703477 19796 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:11.700294 20010 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.702736 19809 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.712281 19949 consensus_queue.cc:1048] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:11.724735 19796 tablet_bootstrap.cc:654] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.724838 20013 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.725466 20013 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.727747 19795 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:11.729756 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.730108 19522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:11.731611 19713 leader_election.cc:343] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.733855 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.735551 19524 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:11.737708 19715 leader_election.cc:304] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:11.739892 20013 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.741416 19715 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:11.743176 19794 tablet_bootstrap.cc:654] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.743605 20013 raft_consensus.cc:2804] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.744029 20013 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.744421 20013 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.707355 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 84012.6us
I20260709 12:13:11.748368 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.752453 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.753203 19673 raft_consensus.cc:2468] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:11.755122 19490 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:11.745450 19795 tablet_bootstrap.cc:654] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.765954 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.771283 19490 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.776141 19420 catalog_manager.cc:5697] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.793341 20027 raft_consensus.cc:2804] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.802006 19520 raft_consensus.cc:2468] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.820721 20027 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:11.835682 19490 leader_election.cc:343] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.837461 19877 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:11.844569 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:11.844694 19877 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.848207 19794 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:11.848225 19877 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:11.848881 19794 ts_tablet_manager.cc:1403] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.155s	user 0.031s	sys 0.016s
I20260709 12:13:11.848351 19748 raft_consensus.cc:2468] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:11.849649 20010 raft_consensus.cc:2749] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:11.849738 19566 consensus_peers.cc:597] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 -> Peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Couldn't send request to peer df754e24c604440998ec5ed4153e9925. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:11.837000 20027 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.856051 19796 tablet_bootstrap.cc:492] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:11.856657 19796 ts_tablet_manager.cc:1403] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.001s
I20260709 12:13:11.856688 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.860035 19598 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:11.860785 19796 raft_consensus.cc:359] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.861521 19713 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:11.862589 20010 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.862982 20010 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.863328 20010 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.864149 19567 leader_election.cc:304] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:11.865325 20001 raft_consensus.cc:2804] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.865854 20001 raft_consensus.cc:697] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:11.866839 20001 consensus_queue.cc:237] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.861781 19796 raft_consensus.cc:385] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.871169 19796 raft_consensus.cc:740] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.877760 19796 consensus_queue.cc:260] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.883158 19794 raft_consensus.cc:359] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.883816 19794 raft_consensus.cc:385] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.884068 19794 raft_consensus.cc:740] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.885468 19794 consensus_queue.cc:260] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.891993 19794 ts_tablet_manager.cc:1434] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.003s
I20260709 12:13:11.881063 20019 consensus_queue.cc:1048] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:13:11.897884 19796 ts_tablet_manager.cc:1434] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.005s
W20260709 12:13:11.892745 20034 log.cc:927] Time spent T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:11.903026 19877 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.903805 19877 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:11.907298 19809 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.911237 19796 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:11.914326 20030 raft_consensus.cc:2749] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:11.922816 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:11.911110 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:11.926244 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:11.916388 19877 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:11.930234 19713 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:11.933159 19798 tablet_bootstrap.cc:654] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.936241 20011 raft_consensus.cc:2749] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.952296 20013 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:11.969892 19798 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:11.974731 20010 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:11.979835 20010 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:11.970865 19798 ts_tablet_manager.cc:1403] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.319s	user 0.024s	sys 0.004s
I20260709 12:13:11.980901 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:11.981688 19598 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.989842 20013 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:11.907353 20027 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:11.990509 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:11.991238 19675 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.993922 19715 leader_election.cc:343] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.995347 19795 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:11.975950 19796 tablet_bootstrap.cc:654] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.999195 19794 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:12.003768 20011 consensus_queue.cc:1048] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.006415 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:12.006649 20030 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.007450 20030 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.000036 19798 raft_consensus.cc:359] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.007447 19795 ts_tablet_manager.cc:1403] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.013s
I20260709 12:13:12.009884 19798 raft_consensus.cc:385] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.010576 19798 raft_consensus.cc:740] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.011905 19798 consensus_queue.cc:260] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:12.012609 19490 leader_election.cc:343] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.009073 19675 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:12.012723 20030 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.020936 19798 ts_tablet_manager.cc:1434] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:13:12.022176 19798 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:12.032644 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:12.032871 20027 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.033455 19671 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.035352 19713 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:12.036676 20013 raft_consensus.cc:2804] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.037278 20013 raft_consensus.cc:697] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:12.038439 20013 consensus_queue.cc:237] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.041996 19795 raft_consensus.cc:359] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.044251 19794 tablet_bootstrap.cc:654] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.045706 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:12.044302 19795 raft_consensus.cc:385] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.047314 19795 raft_consensus.cc:740] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.048090 19795 consensus_queue.cc:260] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.055099 19795 ts_tablet_manager.cc:1434] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:13:12.056246 19795 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:12.055912 19423 catalog_manager.cc:5697] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:12.050732 19949 raft_consensus.cc:493] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.065284 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.064455 19949 raft_consensus.cc:515] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.069741 19798 tablet_bootstrap.cc:654] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.070935 19949 leader_election.cc:290] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.073843 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:12.076133 19490 leader_election.cc:343] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:12.076951 19567 leader_election.cc:343] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.077064 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.090298 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:12.091307 19675 raft_consensus.cc:2468] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
W20260709 12:13:12.094697 19566 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Couldn't send request to peer df754e24c604440998ec5ed4153e9925. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.097663 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.098434 19525 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.098973 19796 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:12.099539 19796 ts_tablet_manager.cc:1403] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.001s
I20260709 12:13:12.100613 19565 leader_election.cc:304] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.101787 20001 raft_consensus.cc:2804] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.102183 20001 raft_consensus.cc:493] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.102531 20001 raft_consensus.cc:3060] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.102586 19796 raft_consensus.cc:359] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.103359 19796 raft_consensus.cc:385] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.103610 19796 raft_consensus.cc:740] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.104329 19796 consensus_queue.cc:260] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.108809 19796 ts_tablet_manager.cc:1434] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:13:12.111054 19796 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:12.111764 19422 catalog_manager.cc:5697] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.123142 19795 tablet_bootstrap.cc:654] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.125053 19796 tablet_bootstrap.cc:654] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.112103 19953 consensus_queue.cc:1048] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 12:13:12.129489 19715 leader_election.cc:343] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.139289 20011 consensus_queue.cc:1048] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.150688 19598 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
W20260709 12:13:12.147153 19491 leader_election.cc:343] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.152451 19491 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:12.154821 20030 raft_consensus.cc:2749] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.156527 19713 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.158125 19877 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.158754 19877 raft_consensus.cc:697] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:12.159870 19877 consensus_queue.cc:237] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.136197 19671 raft_consensus.cc:2468] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:12.162726 19490 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:12.164294 19809 raft_consensus.cc:2804] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.164897 19809 raft_consensus.cc:697] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:12.166005 19809 consensus_queue.cc:237] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.191071 19796 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:12.191874 19796 ts_tablet_manager.cc:1403] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.010s
I20260709 12:13:12.195415 19796 raft_consensus.cc:359] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.196158 19796 raft_consensus.cc:385] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.196439 19796 raft_consensus.cc:740] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.197100 19796 consensus_queue.cc:260] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.197120 19794 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:12.198276 19794 ts_tablet_manager.cc:1403] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.006s
I20260709 12:13:12.204568 19796 ts_tablet_manager.cc:1434] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:13:12.205883 19796 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:12.207855 19794 raft_consensus.cc:359] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.208607 19794 raft_consensus.cc:385] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.208999 19794 raft_consensus.cc:740] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.209950 19794 consensus_queue.cc:260] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.212553 19796 tablet_bootstrap.cc:654] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.219218 19798 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:12.220068 19798 ts_tablet_manager.cc:1403] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.198s	user 0.029s	sys 0.032s
I20260709 12:13:12.232388 19745 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.235222 19798 raft_consensus.cc:359] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.236044 19798 raft_consensus.cc:385] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.236385 19798 raft_consensus.cc:740] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.227656 19794 ts_tablet_manager.cc:1434] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:13:12.239807 19794 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:12.238678 19798 consensus_queue.cc:260] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.179018 20001 raft_consensus.cc:515] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.260784 19859 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.261386 19859 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.263814 19859 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.265019 19795 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:12.265336 19525 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:12.265779 19798 ts_tablet_manager.cc:1434] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.007s
I20260709 12:13:12.268177 19798 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:12.269930 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:12.265883 19795 ts_tablet_manager.cc:1403] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.006s
I20260709 12:13:12.270805 19671 raft_consensus.cc:2393] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:12.271853 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.272689 19523 raft_consensus.cc:2393] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:12.275205 19795 raft_consensus.cc:359] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.275964 19795 raft_consensus.cc:385] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.276240 19795 raft_consensus.cc:740] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.281105 19422 catalog_manager.cc:5697] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.277287 19795 consensus_queue.cc:260] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.285996 20001 leader_election.cc:290] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.287398 19877 raft_consensus.cc:493] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.298610 19877 raft_consensus.cc:515] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.301049 19877 leader_election.cc:290] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.304068 19798 tablet_bootstrap.cc:654] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.289737 19794 tablet_bootstrap.cc:654] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.289948 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:12.293809 19567 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.310038 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.297968 19795 ts_tablet_manager.cc:1434] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:12.314405 19795 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:12.317924 20001 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.322912 19795 tablet_bootstrap.cc:654] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.324348 19794 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:12.325070 19794 ts_tablet_manager.cc:1403] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.005s
I20260709 12:13:12.327104 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.326599 19671 raft_consensus.cc:3060] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.328049 19525 raft_consensus.cc:3060] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.328058 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.332644 19715 leader_election.cc:304] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.332229 19424 catalog_manager.cc:5697] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.334777 20013 raft_consensus.cc:2749] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.364230 19796 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:12.364835 19796 ts_tablet_manager.cc:1403] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.008s
I20260709 12:13:12.365459 20053 consensus_queue.cc:1048] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.378348 19671 raft_consensus.cc:2468] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:12.378727 19525 raft_consensus.cc:2468] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:12.380942 19565 leader_election.cc:304] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:12.381708 19794 raft_consensus.cc:359] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.382481 19795 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:12.382591 19794 raft_consensus.cc:385] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.383092 19795 ts_tablet_manager.cc:1403] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.017s
I20260709 12:13:12.383091 19794 raft_consensus.cc:740] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.384328 19794 consensus_queue.cc:260] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.389032 20053 raft_consensus.cc:2804] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.389871 20053 raft_consensus.cc:697] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:12.390365 19796 raft_consensus.cc:359] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.388880 19795 raft_consensus.cc:359] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.391113 19796 raft_consensus.cc:385] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.391768 19796 raft_consensus.cc:740] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.391081 20053 consensus_queue.cc:237] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.392550 19796 consensus_queue.cc:260] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.391247 19795 raft_consensus.cc:385] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.393966 19795 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.394596 19795 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.399238 19795 ts_tablet_manager.cc:1434] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:13:12.399259 19794 ts_tablet_manager.cc:1434] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.074s	user 0.011s	sys 0.000s
I20260709 12:13:12.402964 19794 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:12.403973 20001 raft_consensus.cc:2749] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.407464 19796 ts_tablet_manager.cc:1434] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:13:12.409014 19796 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:12.420497 19796 tablet_bootstrap.cc:654] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.424110 19795 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:12.430709 19798 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:12.431316 19798 ts_tablet_manager.cc:1403] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.163s	user 0.026s	sys 0.014s
I20260709 12:13:12.431910 19809 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.432533 19809 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.434906 19809 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:12.436726 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:12.437577 19747 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:12.440673 19491 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:12.444271 19809 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.447482 19809 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.447902 19809 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.450374 19798 raft_consensus.cc:359] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.451519 20030 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.452075 20030 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.454552 20030 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.454424 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:12.456159 19490 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.456701 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:12.457394 19672 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:12.458878 19877 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.459432 19877 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.460846 19794 tablet_bootstrap.cc:654] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.461848 19877 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.462463 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:12.464206 19490 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.465058 19490 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:12.463505 19809 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.466435 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.467191 19523 raft_consensus.cc:2468] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:12.467057 20013 consensus_queue.cc:1048] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.468668 19795 tablet_bootstrap.cc:654] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.468770 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.469801 20030 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.470376 19715 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:12.478531 20013 raft_consensus.cc:2804] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.478964 20013 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.472705 20030 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.480118 20053 consensus_queue.cc:1048] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.479377 20013 raft_consensus.cc:3060] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.480810 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
W20260709 12:13:12.482640 19490 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.451157 19798 raft_consensus.cc:385] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.483765 19798 raft_consensus.cc:740] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.480625 20030 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.485463 19798 consensus_queue.cc:260] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.486595 19599 raft_consensus.cc:2468] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:12.492954 19859 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.493577 19798 ts_tablet_manager.cc:1434] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:13:12.494714 19798 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:12.493643 19859 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.498060 19859 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.499487 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:12.500365 19671 raft_consensus.cc:2393] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:12.502256 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.504127 19567 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.504420 19798 tablet_bootstrap.cc:654] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.506160 19859 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.510224 19794 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:12.510834 19794 ts_tablet_manager.cc:1403] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.010s
I20260709 12:13:12.511289 19972 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.510545 19877 consensus_queue.cc:1048] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.511978 19972 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.515337 19795 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:12.515630 19972 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:12.515902 19795 ts_tablet_manager.cc:1403] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.005s
I20260709 12:13:12.517561 19798 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:12.518116 19798 ts_tablet_manager.cc:1403] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 12:13:12.517673 19794 raft_consensus.cc:359] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.518440 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:12.520035 19640 leader_election.cc:343] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.517110 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.521378 19798 raft_consensus.cc:359] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:12.521831 19639 leader_election.cc:343] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.521660 19795 raft_consensus.cc:359] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.523272 19795 raft_consensus.cc:385] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.523691 19795 raft_consensus.cc:740] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.531986 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:12.532850 19745 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.522393 19639 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:12.518554 19794 raft_consensus.cc:385] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.535462 19794 raft_consensus.cc:740] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.535578 19796 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:12.536219 19796 ts_tablet_manager.cc:1403] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.006s
I20260709 12:13:12.536630 19799 raft_consensus.cc:2749] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.541445 19796 raft_consensus.cc:359] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.542245 19796 raft_consensus.cc:385] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.542529 19796 raft_consensus.cc:740] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.546066 19794 consensus_queue.cc:260] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.548636 19424 catalog_manager.cc:5697] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.550948 19745 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:12.552485 19491 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:12.553406 20027 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.522162 19798 raft_consensus.cc:385] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.554332 19798 raft_consensus.cc:740] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.556490 19794 ts_tablet_manager.cc:1434] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:13:12.556012 19798 consensus_queue.cc:260] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.558625 19796 consensus_queue.cc:260] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.564242 19912 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.572181 20013 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.544534 19809 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:12.574160 19798 ts_tablet_manager.cc:1434] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:13:12.557176 19795 consensus_queue.cc:260] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.582216 19794 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:12.586957 19796 ts_tablet_manager.cc:1434] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:13:12.592972 19796 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:12.594493 19798 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:12.582675 19912 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.599996 19912 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.602056 19859 raft_consensus.cc:2749] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.602018 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:12.604773 19641 leader_election.cc:343] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.609440 20013 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.611011 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:12.611768 19598 raft_consensus.cc:3060] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.584748 20030 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.615032 20030 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.624648 20027 raft_consensus.cc:697] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:12.645488 19795 ts_tablet_manager.cc:1434] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.129s	user 0.014s	sys 0.013s
I20260709 12:13:12.637635 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.657933 19795 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:12.659832 19639 leader_election.cc:343] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.660451 19639 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.661975 19748 raft_consensus.cc:3060] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.665650 20075 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.668444 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.669211 19523 raft_consensus.cc:3060] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.672418 19798 tablet_bootstrap.cc:654] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.677397 20075 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.677981 20075 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:12.683753 19715 consensus_peers.cc:597] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.684756 19796 tablet_bootstrap.cc:654] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.687635 20011 consensus_queue.cc:1048] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.688596 20027 consensus_queue.cc:237] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.691305 19794 tablet_bootstrap.cc:654] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.695081 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.696031 19520 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:12.697418 19641 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:12.698474 19912 raft_consensus.cc:2804] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:12.698899 19912 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.699270 19912 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.705240 19795 tablet_bootstrap.cc:654] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.707818 19523 raft_consensus.cc:2468] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:12.718325 20075 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.709234 19598 raft_consensus.cc:2468] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:12.720458 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.721292 19600 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:12.721218 19713 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:12.722710 20011 raft_consensus.cc:2804] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.723639 20011 raft_consensus.cc:697] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:12.726584 20075 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.726593 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:12.727394 20075 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.728675 19912 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.730528 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.731292 19524 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:12.733239 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.733269 19641 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:12.734056 19524 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.734411 19799 raft_consensus.cc:2804] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:12.734808 19799 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.735159 19799 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.736151 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:12.736984 19671 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.737300 20011 consensus_queue.cc:237] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.738477 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.739126 19600 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:12.732560 20075 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.744346 19912 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.750981 20071 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.751679 20071 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.754171 20071 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:12.757107 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:12.760159 19715 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.760861 19671 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:12.763231 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:12.763931 19600 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.765954 19424 catalog_manager.cc:5697] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:12.768746 19799 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.772324 19799 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:12.782306 19490 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.785385 19796 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:12.785997 19796 ts_tablet_manager.cc:1403] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.003s
I20260709 12:13:12.792060 20071 raft_consensus.cc:493] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.792683 20071 raft_consensus.cc:515] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.794584 20074 consensus_queue.cc:1048] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:12.797622 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:12.800797 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:12.801342 19599 raft_consensus.cc:3060] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.801482 19598 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:12.802178 19713 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.802402 20071 leader_election.cc:290] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:12.802726 19713 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:12.803248 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:12.803893 19520 raft_consensus.cc:3060] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.805655 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:12.810487 19796 raft_consensus.cc:359] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.811326 19796 raft_consensus.cc:385] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.811535 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:12.813242 19713 leader_election.cc:343] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.813455 19598 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:12.811731 19796 raft_consensus.cc:740] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.811826 19794 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
W20260709 12:13:12.814072 19713 leader_election.cc:343] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.814580 19794 ts_tablet_manager.cc:1403] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.020s
I20260709 12:13:12.815217 19524 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:12.817698 19600 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:12.814523 19713 leader_election.cc:304] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:12.819425 19639 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:12.818418 19641 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:12.820218 20013 raft_consensus.cc:2749] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.814651 19796 consensus_queue.cc:260] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.821686 19799 raft_consensus.cc:2804] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:12.822995 19799 raft_consensus.cc:697] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:12.823871 19799 consensus_queue.cc:237] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.821200 20071 raft_consensus.cc:2749] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.825789 20075 raft_consensus.cc:2804] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:12.826371 20075 raft_consensus.cc:697] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:12.827284 20075 consensus_queue.cc:237] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.817965 19794 raft_consensus.cc:359] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.833771 19794 raft_consensus.cc:385] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.834097 19794 raft_consensus.cc:740] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.837204 19794 consensus_queue.cc:260] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.839035 19796 ts_tablet_manager.cc:1434] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:13:12.840525 19796 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:12.819536 19520 raft_consensus.cc:2468] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:12.872828 19949 consensus_queue.cc:1048] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.876735 19912 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.877347 19912 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:12.879719 19912 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:12.881505 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:12.886170 19794 ts_tablet_manager.cc:1434] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 12:13:12.887610 19794 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
W20260709 12:13:12.908560 19640 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.908465 20001 consensus_queue.cc:1048] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.909557 19798 tablet_bootstrap.cc:492] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:12.910120 19798 ts_tablet_manager.cc:1403] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.318s	user 0.015s	sys 0.010s
I20260709 12:13:12.913089 19798 raft_consensus.cc:359] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.913506 20027 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.913828 19798 raft_consensus.cc:385] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.914179 19798 raft_consensus.cc:740] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.914038 20027 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:12.914901 19798 consensus_queue.cc:260] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:12.916288 20027 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:12.916612 19798 ts_tablet_manager.cc:1434] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:12.917831 19798 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:12.918694 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:12.919162 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:12.920135 19641 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.920715 19641 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:12.920979 19491 leader_election.cc:343] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.922474 19490 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:12.924510 20078 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.924706 19912 raft_consensus.cc:2749] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.927798 19798 tablet_bootstrap.cc:654] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.931092 20077 consensus_queue.cc:1048] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.932214 20078 raft_consensus.cc:697] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:12.933236 20078 consensus_queue.cc:237] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:12.937650 19794 tablet_bootstrap.cc:654] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.012358 19795 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:13.013021 19795 ts_tablet_manager.cc:1403] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.355s	user 0.021s	sys 0.004s
I20260709 12:13:12.996426 19421 catalog_manager.cc:5697] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.004302 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:13.033442 20011 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.035040 20075 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.054349 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:13:13.081660 19490 leader_election.cc:343] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.082320 19490 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:13.056329 20075 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.053323 20011 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.084234 19795 raft_consensus.cc:359] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.085004 19795 raft_consensus.cc:385] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.085114 20027 raft_consensus.cc:2749] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.087461 19798 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:13.087713 19796 tablet_bootstrap.cc:654] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.093564 19798 ts_tablet_manager.cc:1403] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.026s
I20260709 12:13:13.085357 19795 raft_consensus.cc:740] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.096231 19420 catalog_manager.cc:5697] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.096664 19798 raft_consensus.cc:359] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.096674 19795 consensus_queue.cc:260] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.097579 19798 raft_consensus.cc:385] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.097958 19798 raft_consensus.cc:740] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.098848 19798 consensus_queue.cc:260] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.099766 19795 ts_tablet_manager.cc:1434] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 12:13:13.101583 19798 ts_tablet_manager.cc:1434] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:13:13.105168 19795 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:13.109932 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:13.110845 19745 raft_consensus.cc:2393] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:13.108693 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:13.115621 19795 tablet_bootstrap.cc:654] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.108673 19422 catalog_manager.cc:5697] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.120694 20075 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:13.121076 20011 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:13.122992 19798 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:13.125564 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:13.126935 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:13.127769 20088 log.cc:927] Time spent T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:13.135320 19674 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.138236 20027 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.133669 19641 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:13.167071 19598 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.185720 19794 tablet_bootstrap.cc:492] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:13.186352 19794 ts_tablet_manager.cc:1403] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.299s	user 0.040s	sys 0.053s
W20260709 12:13:13.188155 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 54692.6us
I20260709 12:13:13.189405 19794 raft_consensus.cc:359] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.190188 19794 raft_consensus.cc:385] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.190474 19794 raft_consensus.cc:740] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.191219 19794 consensus_queue.cc:260] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.198629 19794 ts_tablet_manager.cc:1434] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:13.199712 19794 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:13.171080 19673 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.232615 19798 tablet_bootstrap.cc:654] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.247846 19713 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.250294 20011 raft_consensus.cc:2804] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.250746 20011 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.251097 20011 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.261168 19794 tablet_bootstrap.cc:654] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.280270 19795 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:13.280951 19795 ts_tablet_manager.cc:1403] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.176s	user 0.030s	sys 0.012s
I20260709 12:13:13.284549 19796 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:13.285276 19796 ts_tablet_manager.cc:1403] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.445s	user 0.018s	sys 0.009s
I20260709 12:13:13.287417 20011 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.289968 20011 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:13.290618 20011 consensus_queue.cc:1048] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.295724 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:13.296401 19672 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.288918 19796 raft_consensus.cc:359] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.302919 19796 raft_consensus.cc:385] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.301580 19795 raft_consensus.cc:359] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.303447 19796 raft_consensus.cc:740] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.304358 19795 raft_consensus.cc:385] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.305550 19795 raft_consensus.cc:740] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.308900 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:13.309693 19600 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.307376 19796 consensus_queue.cc:260] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.322465 20074 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.320327 20075 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.333014 19672 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:13.308420 19795 consensus_queue.cc:260] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.350998 19795 ts_tablet_manager.cc:1434] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 12:13:13.352602 19795 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:13.364728 20074 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.361734 19713 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.382683 20074 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.414261 19796 ts_tablet_manager.cc:1434] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.129s	user 0.012s	sys 0.002s
I20260709 12:13:13.415505 19796 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:13.412104 19972 raft_consensus.cc:493] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.419636 19972 raft_consensus.cc:515] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.423002 20106 raft_consensus.cc:2804] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.423668 20106 raft_consensus.cc:697] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:13.424153 19598 raft_consensus.cc:1275] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:13.425448 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:13.426350 19597 raft_consensus.cc:2468] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:13.428323 20074 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:13.413082 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 59926.3us
I20260709 12:13:13.432852 20011 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.424659 20106 consensus_queue.cc:237] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.433374 20011 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.436038 19798 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:13.436645 19798 ts_tablet_manager.cc:1403] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.314s	user 0.030s	sys 0.018s
I20260709 12:13:13.438212 19794 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:13.438748 19794 ts_tablet_manager.cc:1403] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.239s	user 0.016s	sys 0.021s
I20260709 12:13:13.457968 19798 raft_consensus.cc:359] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.459190 19798 raft_consensus.cc:385] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.459554 19798 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.464743 19798 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.445385 20011 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:13.471480 19526 raft_consensus.cc:1275] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:13.474032 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:13.474781 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:13.474884 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:13.475986 19796 tablet_bootstrap.cc:654] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.467948 19972 leader_election.cc:290] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:13.482587 19748 raft_consensus.cc:2468] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 0.
I20260709 12:13:13.477790 19798 ts_tablet_manager.cc:1434] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:13:13.478097 19794 raft_consensus.cc:359] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.484654 19794 raft_consensus.cc:385] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.485025 19794 raft_consensus.cc:740] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.486573 19794 consensus_queue.cc:260] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.487797 19675 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.488622 19640 leader_election.cc:304] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.488978 19672 raft_consensus.cc:2468] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:13.489737 20075 raft_consensus.cc:2804] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.490156 20075 raft_consensus.cc:493] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.490484 20075 raft_consensus.cc:3060] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.450623 19600 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:13.491148 19794 ts_tablet_manager.cc:1434] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:13:13.492261 19794 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:13.492918 19795 tablet_bootstrap.cc:654] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.493816 19798 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:13.494416 20027 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:13.496479 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:13.506713 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:13.512810 19520 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.514618 19715 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.515928 20097 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.516482 20097 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.520390 20097 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.510985 19972 consensus_queue.cc:1048] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:13:13.540397 19799 consensus_queue.cc:1048] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.547556 19524 raft_consensus.cc:1275] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:13.550734 19794 tablet_bootstrap.cc:654] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.551967 20011 consensus_queue.cc:1048] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.552713 19597 raft_consensus.cc:1275] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:13:13.556634 19491 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.553860 19422 catalog_manager.cc:5697] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.566962 19798 tablet_bootstrap.cc:654] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.576133 19795 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:13.576767 19795 ts_tablet_manager.cc:1403] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.010s
I20260709 12:13:13.575829 19972 consensus_queue.cc:1048] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:13.590765 20097 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.592629 19972 consensus_queue.cc:1048] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.593834 19859 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.565325 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 66314.3us
I20260709 12:13:13.602824 19796 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:13.612182 19796 ts_tablet_manager.cc:1403] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.013s
I20260709 12:13:13.617669 19794 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:13.618902 19794 ts_tablet_manager.cc:1403] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.006s
I20260709 12:13:13.613806 19859 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.622844 19859 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:13.624313 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:13.629293 19795 raft_consensus.cc:359] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.630592 19795 raft_consensus.cc:385] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.630967 19795 raft_consensus.cc:740] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.627655 19796 raft_consensus.cc:359] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.631632 19796 raft_consensus.cc:385] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.631902 19795 consensus_queue.cc:260] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.631969 19796 raft_consensus.cc:740] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.635618 19796 consensus_queue.cc:260] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.638104 19795 ts_tablet_manager.cc:1434] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.003s
I20260709 12:13:13.644197 19796 ts_tablet_manager.cc:1434] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:13:13.645828 19796 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:13.656883 19795 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:13.659304 19600 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.667984 19490 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:13.669581 20097 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:13.669570 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:13.672415 20074 raft_consensus.cc:2804] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.672847 20074 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.673168 20074 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.676199 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:13.676934 19525 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.682080 20111 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.682780 20111 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.686306 19796 tablet_bootstrap.cc:654] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.691934 19565 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:13.693598 20053 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.687614 19424 catalog_manager.cc:5697] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.713238 20078 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.730849 19520 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.731339 19798 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:13.731910 19798 ts_tablet_manager.cc:1403] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.012s
I20260709 12:13:13.732007 20111 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:13.733695 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:13.735144 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:13.735821 19675 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.743026 19798 raft_consensus.cc:359] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.744295 19798 raft_consensus.cc:385] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.746060 19798 raft_consensus.cc:740] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.747510 19798 consensus_queue.cc:260] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.748782 19525 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:13.750996 20074 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.697011 20075 raft_consensus.cc:515] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.720939 19794 raft_consensus.cc:359] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.755210 19795 tablet_bootstrap.cc:654] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.762768 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:13.761763 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:13.801098 19745 raft_consensus.cc:3060] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:13.802637 19491 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.753487 20074 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:13.762854 20075 leader_election.cc:290] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:13.767504 19715 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.805763 20097 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.806293 20097 raft_consensus.cc:697] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:13.770972 19675 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:13.807313 20097 consensus_queue.cc:237] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.760975 19794 raft_consensus.cc:385] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.810624 19794 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.811372 19794 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.819260 19745 raft_consensus.cc:2468] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:13.766757 19798 ts_tablet_manager.cc:1434] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:13:13.822305 19798 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:13.760528 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:13.756121 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:13.825949 19671 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.827571 19490 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:13.758618 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:13.829988 19600 raft_consensus.cc:3060] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.833925 19794 ts_tablet_manager.cc:1434] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.215s	user 0.008s	sys 0.001s
I20260709 12:13:13.835178 19794 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:13.838626 19600 raft_consensus.cc:2468] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:13.788172 19796 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:13.858170 19671 raft_consensus.cc:2468] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:13.860982 20074 raft_consensus.cc:2749] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.867821 19794 tablet_bootstrap.cc:654] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.868392 19796 ts_tablet_manager.cc:1403] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.004s
I20260709 12:13:13.847628 19798 tablet_bootstrap.cc:654] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.851235 19640 leader_election.cc:304] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.875010 19912 raft_consensus.cc:2804] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.875552 19912 raft_consensus.cc:697] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:13.876463 19912 consensus_queue.cc:237] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:13.878345 19490 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:13.880033 20078 raft_consensus.cc:2804] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.880577 20078 raft_consensus.cc:697] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:13.881457 20078 consensus_queue.cc:237] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:13.884578 19420 catalog_manager.cc:5697] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.885982 20097 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.889863 20097 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.894469 20097 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:13.896008 19796 raft_consensus.cc:359] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.896818 19796 raft_consensus.cc:385] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.897104 19796 raft_consensus.cc:740] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.897305 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:13.899772 19713 leader_election.cc:343] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.901300 19796 consensus_queue.cc:260] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.903929 20097 consensus_queue.cc:1048] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.910434 19796 ts_tablet_manager.cc:1434] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:13:13.911543 19796 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:13.917999 20097 consensus_queue.cc:1048] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.931592 19796 tablet_bootstrap.cc:654] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.942974 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:13.944531 19715 leader_election.cc:343] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.945549 19715 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:13.950047 20010 raft_consensus.cc:2749] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.950953 20010 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.951520 20010 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:13.954594 20010 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:13.957260 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:13.958129 19520 raft_consensus.cc:2468] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.958698 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:13.959453 19715 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:13.959784 19601 raft_consensus.cc:2468] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:13.960327 20010 raft_consensus.cc:2804] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.960987 20010 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.961474 20010 raft_consensus.cc:3060] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.986374 19795 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:13.987089 19795 ts_tablet_manager.cc:1403] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.330s	user 0.016s	sys 0.028s
I20260709 12:13:13.994896 19795 raft_consensus.cc:359] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:13.996480 19795 raft_consensus.cc:385] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.997391 19795 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.998443 19795 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.000267 19795 ts_tablet_manager.cc:1434] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:13:14.001696 19795 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:14.001813 20111 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.009258 20111 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.012048 20111 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:14.014149 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:14.013612 19420 catalog_manager.cc:5697] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.015554 19675 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:14.025569 19490 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:14.026607 20111 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.027136 20111 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.027570 20111 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.029382 19796 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:14.029995 19796 ts_tablet_manager.cc:1403] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.000s
I20260709 12:13:14.029487 19794 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:14.030943 19794 ts_tablet_manager.cc:1403] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.196s	user 0.054s	sys 0.054s
I20260709 12:13:14.039105 19796 raft_consensus.cc:359] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.039891 19796 raft_consensus.cc:385] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.040198 19796 raft_consensus.cc:740] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.041040 19796 consensus_queue.cc:260] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.042780 19796 ts_tablet_manager.cc:1434] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:14.043318 19798 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:14.043918 19798 ts_tablet_manager.cc:1403] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.222s	user 0.027s	sys 0.008s
I20260709 12:13:14.046128 19796 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:14.052258 19795 tablet_bootstrap.cc:654] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.052335 19794 raft_consensus.cc:359] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.055217 19794 raft_consensus.cc:385] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.055608 19794 raft_consensus.cc:740] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.056710 19794 consensus_queue.cc:260] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.048303 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:14.076826 19794 ts_tablet_manager.cc:1434] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.002s
I20260709 12:13:14.099928 20111 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:14.102090 19490 leader_election.cc:343] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.069895 20010 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.110383 20010 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:14.111855 19794 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:14.116752 19798 raft_consensus.cc:359] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.119107 19798 raft_consensus.cc:385] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.119503 19798 raft_consensus.cc:740] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
W20260709 12:13:14.115095 20140 log.cc:927] Time spent T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:14.111181 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:14.125999 19798 consensus_queue.cc:260] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.129181 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:14.130055 19600 raft_consensus.cc:3060] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.130470 20111 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:14.120141 20010 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.139659 20010 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.140524 19794 tablet_bootstrap.cc:654] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.141032 19796 tablet_bootstrap.cc:654] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.130096 19798 ts_tablet_manager.cc:1434] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.004s
I20260709 12:13:14.146173 19798 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:14.162678 20010 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:14.165189 19798 tablet_bootstrap.cc:654] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.224354 19524 raft_consensus.cc:3060] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.231781 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
W20260709 12:13:14.236809 19490 leader_election.cc:343] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.257611 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:14.258965 19675 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.269887 19524 raft_consensus.cc:2468] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:14.255434 19421 catalog_manager.cc:5697] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.279249 20146 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.280411 19794 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:14.282071 19794 ts_tablet_manager.cc:1403] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.002s
I20260709 12:13:14.284557 19715 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:14.312484 19675 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
W20260709 12:13:14.295945 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:14.280670 20146 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.353930 20053 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.355020 20053 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.357698 19795 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:14.358232 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:14.358879 19795 ts_tablet_manager.cc:1403] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.358s	user 0.025s	sys 0.008s
I20260709 12:13:14.387315 20146 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:14.387143 19796 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:14.406108 20106 raft_consensus.cc:2804] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.407234 20106 raft_consensus.cc:697] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:14.409217 20106 consensus_queue.cc:237] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.431480 19600 raft_consensus.cc:2468] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:14.439327 20053 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:14.450063 19796 ts_tablet_manager.cc:1403] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.404s	user 0.026s	sys 0.008s
W20260709 12:13:14.403643 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 119625us
I20260709 12:13:14.454183 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:14.455163 19674 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:14.460744 19794 raft_consensus.cc:359] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.462917 19794 raft_consensus.cc:385] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.464708 19794 raft_consensus.cc:740] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
W20260709 12:13:14.470499 19491 consensus_peers.cc:597] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 -> Peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Couldn't send request to peer df754e24c604440998ec5ed4153e9925. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:14.472432 19796 raft_consensus.cc:359] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:14.477335 19713 leader_election.cc:343] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.473392 19796 raft_consensus.cc:385] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.482117 19796 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.482944 19796 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.495968 19796 ts_tablet_manager.cc:1434] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:13:14.498109 19796 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:14.498996 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:14.511256 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:14.516134 19795 raft_consensus.cc:359] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.517977 19794 consensus_queue.cc:260] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.519431 19674 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
W20260709 12:13:14.531961 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 165094us
I20260709 12:13:14.533656 19795 raft_consensus.cc:385] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.534340 19795 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.535677 19795 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.540306 19796 tablet_bootstrap.cc:654] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.549351 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:14.552942 19798 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:14.553900 19798 ts_tablet_manager.cc:1403] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.408s	user 0.031s	sys 0.028s
I20260709 12:13:14.553834 19490 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:14.558800 19798 raft_consensus.cc:359] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.559692 19798 raft_consensus.cc:385] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.559957 19798 raft_consensus.cc:740] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.560971 20114 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.560745 19798 consensus_queue.cc:260] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.561684 20114 raft_consensus.cc:697] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:14.573235 20114 consensus_queue.cc:237] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.584301 19794 ts_tablet_manager.cc:1434] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.302s	user 0.006s	sys 0.005s
I20260709 12:13:14.589188 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:14.594424 19713 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:14.598239 20147 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:14.598752 19566 leader_election.cc:343] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.598752 20147 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.600662 20147 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.601815 19877 consensus_queue.cc:1048] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:14.606818 19795 ts_tablet_manager.cc:1434] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.247s	user 0.011s	sys 0.005s
I20260709 12:13:14.604766 19565 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:14.610731 19953 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.611312 19795 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:14.614136 19794 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:14.615640 19877 consensus_queue.cc:1048] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:14.629199 19798 ts_tablet_manager.cc:1434] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:13:14.618288 19953 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.630285 19953 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:14.681104 19639 leader_election.cc:343] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.687595 19799 consensus_queue.cc:1048] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:14.696884 19794 tablet_bootstrap.cc:654] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.697984 19798 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:14.709900 20150 consensus_queue.cc:1048] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:14.725631 19796 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:14.726490 19796 ts_tablet_manager.cc:1403] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.013s
W20260709 12:13:14.728717 19641 leader_election.cc:343] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.729308 19641 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:14.731480 19799 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.743891 19420 catalog_manager.cc:5697] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.753996 20147 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.767997 20077 consensus_queue.cc:1048] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:14.770524 19795 tablet_bootstrap.cc:654] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.783330 19796 raft_consensus.cc:359] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:14.784549 19796 raft_consensus.cc:385] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.784994 19796 raft_consensus.cc:740] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.788141 19796 consensus_queue.cc:260] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:14.788497 19424 catalog_manager.cc:5697] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.790995 19796 ts_tablet_manager.cc:1434] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 12:13:14.795835 19798 tablet_bootstrap.cc:654] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.798944 19794 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:14.799849 19794 ts_tablet_manager.cc:1403] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.010s
I20260709 12:13:14.801476 20147 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:14.803125 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:14.804033 19671 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.807209 19794 raft_consensus.cc:359] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.808586 19794 raft_consensus.cc:385] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.809002 19794 raft_consensus.cc:740] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.809085 19953 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:14.810659 19794 consensus_queue.cc:260] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:14.811451 19953 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:14.813354 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:14.814515 19794 ts_tablet_manager.cc:1434] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.003s
W20260709 12:13:14.819506 19566 leader_election.cc:343] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.847014 19796 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:14.852396 19794 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:14.853039 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:14.857762 19670 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.875653 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:14.879191 19795 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:14.879860 19795 ts_tablet_manager.cc:1403] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.269s	user 0.030s	sys 0.003s
I20260709 12:13:14.906916 20077 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.909406 20077 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.910107 20010 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.910790 20010 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:14.911968 19795 raft_consensus.cc:359] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.912762 19795 raft_consensus.cc:385] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.913050 19795 raft_consensus.cc:740] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.913862 19795 consensus_queue.cc:260] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.922705 19877 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.930277 19877 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:14.939911 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:14.951717 19713 leader_election.cc:343] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.958571 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:14.982156 19749 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:14.962476 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:14.948798 19748 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.983773 20010 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:14.916285 20077 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:14.980744 20097 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.986042 20097 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:14.989035 20097 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:14.995602 19490 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.999138 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:14.999372 19521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.001690 19796 tablet_bootstrap.cc:654] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.002857 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.003602 19524 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:15.004336 19491 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:15.006755 20077 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.007200 20077 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.007591 20077 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.008590 19877 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:15.016193 19795 ts_tablet_manager.cc:1434] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.136s	user 0.005s	sys 0.004s
I20260709 12:13:15.017735 19795 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:15.020898 19490 consensus_peers.cc:597] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:15.022989 20071 consensus_queue.cc:1048] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:15.023471 19715 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.025089 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:15.026026 20071 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.026412 20071 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.026760 20071 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.035863 19798 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.036510 19798 ts_tablet_manager.cc:1403] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.351s	user 0.012s	sys 0.004s
I20260709 12:13:15.037123 19796 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.038008 19794 tablet_bootstrap.cc:654] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.039925 19796 ts_tablet_manager.cc:1403] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.219s	user 0.009s	sys 0.007s
I20260709 12:13:15.043567 19798 raft_consensus.cc:359] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.044366 19798 raft_consensus.cc:385] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.044727 19798 raft_consensus.cc:740] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.045346 19713 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.044822 19796 raft_consensus.cc:359] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.046607 19796 raft_consensus.cc:385] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.046989 19796 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.050155 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.047719 19796 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.054225 19796 ts_tablet_manager.cc:1434] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:13:15.045660 19798 consensus_queue.cc:260] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.055553 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:15.050123 20071 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.058411 19953 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.058949 19953 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.061411 19953 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:15.061915 19798 ts_tablet_manager.cc:1434] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 12:13:15.062743 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.062988 20071 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:15.064294 19798 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
W20260709 12:13:15.064457 19565 leader_election.cc:343] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.069905 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.070899 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:15.073091 19566 leader_election.cc:343] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.073596 19566 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.075021 19953 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:15.075781 19713 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.076282 20071 consensus_queue.cc:1048] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.079645 20150 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.080255 20150 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.055668 19796 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.085430 19795 tablet_bootstrap.cc:654] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.086130 20150 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:15.086999 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:15.091203 19639 leader_election.cc:343] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.092118 19953 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.092715 19953 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.095104 19953 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.097139 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.098042 19525 raft_consensus.cc:2468] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:15.097163 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.099162 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.099768 19567 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
W20260709 12:13:15.099910 19641 leader_election.cc:343] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.099916 19747 raft_consensus.cc:2468] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:15.100682 19641 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.101810 19859 raft_consensus.cc:2804] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.101914 20150 raft_consensus.cc:2749] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.102310 19859 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.102722 19859 raft_consensus.cc:3060] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.104267 19671 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:15.043485 19670 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:15.106122 19565 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.107601 19953 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.109179 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:15.109241 19953 raft_consensus.cc:697] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
W20260709 12:13:15.112443 19713 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.113009 19713 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.112895 19859 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.114558 19713 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:15.115690 19953 consensus_queue.cc:237] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.118358 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:15.119001 19525 raft_consensus.cc:3060] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.119226 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:15.119853 19747 raft_consensus.cc:3060] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.123461 20147 raft_consensus.cc:2749] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.125253 20147 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.125842 20147 raft_consensus.cc:697] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:15.126914 20147 consensus_queue.cc:237] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.134303 19796 tablet_bootstrap.cc:654] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.136312 19859 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.137049 19525 raft_consensus.cc:2468] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:15.140429 19798 tablet_bootstrap.cc:654] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.140570 19567 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:15.141397 20077 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.142928 19526 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:15.142053 19859 raft_consensus.cc:2804] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.145912 19795 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:15.146925 19795 ts_tablet_manager.cc:1403] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.130s	user 0.022s	sys 0.000s
I20260709 12:13:15.149295 19794 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:15.149684 20097 raft_consensus.cc:2749] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.150063 19794 ts_tablet_manager.cc:1403] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.333s	user 0.013s	sys 0.007s
I20260709 12:13:15.151882 19859 raft_consensus.cc:697] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:15.152617 19798 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.153796 19859 consensus_queue.cc:237] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.160018 19798 ts_tablet_manager.cc:1403] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.004s
I20260709 12:13:15.162072 19794 raft_consensus.cc:359] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.169314 19794 raft_consensus.cc:385] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.171306 19794 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.172181 19794 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.172567 19796 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.173393 19796 ts_tablet_manager.cc:1403] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.007s
I20260709 12:13:15.176067 19794 ts_tablet_manager.cc:1434] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:15.156666 19795 raft_consensus.cc:359] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.166332 19798 raft_consensus.cc:359] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.193771 19795 raft_consensus.cc:385] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.193835 19798 raft_consensus.cc:385] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.194131 19795 raft_consensus.cc:740] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.194868 19798 raft_consensus.cc:740] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.195322 19795 consensus_queue.cc:260] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.195688 19798 consensus_queue.cc:260] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:15.197681 19713 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.197924 19795 ts_tablet_manager.cc:1434] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 12:13:15.198289 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.198951 19798 ts_tablet_manager.cc:1434] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:13:15.199077 20097 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.199185 19795 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:15.200359 19794 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:15.192467 19796 raft_consensus.cc:359] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.201771 19796 raft_consensus.cc:385] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.202096 19796 raft_consensus.cc:740] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.210081 19420 catalog_manager.cc:5697] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.203086 19796 consensus_queue.cc:260] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:15.199956 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 53839.3us
I20260709 12:13:15.218490 19798 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:15.220709 19795 tablet_bootstrap.cc:654] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.227411 19796 ts_tablet_manager.cc:1434] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:13:15.234369 19796 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.248661 20117 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.254341 19747 raft_consensus.cc:2468] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:15.254881 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:15.255889 19749 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:15.257867 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
W20260709 12:13:15.259277 19490 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.259727 19490 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.260844 20117 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.261045 20077 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:15.265194 19794 tablet_bootstrap.cc:654] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.248627 19798 tablet_bootstrap.cc:654] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.282299 19795 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:15.284991 19795 ts_tablet_manager.cc:1403] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.003s
I20260709 12:13:15.283761 19421 catalog_manager.cc:5697] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.288064 19795 raft_consensus.cc:359] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.288748 19795 raft_consensus.cc:385] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.291733 19795 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.292927 19796 tablet_bootstrap.cc:654] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.292516 19795 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.297696 19795 ts_tablet_manager.cc:1434] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:13:15.298784 19795 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:15.299873 19877 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.300429 19877 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.306200 19420 catalog_manager.cc:5697] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.309712 19877 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.313896 19796 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.305401 19795 tablet_bootstrap.cc:654] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.314523 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.315492 19524 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:15.316608 19715 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:15.317934 20010 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.318365 20010 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.318699 20010 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.314530 19796 ts_tablet_manager.cc:1403] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.001s
I20260709 12:13:15.326792 19796 raft_consensus.cc:359] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.327555 19796 raft_consensus.cc:385] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.327814 19796 raft_consensus.cc:740] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.328464 19796 consensus_queue.cc:260] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.331153 19796 ts_tablet_manager.cc:1434] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:15.332252 19796 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.339100 19796 tablet_bootstrap.cc:654] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.347474 20010 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.351260 19798 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.355846 19798 ts_tablet_manager.cc:1403] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.018s
I20260709 12:13:15.358943 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:15.359061 19798 raft_consensus.cc:359] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.359843 19674 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.360042 19798 raft_consensus.cc:385] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.360426 19798 raft_consensus.cc:740] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.360564 19796 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.361150 19796 ts_tablet_manager.cc:1403] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 12:13:15.361166 19798 consensus_queue.cc:260] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.363658 19798 ts_tablet_manager.cc:1434] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:15.364574 19796 raft_consensus.cc:359] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.365311 19796 raft_consensus.cc:385] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.365638 19798 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:15.365682 19796 raft_consensus.cc:740] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.366799 19796 consensus_queue.cc:260] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.369233 19796 ts_tablet_manager.cc:1434] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:15.370934 19796 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.377678 19798 tablet_bootstrap.cc:654] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.378446 20010 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.380468 19796 tablet_bootstrap.cc:654] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.388803 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:15.391168 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.393406 19796 tablet_bootstrap.cc:492] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.394034 19796 ts_tablet_manager.cc:1403] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 12:13:15.397037 19796 raft_consensus.cc:359] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.397862 19796 raft_consensus.cc:385] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.398185 19796 raft_consensus.cc:740] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.399044 19796 consensus_queue.cc:260] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.397882 19524 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.410516 19524 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:15.412792 19715 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:15.413247 20147 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.413852 20147 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.416601 19877 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.417186 19877 raft_consensus.cc:697] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:15.418107 19877 consensus_queue.cc:237] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.422375 20147 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:15.412842 19796 ts_tablet_manager.cc:1434] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:13:15.424810 19796 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.430361 19798 tablet_bootstrap.cc:492] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.431012 19798 ts_tablet_manager.cc:1403] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.003s
I20260709 12:13:15.422571 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:15.434156 19798 raft_consensus.cc:359] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.434916 19798 raft_consensus.cc:385] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.435192 19798 raft_consensus.cc:740] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.435997 19798 consensus_queue.cc:260] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:15.436357 19713 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.438210 19796 tablet_bootstrap.cc:654] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.443002 19798 ts_tablet_manager.cc:1434] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:15.444259 19798 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:15.454203 19795 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:15.454841 19795 ts_tablet_manager.cc:1403] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.156s	user 0.037s	sys 0.038s
I20260709 12:13:15.456847 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:15.458460 19715 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.458911 19715 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.376648 19674 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:15.459771 19798 tablet_bootstrap.cc:654] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.460088 19877 raft_consensus.cc:2749] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.459070 19795 raft_consensus.cc:359] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.462090 19795 raft_consensus.cc:385] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.462393 19795 raft_consensus.cc:740] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.463817 19795 consensus_queue.cc:260] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.493688 19795 ts_tablet_manager.cc:1434] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:13:15.494978 19795 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:15.497781 19794 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:15.498440 19794 ts_tablet_manager.cc:1403] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.298s	user 0.026s	sys 0.006s
I20260709 12:13:15.503367 20001 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.504014 20001 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.502676 19794 raft_consensus.cc:359] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.506222 20001 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.506311 19794 raft_consensus.cc:385] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.507495 19794 raft_consensus.cc:740] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.507863 20001 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.509924 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.508522 20001 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.514513 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:15.514051 19567 leader_election.cc:343] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.515524 20001 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:15.517999 19795 tablet_bootstrap.cc:654] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.516875 19794 consensus_queue.cc:260] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.520128 19877 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.520710 19794 ts_tablet_manager.cc:1434] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
W20260709 12:13:15.523064 19566 leader_election.cc:343] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.523577 19566 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.525712 19859 raft_consensus.cc:2749] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.532045 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.544677 20010 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.552269 19798 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.573734 19798 ts_tablet_manager.cc:1403] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.000s
I20260709 12:13:15.573441 20010 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.575917 20010 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:15.544569 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.577126 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:15.536499 19423 catalog_manager.cc:5697] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.580017 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.580895 19670 raft_consensus.cc:2393] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:15.577225 19798 raft_consensus.cc:359] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.581396 19798 raft_consensus.cc:385] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.581794 19798 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.582212 19565 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.582580 19794 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:15.588168 19912 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.588914 19912 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.591300 19912 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.588186 19795 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:15.593823 19795 ts_tablet_manager.cc:1403] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.009s
I20260709 12:13:15.595132 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.582653 19798 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:15.596912 19640 leader_election.cc:343] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.597950 20001 consensus_queue.cc:1048] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.598667 19798 ts_tablet_manager.cc:1434] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:13:15.599339 19526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.599906 19798 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:15.600360 19713 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
W20260709 12:13:15.601053 19641 leader_election.cc:343] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.601611 19641 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.602564 20097 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.602839 19912 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.585415 19953 raft_consensus.cc:2749] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.608129 19798 tablet_bootstrap.cc:654] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.612906 20097 raft_consensus.cc:2749] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.620361 20001 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.620990 20001 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:15.624150 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.626497 19859 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.628597 19796 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.629179 19796 ts_tablet_manager.cc:1403] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.205s	user 0.031s	sys 0.031s
I20260709 12:13:15.630147 19749 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:15.633810 19796 raft_consensus.cc:359] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.637116 20117 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.637780 20117 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.640623 20117 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:15.634627 19796 raft_consensus.cc:385] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.646236 19798 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.647856 19798 ts_tablet_manager.cc:1403] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.006s
I20260709 12:13:15.650977 19798 raft_consensus.cc:359] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.642779 19796 raft_consensus.cc:740] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.651777 19798 raft_consensus.cc:385] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.652125 19798 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.652451 19796 consensus_queue.cc:260] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.653859 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.655047 19525 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:15.655112 20071 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.655483 19796 ts_tablet_manager.cc:1434] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:13:15.655814 20071 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.656744 19796 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.656457 19798 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.657440 19567 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:15.657970 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:15.658739 19747 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:15.659664 19599 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.660058 19491 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:15.660921 20071 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:15.661270 20117 raft_consensus.cc:2804] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.649523 19794 tablet_bootstrap.cc:654] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.661724 20117 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.662226 20117 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.666095 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.666519 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:15.667790 19490 leader_election.cc:343] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:15.669255 19713 leader_election.cc:343] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.672164 19877 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.672806 19796 tablet_bootstrap.cc:654] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.672765 19877 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.673650 19859 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.675254 19877 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.678372 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.679442 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:15.680898 19715 leader_election.cc:343] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.682161 19670 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:15.683552 19796 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:15.683889 19713 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.684095 19796 ts_tablet_manager.cc:1403] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 12:13:15.685871 20071 raft_consensus.cc:2804] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.686357 20071 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.686784 20071 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.651885 20001 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.626546 19795 raft_consensus.cc:359] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.693629 19795 raft_consensus.cc:385] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.694368 19859 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.698210 20117 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.702359 19796 raft_consensus.cc:359] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.708678 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:15.716897 19600 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:15.718636 19713 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:15.693930 19795 raft_consensus.cc:740] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.719266 20117 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:15.716158 19859 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.719905 19796 raft_consensus.cc:385] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.720270 19796 raft_consensus.cc:740] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.720147 19859 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.721100 19796 consensus_queue.cc:260] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.722194 19795 consensus_queue.cc:260] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.723785 19859 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:15.730159 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:15.733822 19798 ts_tablet_manager.cc:1434] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.001s
I20260709 12:13:15.735065 19795 ts_tablet_manager.cc:1434] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.001s
I20260709 12:13:15.735157 20147 raft_consensus.cc:2804] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.738472 20147 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.738808 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:15.739552 19747 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.738849 20147 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.735180 19798 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:15.753456 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:15.758190 19795 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:15.760877 19953 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:15.762512 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 49662.3us
W20260709 12:13:15.762797 19490 leader_election.cc:343] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.770289 19798 tablet_bootstrap.cc:654] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:15.784775 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:15.762038 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:15.799743 19794 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:15.800379 19796 ts_tablet_manager.cc:1434] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 12:13:15.800504 19794 ts_tablet_manager.cc:1403] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.218s	user 0.027s	sys 0.011s
I20260709 12:13:15.809371 19567 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:15.761528 19953 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:15.822489 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 103954us
I20260709 12:13:15.834254 19795 tablet_bootstrap.cc:654] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.789000 20071 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.840874 19798 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:15.841667 19798 ts_tablet_manager.cc:1403] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.000s
I20260709 12:13:15.846276 19796 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: Bootstrap starting.
I20260709 12:13:15.837107 20147 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:15.866899 20071 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:15.877202 19859 raft_consensus.cc:2749] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.855290 20010 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:15.899384 19794 raft_consensus.cc:359] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.900364 19794 raft_consensus.cc:385] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.900703 19794 raft_consensus.cc:740] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.888803 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:15.903347 19798 raft_consensus.cc:359] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.913000 19794 consensus_queue.cc:260] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:15.914260 19798 raft_consensus.cc:385] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.914722 19798 raft_consensus.cc:740] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.921671 19798 consensus_queue.cc:260] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:15.927500 19794 ts_tablet_manager.cc:1434] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.001s
I20260709 12:13:15.931067 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:15.931854 19671 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:15.921979 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 103122us
W20260709 12:13:15.937433 19715 leader_election.cc:343] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.945384 19796 tablet_bootstrap.cc:654] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.949430 19953 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:15.940024 20117 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.966243 19798 ts_tablet_manager.cc:1434] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 12:13:15.974944 19794 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:15.942996 20010 consensus_queue.cc:1048] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:13:15.967660 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:15.982102 19491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 44692.5us
I20260709 12:13:15.955977 19953 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:13:15.960736 20214 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.005935 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:16.006654 19600 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.993505 19673 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:15.969025 20117 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.005951 19798 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:16.015748 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:16.020387 19795 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:16.021051 19795 ts_tablet_manager.cc:1403] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.011s
I20260709 12:13:16.003232 20147 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:16.024232 20117 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:16.034759 19795 raft_consensus.cc:359] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.035423 19795 raft_consensus.cc:385] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.035671 19795 raft_consensus.cc:740] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.037410 19600 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
W20260709 12:13:16.038682 19713 leader_election.cc:343] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:16.038275 19490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 45443.8us
I20260709 12:13:16.044140 19713 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:16.045302 19877 raft_consensus.cc:2804] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.045930 19877 raft_consensus.cc:697] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:16.040546 19795 consensus_queue.cc:260] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.046861 19877 consensus_queue.cc:237] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.010874 19671 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:16.054375 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:16.054558 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:16.055219 19670 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:16.055323 19523 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:16.002919 20214 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.072074 19795 ts_tablet_manager.cc:1434] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:13:16.061648 19490 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:16.047784 20207 consensus_queue.cc:1048] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:13:16.076110 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:16.082487 20216 raft_consensus.cc:2804] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.115648 20214 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:16.119931 19565 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:16.122328 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:16.123443 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:16.124976 19798 tablet_bootstrap.cc:654] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.131489 19745 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
W20260709 12:13:16.134094 19490 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:16.135336 19491 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:16.138765 20215 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.139283 20215 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.139707 20215 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.127601 20216 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.182543 20216 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.112083 19599 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:16.185359 20211 raft_consensus.cc:2804] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.149364 19747 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:16.206887 19491 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:16.210641 19794 tablet_bootstrap.cc:654] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:16.279872 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 128115us
I20260709 12:13:16.286656 19713 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:16.209450 20223 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.288120 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 126726us
W20260709 12:13:16.301894 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 107485us
I20260709 12:13:16.287827 20071 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.288107 20214 raft_consensus.cc:2804] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:16.346099 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 55880.9us
I20260709 12:13:16.299157 20223 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:16.330610 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 131182us
I20260709 12:13:16.369266 20010 consensus_queue.cc:1048] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:16.336127 20071 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.375828 20071 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:16.378466 20224 log.cc:927] Time spent T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:13:16.337815 20214 raft_consensus.cc:697] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:16.381206 19796 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: No bootstrap required, opened a new log
I20260709 12:13:16.381486 20214 consensus_queue.cc:237] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.381856 19796 ts_tablet_manager.cc:1403] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: Time spent bootstrapping tablet: real 0.555s	user 0.025s	sys 0.013s
I20260709 12:13:16.384532 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:16.391238 19747 raft_consensus.cc:2393] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:16.391677 20200 raft_consensus.cc:2804] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.392316 20200 raft_consensus.cc:697] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:16.398770 19796 raft_consensus.cc:359] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.399979 19796 raft_consensus.cc:385] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.400337 19796 raft_consensus.cc:740] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.414012 19796 consensus_queue.cc:260] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.470952 19795 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:16.468890 20211 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.393211 20200 consensus_queue.cc:237] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.500792 20211 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.517970 20010 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.547138 19798 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:16.547744 19798 ts_tablet_manager.cc:1403] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.545s	user 0.021s	sys 0.021s
I20260709 12:13:16.558979 19796 ts_tablet_manager.cc:1434] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: Time spent starting tablet: real 0.168s	user 0.014s	sys 0.004s
I20260709 12:13:16.522468 20215 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.563067 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:16.567193 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:16.544378 20010 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.570602 20212 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.570936 20010 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:16.571231 20212 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:16.578781 20229 log.cc:927] Time spent T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.213s	user 0.003s	sys 0.007s
I20260709 12:13:16.578542 19794 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:16.595216 19794 ts_tablet_manager.cc:1403] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.634s	user 0.036s	sys 0.006s
I20260709 12:13:16.590945 19798 raft_consensus.cc:359] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.599329 19798 raft_consensus.cc:385] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:16.574683 20227 log.cc:927] Time spent T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:13:16.599718 19798 raft_consensus.cc:740] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.608268 19794 raft_consensus.cc:359] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.610222 19794 raft_consensus.cc:385] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.607486 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:16.581701 20222 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.576355 20215 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:16.614303 19794 raft_consensus.cc:740] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.573519 20212 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:16.617372 19491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 51747us
W20260709 12:13:16.618324 19713 leader_election.cc:343] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:16.613919 19798 consensus_queue.cc:260] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.634913 19521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:16.631096 19794 consensus_queue.cc:260] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.654464 19795 tablet_bootstrap.cc:654] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.654965 19673 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.658427 19597 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.626511 20222 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.667274 19798 ts_tablet_manager.cc:1434] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.003s
I20260709 12:13:16.675304 19794 ts_tablet_manager.cc:1434] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 12:13:16.649904 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:16.688011 19794 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:16.684764 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:16.695436 19670 raft_consensus.cc:2468] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:16.698312 19798 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:16.705623 20222 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:16.706910 20216 consensus_meta.cc:287] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.003s
I20260709 12:13:16.706918 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:16.707492 20216 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.707895 19599 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:16.712255 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:16.697558 19749 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.718433 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:16.721978 19641 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:16.723258 20234 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:16.726287 19713 leader_election.cc:343] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:16.726846 19713 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:16.729254 20247 raft_consensus.cc:2749] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:16.731217 20211 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.733593 19794 tablet_bootstrap.cc:654] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.735392 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:16.736241 19598 raft_consensus.cc:2468] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 0.
I20260709 12:13:16.743522 19600 raft_consensus.cc:2393] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 1: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
W20260709 12:13:16.753085 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 107430us
I20260709 12:13:16.757450 19565 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:16.758785 19859 raft_consensus.cc:2804] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.759327 19859 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.759725 19859 raft_consensus.cc:3060] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.778091 19859 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.766036 20216 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:16.769526 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:16.792718 19675 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.784387 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:16.771004 20223 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:16.776990 20234 raft_consensus.cc:2749] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:16.797410 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:16.798306 19746 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:16.789022 19490 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:16.801656 20216 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.802870 20216 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.803390 20216 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.806391 19749 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:16.814170 19798 tablet_bootstrap.cc:654] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.782605 20211 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:16.790025 19713 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:16.817363 19491 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:16.817957 19795 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:16.819147 19795 ts_tablet_manager.cc:1403] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.364s	user 0.017s	sys 0.006s
I20260709 12:13:16.823937 20245 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.824600 20245 raft_consensus.cc:697] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:16.825577 20245 consensus_queue.cc:237] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:16.838195 19859 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:16.845285 20097 raft_consensus.cc:2804] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:16.845968 20097 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.846401 20097 raft_consensus.cc:3060] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.844558 19794 tablet_bootstrap.cc:492] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:16.847512 19794 ts_tablet_manager.cc:1403] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.162s	user 0.022s	sys 0.007s
I20260709 12:13:16.848891 19795 raft_consensus.cc:359] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.866940 19795 raft_consensus.cc:385] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.860345 19675 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:16.864588 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:16.867398 19795 raft_consensus.cc:740] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.844652 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:16.878062 19521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:16.881018 19794 raft_consensus.cc:359] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.882082 19794 raft_consensus.cc:385] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.882431 19794 raft_consensus.cc:740] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
W20260709 12:13:16.882764 19713 consensus_peers.cc:597] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.883212 19794 consensus_queue.cc:260] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.881131 19795 consensus_queue.cc:260] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.888641 19490 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:16.894518 19524 raft_consensus.cc:2468] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
W20260709 12:13:16.901167 19472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:16.887857 19671 raft_consensus.cc:3060] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.910337 19521 raft_consensus.cc:2393] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 1: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:16.913250 19525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:16.913489 20245 raft_consensus.cc:2804] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.914350 20245 raft_consensus.cc:697] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:16.915314 20245 consensus_queue.cc:237] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:16.923993 19567 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:16.924938 19859 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:16.925261 20077 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:16.931429 20200 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.932148 20200 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.934814 20200 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:16.940475 20216 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.966972 19795 ts_tablet_manager.cc:1434] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.146s	user 0.011s	sys 0.000s
I20260709 12:13:16.954793 19673 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:16.970959 20222 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:16.974170 20216 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:16.957374 19794 ts_tablet_manager.cc:1434] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.003s
I20260709 12:13:16.981813 20077 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.982543 20077 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.984985 20077 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:16.985005 19794 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
W20260709 12:13:16.946563 19715 leader_election.cc:343] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:16.961580 20097 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:16.955197 19798 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:16.987949 19798 ts_tablet_manager.cc:1403] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.302s	user 0.017s	sys 0.003s
I20260709 12:13:16.991560 19798 raft_consensus.cc:359] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.966737 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:16.992503 19798 raft_consensus.cc:385] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.992853 19600 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:16.992901 19798 raft_consensus.cc:740] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.994042 19798 consensus_queue.cc:260] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:16.978812 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:16.985880 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:17.017436 19747 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.017590 19597 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.998973 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:17.022046 19600 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:17.006852 19798 ts_tablet_manager.cc:1434] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:17.008731 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:17.010954 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:17.028939 19745 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:16.996786 19420 catalog_manager.cc:5697] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.029397 19523 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:17.043582 19491 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:17.045737 19713 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:17.053356 19420 catalog_manager.cc:5697] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.062107 19798 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: Bootstrap starting.
I20260709 12:13:17.055110 20245 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:17.072331 20245 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.072942 20245 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.072834 19671 raft_consensus.cc:2468] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:17.077118 19565 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:17.078095 20211 raft_consensus.cc:2804] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.067633 20230 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:17.079012 20230 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.079463 20230 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.066776 20252 consensus_queue.cc:1048] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:13:17.078615 20211 raft_consensus.cc:697] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:17.081175 20211 consensus_queue.cc:237] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:17.082482 19715 consensus_peers.cc:597] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.072901 19597 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:17.097921 19795 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:17.128239 19490 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:17.139861 20219 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.148221 19747 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:17.155612 19798 tablet_bootstrap.cc:654] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.142776 20219 raft_consensus.cc:697] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:17.159343 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:17.160226 19600 raft_consensus.cc:3060] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.157949 20097 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:17.156632 19524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:17.182961 19715 leader_election.cc:343] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:17.204792 19600 raft_consensus.cc:2468] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:17.210636 20245 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.212605 19713 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:17.216662 19794 tablet_bootstrap.cc:654] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.219870 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:17.220732 19601 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.186277 20219 consensus_queue.cc:237] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.221742 20097 raft_consensus.cc:2804] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.219866 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:17.222574 20097 raft_consensus.cc:697] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:17.223523 20097 consensus_queue.cc:237] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.225487 19421 catalog_manager.cc:5697] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.230420 20235 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.213164 20245 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:17.234370 20235 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.238502 20230 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.242096 20235 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:17.243877 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:17.244735 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:17.246141 20230 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:17.247833 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:17.248893 19746 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 2: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:17.248903 19639 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:17.254197 20244 consensus_queue.cc:1048] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.261811 19523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:17.262712 19523 raft_consensus.cc:2393] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:17.266347 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:17.268347 20232 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:17.258849 20235 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:17.279975 19671 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.284817 19798 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: No bootstrap required, opened a new log
I20260709 12:13:17.286793 20214 consensus_queue.cc:1048] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.285573 19798 ts_tablet_manager.cc:1403] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.002s
I20260709 12:13:17.292023 20214 consensus_queue.cc:1048] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.297066 19795 tablet_bootstrap.cc:654] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.305989 19601 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:17.307602 19490 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:17.310042 20214 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.310715 20214 raft_consensus.cc:697] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:17.311916 20214 consensus_queue.cc:237] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.324641 19794 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:17.325394 19794 ts_tablet_manager.cc:1403] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.342s	user 0.023s	sys 0.004s
I20260709 12:13:17.335920 19794 raft_consensus.cc:359] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.336921 19794 raft_consensus.cc:385] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.340011 19798 raft_consensus.cc:359] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.341331 19798 raft_consensus.cc:385] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.341675 19798 raft_consensus.cc:740] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.337255 19794 raft_consensus.cc:740] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.342939 19794 consensus_queue.cc:260] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.346846 19794 ts_tablet_manager.cc:1434] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:13:17.355716 20245 consensus_queue.cc:1048] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.359253 19798 consensus_queue.cc:260] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.360378 19795 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:17.360966 19795 ts_tablet_manager.cc:1403] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.303s	user 0.015s	sys 0.002s
I20260709 12:13:17.358492 19794 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: Bootstrap starting.
I20260709 12:13:17.373442 19798 ts_tablet_manager.cc:1434] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:13:17.373562 19795 raft_consensus.cc:359] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.375229 19795 raft_consensus.cc:385] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.375604 19795 raft_consensus.cc:740] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.376534 19795 consensus_queue.cc:260] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.379552 19795 ts_tablet_manager.cc:1434] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:17.380801 19795 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:17.387316 19794 tablet_bootstrap.cc:654] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.435429 19795 tablet_bootstrap.cc:654] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.450861 20214 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.451689 20214 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.454975 20214 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:17.454996 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:17.465669 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:17.466461 19671 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:17.468540 19490 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:17.469208 19601 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 0.
I20260709 12:13:17.469487 20216 raft_consensus.cc:2804] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.470024 20216 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.470389 20216 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.478371 19794 tablet_bootstrap.cc:492] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: No bootstrap required, opened a new log
I20260709 12:13:17.479364 19794 ts_tablet_manager.cc:1403] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: Time spent bootstrapping tablet: real 0.121s	user 0.031s	sys 0.016s
I20260709 12:13:17.482704 19794 raft_consensus.cc:359] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.483516 19794 raft_consensus.cc:385] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.483815 19794 raft_consensus.cc:740] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.483525 20219 consensus_queue.cc:1048] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.484565 19794 consensus_queue.cc:260] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.487138 19794 ts_tablet_manager.cc:1434] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:17.493949 20001 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.494560 20001 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.496527 20001 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:17.498476 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:17.499285 19673 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:17.498585 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:17.500732 19749 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 0.
I20260709 12:13:17.502206 19565 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:17.503111 20001 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.503476 20001 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.503777 20001 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.510362 19422 catalog_manager.cc:5697] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.513393 19422 catalog_manager.cc:5697] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.516598 19422 catalog_manager.cc:5697] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 0 to 1, leader changed from <none> to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 1 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.530648 19795 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:17.531740 19795 ts_tablet_manager.cc:1403] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.004s
I20260709 12:13:17.535748 19795 raft_consensus.cc:359] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:17.536547 19795 raft_consensus.cc:385] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.536151 20001 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.536966 19795 raft_consensus.cc:740] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.537941 19795 consensus_queue.cc:260] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:17.541569 20216 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.553499 20216 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:17.555850 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:17.547747 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:17.556520 19671 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.556912 19749 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.548602 19423 catalog_manager.cc:5697] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } }
I20260709 12:13:17.541702 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:17.561246 19675 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.565213 19671 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:17.544414 20001 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:17.554247 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:17.566695 19598 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.577479 19749 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:17.584283 19490 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:17.585368 20214 raft_consensus.cc:2804] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.585956 20214 raft_consensus.cc:697] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:17.555675 19795 ts_tablet_manager.cc:1434] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:13:17.587476 19795 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:17.592090 19420 catalog_manager.cc:5697] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.595671 19598 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:17.587180 20214 consensus_queue.cc:237] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:17.582528 19675 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:17.597507 19566 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:17.598654 20001 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.599164 20001 raft_consensus.cc:697] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:17.599993 20001 consensus_queue.cc:237] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:17.601991 19420 catalog_manager.cc:5697] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 2, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.597438 19795 tablet_bootstrap.cc:654] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.641146 20230 consensus_queue.cc:1048] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.641901 19421 catalog_manager.cc:5697] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.647428 19524 raft_consensus.cc:3060] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.667800 20214 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.668494 20214 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:17.670914 20214 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:17.674254 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:17.674422 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:17.676082 19490 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:17.678253 20216 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:17.689288 20214 consensus_queue.cc:1048] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.697677 20217 consensus_queue.cc:1048] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:17.711558 19715 consensus_peers.cc:597] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.724433 20211 consensus_queue.cc:1048] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.738996 19795 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: No bootstrap required, opened a new log
I20260709 12:13:17.739671 19795 ts_tablet_manager.cc:1403] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.016s
I20260709 12:13:17.738101 19424 catalog_manager.cc:5697] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.745733 19749 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:17.743325 19795 raft_consensus.cc:359] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.752007 19795 raft_consensus.cc:385] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.752429 19795 raft_consensus.cc:740] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.756875 20245 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.753255 19795 consensus_queue.cc:260] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.761049 19795 ts_tablet_manager.cc:1434] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:13:17.771015 19601 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:17.774914 20214 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.798377 20074 consensus_queue.cc:1048] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.862859 20214 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.863404 20214 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:17.865598 20214 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:17.868921 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:17.877048 19524 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.877599 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:17.879405 19491 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:17.880569 20219 raft_consensus.cc:2749] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:17.983553 20214 consensus_queue.cc:1048] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.990621 20214 consensus_queue.cc:1048] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:18.048671 20211 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:18.059836 20217 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:18.325181 19524 raft_consensus.cc:3060] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.715874 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
W20260709 12:13:18.719906 19715 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:18.734082 19715 consensus_peers.cc:597] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.734890 19715 consensus_peers.cc:597] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.789896 19715 consensus_peers.cc:597] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.794979 19641 consensus_peers.cc:597] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.807212 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:18.808398 19567 consensus_peers.cc:597] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.808605 10697 tablet_replica.cc:333] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.809718 10697 raft_consensus.cc:2243] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.810643 10697 raft_consensus.cc:2272] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.813246 10697 tablet_replica.cc:333] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.814136 10697 raft_consensus.cc:2243] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.814714 10697 raft_consensus.cc:2272] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.816910 10697 tablet_replica.cc:333] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.817745 10697 raft_consensus.cc:2243] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.818814 10697 raft_consensus.cc:2272] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.821576 10697 tablet_replica.cc:333] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.822475 10697 raft_consensus.cc:2243] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.823045 10697 raft_consensus.cc:2272] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.825773 10697 tablet_replica.cc:333] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.826575 10697 raft_consensus.cc:2243] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.827087 10697 raft_consensus.cc:2272] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.829458 10697 tablet_replica.cc:333] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.830338 10697 raft_consensus.cc:2243] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.830749 10697 raft_consensus.cc:2272] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.832979 10697 tablet_replica.cc:333] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.833773 10697 raft_consensus.cc:2243] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.834900 10697 raft_consensus.cc:2272] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.837723 10697 tablet_replica.cc:333] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.838749 10697 raft_consensus.cc:2243] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.839197 10697 raft_consensus.cc:2272] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.841427 10697 tablet_replica.cc:333] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.842079 10697 raft_consensus.cc:2243] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.842877 10697 raft_consensus.cc:2272] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.845323 10697 tablet_replica.cc:333] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.846189 10697 raft_consensus.cc:2243] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.847319 10697 raft_consensus.cc:2272] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.850232 10697 tablet_replica.cc:333] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
W20260709 12:13:18.850808 19567 consensus_peers.cc:597] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.851079 10697 raft_consensus.cc:2243] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.851725 10697 raft_consensus.cc:2272] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.854058 10697 tablet_replica.cc:333] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.854780 10697 raft_consensus.cc:2243] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.855409 10697 raft_consensus.cc:2272] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.858572 10697 tablet_replica.cc:333] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.859445 10697 raft_consensus.cc:2243] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.860067 10697 raft_consensus.cc:2272] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.863229 10697 tablet_replica.cc:333] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
W20260709 12:13:18.863827 19567 consensus_peers.cc:597] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.864136 10697 raft_consensus.cc:2243] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.864851 10697 raft_consensus.cc:2272] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.867978 10697 tablet_replica.cc:333] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.868889 10697 raft_consensus.cc:2243] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.870014 10697 raft_consensus.cc:2272] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.871122 19641 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.870026 19567 consensus_peers.cc:597] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.872764 10697 tablet_replica.cc:333] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.873672 10697 raft_consensus.cc:2243] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.874725 10697 raft_consensus.cc:2272] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.877842 10697 tablet_replica.cc:333] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.878778 10697 raft_consensus.cc:2243] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.879318 10697 raft_consensus.cc:2272] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.880218 19715 consensus_peers.cc:597] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.881984 10697 tablet_replica.cc:333] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.882721 10697 raft_consensus.cc:2243] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.883249 10697 raft_consensus.cc:2272] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.886068 10697 tablet_replica.cc:333] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.886900 10697 raft_consensus.cc:2243] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.887478 10697 raft_consensus.cc:2272] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.889626 10697 tablet_replica.cc:333] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.890214 10697 raft_consensus.cc:2243] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.890673 10697 raft_consensus.cc:2272] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.893059 10697 tablet_replica.cc:333] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.893913 10697 raft_consensus.cc:2243] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.894409 10697 raft_consensus.cc:2272] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.896641 10697 tablet_replica.cc:333] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.897214 10697 raft_consensus.cc:2243] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.897727 10697 raft_consensus.cc:2272] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.899643 10697 tablet_replica.cc:333] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.900255 10697 raft_consensus.cc:2243] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.900679 10697 raft_consensus.cc:2272] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.902514 10697 tablet_replica.cc:333] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.903105 10697 raft_consensus.cc:2243] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.903529 10697 raft_consensus.cc:2272] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.905761 10697 tablet_replica.cc:333] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.906374 10697 raft_consensus.cc:2243] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.906816 10697 raft_consensus.cc:2272] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.909950 10697 tablet_replica.cc:333] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.910760 10697 raft_consensus.cc:2243] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.911931 10697 raft_consensus.cc:2272] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.914908 10697 tablet_replica.cc:333] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.915760 10697 raft_consensus.cc:2243] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.916718 10697 raft_consensus.cc:2272] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.919248 10697 tablet_replica.cc:333] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
W20260709 12:13:18.919422 19715 consensus_peers.cc:597] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.920024 10697 raft_consensus.cc:2243] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.920728 10697 raft_consensus.cc:2272] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.923069 10697 tablet_replica.cc:333] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.923852 10697 raft_consensus.cc:2243] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.924475 10697 raft_consensus.cc:2272] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.927667 10697 tablet_replica.cc:333] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.928512 10697 raft_consensus.cc:2243] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:18.928787 19567 consensus_peers.cc:597] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.929534 10697 raft_consensus.cc:2272] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.930529 19567 consensus_peers.cc:597] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.932331 10697 tablet_replica.cc:333] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.933300 10697 raft_consensus.cc:2243] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.934434 10697 raft_consensus.cc:2272] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.935561 19567 consensus_peers.cc:597] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.937528 10697 tablet_replica.cc:333] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.938534 10697 raft_consensus.cc:2243] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.939142 10697 raft_consensus.cc:2272] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.941715 10697 tablet_replica.cc:333] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.942408 10697 raft_consensus.cc:2243] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.942951 10697 raft_consensus.cc:2272] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.945684 10697 tablet_replica.cc:333] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.946376 10697 raft_consensus.cc:2243] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.947189 10697 raft_consensus.cc:2272] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.949460 10697 tablet_replica.cc:333] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.950098 10697 raft_consensus.cc:2243] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.950521 10697 raft_consensus.cc:2272] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.952647 10697 tablet_replica.cc:333] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.953176 10697 raft_consensus.cc:2243] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.954071 10697 raft_consensus.cc:2272] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.956633 10697 tablet_replica.cc:333] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.957260 10697 raft_consensus.cc:2243] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.957757 10697 raft_consensus.cc:2272] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.960109 10697 tablet_replica.cc:333] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.960856 10697 raft_consensus.cc:2243] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.961987 10697 raft_consensus.cc:2272] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.964735 19567 consensus_peers.cc:597] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.965108 10697 tablet_replica.cc:333] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.966120 10697 raft_consensus.cc:2243] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:18.966404 19715 consensus_peers.cc:597] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.966697 10697 raft_consensus.cc:2272] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.968984 19715 consensus_peers.cc:597] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.969789 10697 tablet_replica.cc:333] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.970408 10697 raft_consensus.cc:2243] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.970916 10697 raft_consensus.cc:2272] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.973423 10697 tablet_replica.cc:333] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.974160 10697 raft_consensus.cc:2243] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.974682 10697 raft_consensus.cc:2272] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.977119 10697 tablet_replica.cc:333] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.977795 10697 raft_consensus.cc:2243] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.978766 10697 raft_consensus.cc:2272] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.981143 10697 tablet_replica.cc:333] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.981848 10697 raft_consensus.cc:2243] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.982870 10697 raft_consensus.cc:2272] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.985590 10697 tablet_replica.cc:333] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.986126 10697 raft_consensus.cc:2243] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.986593 10697 raft_consensus.cc:2272] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.988933 10697 tablet_replica.cc:333] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: stopping tablet replica
I20260709 12:13:18.989629 10697 raft_consensus.cc:2243] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.990195 10697 raft_consensus.cc:2272] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.994743 19641 consensus_peers.cc:597] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.000336 19715 consensus_peers.cc:597] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.018673 19641 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.041926 19567 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.043027 19567 consensus_peers.cc:597] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.067150 19641 consensus_peers.cc:597] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.084650 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
W20260709 12:13:19.092840 19715 consensus_peers.cc:597] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.099076 19715 consensus_peers.cc:597] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.175652 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:19.188598 19715 consensus_peers.cc:597] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.189635 20310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:19.190557 20309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:19.197686 19641 consensus_peers.cc:597] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.200049 10697 server_base.cc:1061] running on GCE node
W20260709 12:13:19.200654 20314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:19.206655 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:19.207209 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:19.207463 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599199207437 us; error 0 us; skew 500 ppm
I20260709 12:13:19.208451 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:19.212846 10697 webserver.cc:533] Webserver started at http://127.10.114.65:33695/ using document root <none> and password file <none>
I20260709 12:13:19.213423 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:19.213689 10697 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:19.218588 10697 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.004s
W20260709 12:13:19.233152 19715 consensus_peers.cc:597] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.233256 20320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:19.234563 10697 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:19.234997 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "572e5980055c424db2e88348b978bd27"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-08l4"
I20260709 12:13:19.235450 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:19.249054 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:19.251509 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:19.254958 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:19.266825 20329 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:13:19.280978 19715 consensus_peers.cc:597] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.611949 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:13:19.612393 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.347s	user 0.012s	sys 0.000s
I20260709 12:13:19.612725 10697 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:13:19.618204 20329 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.640141 20329 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.641403 20329 tablet_bootstrap.cc:492] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.642174 20329 ts_tablet_manager.cc:1403] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:13:19.645071 20329 raft_consensus.cc:359] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.645709 20329 raft_consensus.cc:740] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.646327 20329 consensus_queue.cc:260] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.648576 20329 ts_tablet_manager.cc:1434] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:19.649341 20329 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.669380 20329 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.670488 20329 tablet_bootstrap.cc:492] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.671239 20329 ts_tablet_manager.cc:1403] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:13:19.673972 20329 raft_consensus.cc:359] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.674707 20329 raft_consensus.cc:740] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.675513 20329 consensus_queue.cc:260] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.677655 20329 ts_tablet_manager.cc:1434] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:19.678511 20329 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.695295 20329 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.696388 20329 tablet_bootstrap.cc:492] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.697170 20329 ts_tablet_manager.cc:1403] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:13:19.699787 20329 raft_consensus.cc:359] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:19.701660 20329 raft_consensus.cc:740] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.702669 20329 consensus_queue.cc:260] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:19.704797 20329 ts_tablet_manager.cc:1434] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:19.705700 20329 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.717587 20329 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.718456 20329 tablet_bootstrap.cc:492] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.719058 20329 ts_tablet_manager.cc:1403] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:13:19.721077 20329 raft_consensus.cc:359] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.721683 20329 raft_consensus.cc:740] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.722345 20329 consensus_queue.cc:260] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.723862 20329 ts_tablet_manager.cc:1434] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:19.724649 20329 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.740273 20329 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.741345 20329 tablet_bootstrap.cc:492] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.742056 20329 ts_tablet_manager.cc:1403] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:13:19.744962 20329 raft_consensus.cc:359] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.745734 20329 raft_consensus.cc:740] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.746486 20329 consensus_queue.cc:260] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.748445 20329 ts_tablet_manager.cc:1434] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:19.749267 20329 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.764039 20329 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.764858 20329 tablet_bootstrap.cc:492] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.765424 20329 ts_tablet_manager.cc:1403] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:13:19.767462 20329 raft_consensus.cc:359] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:19.767993 20329 raft_consensus.cc:740] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.768838 20329 consensus_queue.cc:260] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:19.770622 20329 ts_tablet_manager.cc:1434] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:13:19.771472 20329 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.783023 20244 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.783834 20244 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.787264 20244 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:19.788214 20329 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.789623 20329 tablet_bootstrap.cc:492] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.790311 20329 ts_tablet_manager.cc:1403] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:13:19.793495 20329 raft_consensus.cc:359] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.794210 20329 raft_consensus.cc:740] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.795006 20329 consensus_queue.cc:260] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.797076 20329 ts_tablet_manager.cc:1434] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:13:19.798283 20329 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.801445 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:19.806706 19715 leader_election.cc:336] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.807616 19713 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:19.813944 20230 raft_consensus.cc:2749] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.821333 20329 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.821506 20330 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.822110 20330 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.822602 20329 tablet_bootstrap.cc:492] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.823489 20329 ts_tablet_manager.cc:1403] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:13:19.825486 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:19.827224 20330 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:19.826958 20329 raft_consensus.cc:359] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.827844 20329 raft_consensus.cc:740] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.828649 20329 consensus_queue.cc:260] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.830827 20329 ts_tablet_manager.cc:1434] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:19.832051 20329 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:19.849396 19567 leader_election.cc:336] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.850023 19567 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:19.854080 20001 raft_consensus.cc:2749] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.861852 20329 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.863096 20329 tablet_bootstrap.cc:492] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.863878 20329 ts_tablet_manager.cc:1403] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 12:13:19.867190 20329 raft_consensus.cc:359] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:19.867969 20329 raft_consensus.cc:740] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.868716 20329 consensus_queue.cc:260] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:19.871119 20329 ts_tablet_manager.cc:1434] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:19.872028 20329 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.884243 20235 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.884968 20235 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.887298 20235 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:19.887974 20235 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.888445 20235 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.890738 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:19.891288 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:19.892155 20329 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.893193 20329 tablet_bootstrap.cc:492] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.893579 20235 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:19.893965 20329 ts_tablet_manager.cc:1403] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:13:19.897279 20329 raft_consensus.cc:359] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.898442 20329 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.897280 20244 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.897889 10697 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:13:19.900223 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.288s	user 0.270s	sys 0.009s
I20260709 12:13:19.900157 20244 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:19.902026 19641 leader_election.cc:336] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.902503 20244 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:19.902726 19641 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:19.899427 20329 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:19.905718 20329 ts_tablet_manager.cc:1434] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:19.906610 20329 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:19.908349 19641 leader_election.cc:336] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.909047 19641 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:19.909751 20235 raft_consensus.cc:2749] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:19.909732 19715 leader_election.cc:336] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.911399 20150 raft_consensus.cc:2749] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.913825 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:19.915772 19713 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:19.917418 20244 raft_consensus.cc:2749] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.931949 20329 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.933342 20329 tablet_bootstrap.cc:492] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.934365 20329 ts_tablet_manager.cc:1403] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.007s
I20260709 12:13:19.938150 20329 raft_consensus.cc:359] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.939087 20329 raft_consensus.cc:740] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.940223 20329 consensus_queue.cc:260] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.942939 20329 ts_tablet_manager.cc:1434] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:19.944118 20329 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.965461 20329 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.966811 20329 tablet_bootstrap.cc:492] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:19.967756 20329 ts_tablet_manager.cc:1403] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:13:19.971184 20329 raft_consensus.cc:359] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.972168 20329 raft_consensus.cc:740] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.972854 20329 consensus_queue.cc:260] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.974352 20001 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.974829 20329 ts_tablet_manager.cc:1434] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:19.974938 20001 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:19.975585 20329 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:19.977169 20001 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:19.984122 19567 leader_election.cc:336] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:19.989778 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:19.992064 19566 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:19.993042 20001 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.997936 20235 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:19.998876 20235 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.001597 20150 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.002322 20150 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.004753 20329 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.006070 20329 tablet_bootstrap.cc:492] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:20.006898 20329 ts_tablet_manager.cc:1403] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 12:13:20.009953 20329 raft_consensus.cc:359] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.010880 20329 raft_consensus.cc:740] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:20.011706 20329 consensus_queue.cc:260] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.013849 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.014344 20329 ts_tablet_manager.cc:1434] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:20.015472 20329 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:20.019105 20230 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.019791 20230 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:20.026762 19641 leader_election.cc:336] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.004711 20150 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.032940 20235 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.036262 20230 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:20.062453 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 51816.9us
I20260709 12:13:20.049644 19639 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:20.065023 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.067257 20319 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:20.060294 20001 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.069391 20001 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.072616 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.073302 19673 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.074625 19565 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.075438 20330 raft_consensus.cc:2804] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.075806 20330 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.076189 20330 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:20.079210 19567 leader_election.cc:336] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.082320 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.086140 20244 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.086952 20244 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.090032 20319 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.090845 20319 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.093076 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.093873 19598 raft_consensus.cc:2468] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.098174 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.096932 20150 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.107905 20150 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.110581 19713 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.111820 20230 raft_consensus.cc:2804] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.101653 20244 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.112277 20230 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.102988 20235 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.112768 20230 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.113225 20235 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.115907 20235 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.103343 20395 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.118489 20395 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.093516 20319 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.124185 20150 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.124680 20001 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:20.125841 19715 leader_election.cc:336] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.126394 19715 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:20.127184 20244 raft_consensus.cc:2749] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:20.129403 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.133641 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.134696 19746 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.137913 19640 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.139204 20235 raft_consensus.cc:2804] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.139748 20235 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.141476 20235 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.145176 20395 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.150842 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:20.147485 19641 leader_election.cc:336] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.151957 19641 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:20.151858 19599 raft_consensus.cc:2468] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.162811 19639 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.163698 20397 raft_consensus.cc:2749] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:20.163798 20150 raft_consensus.cc:2804] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.164669 20150 raft_consensus.cc:493] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.165210 20150 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.153828 20330 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.169353 20330 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:20.174407 19641 leader_election.cc:336] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.175246 19641 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:20.177871 20395 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:20.177970 19641 leader_election.cc:336] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.179219 19641 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:20.179983 20395 raft_consensus.cc:2749] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:20.180755 19567 leader_election.cc:336] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.181246 20400 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
W20260709 12:13:20.181110 19641 leader_election.cc:336] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.181921 20400 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.182664 20329 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:20.182539 19641 leader_election.cc:336] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.183730 20329 tablet_bootstrap.cc:492] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:20.184151 20400 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.184475 20329 ts_tablet_manager.cc:1403] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.169s	user 0.049s	sys 0.021s
I20260709 12:13:20.185110 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.185771 19675 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.188046 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.191995 20230 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.202382 20329 raft_consensus.cc:359] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.203235 20329 raft_consensus.cc:740] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
W20260709 12:13:20.197209 19715 leader_election.cc:336] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:20.209030 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:20.209789 19599 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.211024 20230 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.214198 20329 consensus_queue.cc:260] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.220162 20329 ts_tablet_manager.cc:1434] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:13:20.221589 20329 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:20.222645 19599 raft_consensus.cc:2468] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:20.229127 19713 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.230115 20400 raft_consensus.cc:2804] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.230643 20400 raft_consensus.cc:697] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:20.231665 19675 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:20.231570 20400 consensus_queue.cc:237] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.233978 19565 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:20.235095 20325 raft_consensus.cc:2804] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.235567 20325 raft_consensus.cc:697] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:20.237324 20150 raft_consensus.cc:515] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.236390 20325 consensus_queue.cc:237] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.225706 20330 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.225945 20406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:46269 every 8 connection(s)
I20260709 12:13:20.226086 20235 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.238859 20330 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.241703 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.242357 19746 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.239801 20150 leader_election.cc:290] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.241068 20235 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.225780 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:46269
I20260709 12:13:20.240968 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:20.246520 19601 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.254626 20235 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.255491 20235 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.259789 20230 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.260571 20230 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.263259 20244 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.263811 20244 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.266775 20395 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.267385 20395 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.270769 20235 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.270658 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.271576 19598 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.272439 19601 raft_consensus.cc:2468] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.273026 20330 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.273240 19639 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.312346 19423 catalog_manager.cc:5697] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.315464 20150 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.276223 20244 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.276330 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.315788 19639 leader_election.cc:304] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.316416 19675 raft_consensus.cc:2468] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.276602 20230 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.277834 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.278846 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.315869 20150 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.318029 19749 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.318302 20150 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.322362 19640 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.323283 20394 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.280052 20395 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.284240 20397 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.324236 20397 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.324486 19713 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.327242 20244 raft_consensus.cc:2804] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.327692 20244 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.327960 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.328104 20244 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.328091 20407 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.328976 20407 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.331488 20407 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.286465 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.337920 20150 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.340495 19673 raft_consensus.cc:2393] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:20.345511 20244 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.346854 20150 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.347105 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:20.347783 19601 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.348508 20244 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.349267 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.350049 19673 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.357215 19601 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.358779 20230 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.360170 19639 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.359459 20230 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.361162 20150 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.362439 20150 raft_consensus.cc:697] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:20.362605 20230 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.363708 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:20.360152 19673 raft_consensus.cc:2468] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:20.363369 20150 consensus_queue.cc:237] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.366983 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.367870 20415 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.368470 20415 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.371842 20415 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.371986 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.287650 20414 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.297647 20325 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.373440 20325 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.374117 19713 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.375252 20230 raft_consensus.cc:2804] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.375701 20325 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.375865 20230 raft_consensus.cc:697] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:20.310457 19746 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.317317 20319 raft_consensus.cc:2804] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.377584 20319 raft_consensus.cc:697] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:20.377635 20230 consensus_queue.cc:237] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.332355 19749 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.323696 20394 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.284881 20001 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.326718 20397 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.380000 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.380290 20001 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.380935 19640 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.381426 19598 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.381844 20397 raft_consensus.cc:2804] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.382375 20397 raft_consensus.cc:697] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:20.382536 20001 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.333856 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.383366 19675 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.383267 20397 consensus_queue.cc:237] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.383898 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.372794 19671 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.378624 20319 consensus_queue.cc:237] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.380002 20394 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.387472 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.387691 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.388170 19746 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.388396 19749 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.389861 19640 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.390064 19566 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.391053 20235 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.391089 19566 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.391634 20235 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.392102 20235 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.392817 20001 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.393244 20001 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.393651 20001 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.397775 20244 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.398391 19565 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.398488 20244 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.399616 19713 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.399268 20330 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.400720 20330 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.400972 20400 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.401679 20400 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.401773 19565 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.402233 20400 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.402593 20407 raft_consensus.cc:2804] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.403033 20407 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.403460 20407 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.401142 20330 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.379038 19601 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.410293 19713 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.410969 20414 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.411423 20395 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.411852 20331 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.412267 20395 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.412446 20331 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.413455 20414 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.413884 20411 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40525
I20260709 12:13:20.416993 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.430382 20411 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:20.430699 19746 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.431432 20411 heartbeater.cc:507] Master 127.10.114.126:40525 requested a full tablet report, sending...
I20260709 12:13:20.420732 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.422724 20331 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.435925 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.436599 19675 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.422870 20244 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.426038 20325 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.415187 20418 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.416393 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.438876 19671 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:20.438731 20418 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.439541 20325 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.440033 20325 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.426831 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.420912 20329 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.441687 20395 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.441375 20418 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.442619 20329 tablet_bootstrap.cc:492] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:20.443401 20329 ts_tablet_manager.cc:1403] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.222s	user 0.013s	sys 0.012s
I20260709 12:13:20.416258 20394 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.444121 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:20.444747 19675 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:20.448899 19713 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.449332 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.449832 19713 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.424962 20235 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.420267 20407 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.452457 20235 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.454239 20407 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.457880 20331 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.458396 20331 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.458748 20331 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.434197 20424 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.480294 20329 raft_consensus.cc:359] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.481556 20329 raft_consensus.cc:740] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:20.482576 20329 consensus_queue.cc:260] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.488296 20329 ts_tablet_manager.cc:1434] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:13:20.489676 20329 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:20.491861 20001 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.500206 20400 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.501523 20001 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.502540 20400 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:20.497377 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 78001.4us
I20260709 12:13:20.514154 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.515192 19671 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.517645 19565 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.519237 20001 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.519721 20001 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.520136 20001 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.485162 20244 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.561901 19640 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:20.533975 20423 log.cc:927] Time spent T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:13:20.479924 20424 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
W20260709 12:13:20.552253 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 127039us
I20260709 12:13:20.569213 19671 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:20.572129 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:20.573186 19749 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:20.571201 19565 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.574362 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.494302 20330 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.577809 19566 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.541814 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.579432 19745 raft_consensus.cc:2393] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 2: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:20.582086 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.582284 20431 raft_consensus.cc:2804] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.582855 20319 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:20.566592 20244 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.583577 20394 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.584640 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.586064 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.572214 20424 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.610191 19746 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.616552 19747 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.607208 20244 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.605137 20319 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.625871 19747 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.626334 20319 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.614509 20001 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.606822 20331 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.607645 20415 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:20.606314 20325 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:20.701483 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 139028us
I20260709 12:13:20.703891 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:20.705906 19601 raft_consensus.cc:2393] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:20.703094 20001 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.709333 19640 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.641499 20415 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:20.713949 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.714768 19675 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.717357 20325 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.713836 20415 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:20.714226 20395 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.754515 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.774299 20370 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.754546 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.775204 20376 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:20.732677 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.754750 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.752239 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.771732 19421 catalog_manager.cc:5697] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.771377 19420 catalog_manager.cc:5697] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.759745 20395 raft_consensus.cc:697] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:20.789011 20331 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.781031 20431 raft_consensus.cc:697] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:20.786000 20374 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.799127 19675 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:20.801052 20395 consensus_queue.cc:237] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.817862 19565 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.822322 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.822952 19673 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.823145 20325 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.823678 20325 raft_consensus.cc:697] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:20.824536 20325 consensus_queue.cc:237] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.745260 20244 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.805795 20431 consensus_queue.cc:237] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.826784 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.832284 20244 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.837728 19601 raft_consensus.cc:1275] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.808687 19746 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.754204 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:20.849869 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.814721 20330 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:20.754386 20424 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.753942 20415 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:20.850546 19675 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.813696 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.821677 19598 raft_consensus.cc:1275] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.851289 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:20.848949 19673 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
W20260709 12:13:20.852659 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 64269us
I20260709 12:13:20.856062 19565 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:20.863662 20415 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.863981 19675 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:20.864470 20442 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.865063 20442 raft_consensus.cc:697] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:20.866012 20442 consensus_queue.cc:237] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:20.866489 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.867213 19749 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:20.871778 19640 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.877383 19745 raft_consensus.cc:2393] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 2: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:20.869354 19668 raft_consensus.cc:1275] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.860440 20150 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:13:20.885699 20319 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.888152 20319 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:20.869884 20372 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.889925 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.891633 20424 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:20.885736 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.879050 20235 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.889997 19671 raft_consensus.cc:2393] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:20.895910 19749 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:20.896694 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:20.888163 19715 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:20.900655 19641 leader_election.cc:343] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.900705 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:20.901998 19641 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:20.903306 19641 leader_election.cc:343] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.908918 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:20.910032 19749 raft_consensus.cc:2393] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
W20260709 12:13:20.910135 19715 leader_election.cc:343] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:20.911444 19715 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.903283 20376 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:20.913203 19715 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.904217 20235 raft_consensus.cc:697] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:20.920475 19749 raft_consensus.cc:1275] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.911782 20424 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:20.919643 19715 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.900694 19713 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:20.924851 19715 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:20.933862 19715 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:20.935221 19715 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.939584 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:20.940781 19599 raft_consensus.cc:2393] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:20.945369 20440 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.946028 20440 raft_consensus.cc:697] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:20.947011 20440 consensus_queue.cc:237] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.948940 20439 consensus_queue.cc:1048] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 12:13:20.951673 19641 leader_election.cc:343] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:20.952775 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.950901 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:20.941579 19668 raft_consensus.cc:1275] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.976516 20329 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.983448 20235 consensus_queue.cc:237] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:20.993046 20374 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:20.984866 20230 consensus_queue.cc:1048] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.936605 20319 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:13:20.975975 19566 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:20.998252 19601 raft_consensus.cc:1275] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.004557 20376 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
W20260709 12:13:21.021382 19715 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.021994 19715 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:21.025381 20415 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:21.017848 20445 consensus_queue.cc:1048] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:13:21.044732 20329 tablet_bootstrap.cc:492] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.046096 20329 ts_tablet_manager.cc:1403] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.557s	user 0.023s	sys 0.019s
I20260709 12:13:21.026813 20439 raft_consensus.cc:2749] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:21.060904 20330 consensus_queue.cc:1048] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.056348 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.047500 20415 raft_consensus.cc:697] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:21.078778 20329 raft_consensus.cc:359] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.079679 20329 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.080753 20329 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.085815 20329 ts_tablet_manager.cc:1434] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:13:21.075538 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.119029 20415 consensus_queue.cc:237] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.129019 20329 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.132563 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.134143 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.134912 20366 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:21.135883 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.136593 20371 raft_consensus.cc:3060] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.136781 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.138917 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.142023 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.143733 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:21.104449 19420 ts_manager.cc:194] Re-registered known tserver with Master: 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:21.159643 20371 raft_consensus.cc:2468] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:21.117287 20372 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:21.170797 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.172124 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.177160 20370 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.191372 19421 catalog_manager.cc:5697] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.210568 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.210311 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.227432 20375 raft_consensus.cc:1275] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.229367 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.231269 20329 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.231416 20375 raft_consensus.cc:1275] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.232743 20329 tablet_bootstrap.cc:492] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.233757 20329 ts_tablet_manager.cc:1403] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.008s
W20260709 12:13:21.235574 19715 consensus_peers.cc:597] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.236312 19715 leader_election.cc:343] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.236850 20329 raft_consensus.cc:359] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.237897 20329 raft_consensus.cc:740] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.238646 20329 consensus_queue.cc:260] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:21.240118 19715 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.242075 19715 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:21.243463 20439 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:21.249466 19421 catalog_manager.cc:5697] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:21.251916 19421 catalog_manager.cc:5697] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.258569 20329 ts_tablet_manager.cc:1434] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:13:21.259656 20329 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.264640 20370 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:21.289835 20329 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.292354 20329 tablet_bootstrap.cc:492] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.306584 20329 ts_tablet_manager.cc:1403] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.015s
I20260709 12:13:21.310799 20329 raft_consensus.cc:359] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.311856 20329 raft_consensus.cc:740] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.312939 20329 consensus_queue.cc:260] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.315200 20329 ts_tablet_manager.cc:1434] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:21.316303 20329 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.318322 19567 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:21.319579 20426 raft_consensus.cc:2749] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:21.323143 19567 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:21.324286 19567 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:21.325356 19567 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.325995 19567 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:21.326768 20319 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:21.327260 19641 consensus_peers.cc:597] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.328255 19641 leader_election.cc:343] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.328814 19641 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:21.329171 19567 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.329402 20415 raft_consensus.cc:2749] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:21.330953 19567 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.331190 20319 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:21.334800 19567 consensus_peers.cc:597] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.336006 19567 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.337894 20319 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.336443 19567 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:21.342602 19567 leader_election.cc:343] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:21.343997 19567 leader_election.cc:343] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.346590 20426 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:21.348749 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:21.350344 20329 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.351147 20368 raft_consensus.cc:1275] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.351468 20329 tablet_bootstrap.cc:492] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.352247 20329 ts_tablet_manager.cc:1403] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.012s
I20260709 12:13:21.353063 20368 raft_consensus.cc:1275] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.355531 20329 raft_consensus.cc:359] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.356305 20329 raft_consensus.cc:740] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.357060 20329 consensus_queue.cc:260] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.359345 20329 ts_tablet_manager.cc:1434] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:21.360210 20329 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.360666 19673 raft_consensus.cc:1275] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.363058 20415 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:21.375734 19715 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:21.376322 19715 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:21.376453 19424 catalog_manager.cc:5697] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.377909 20400 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:21.378782 19673 raft_consensus.cc:1275] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.380489 20426 consensus_queue.cc:1048] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:21.381919 19715 consensus_peers.cc:597] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.378888 19424 catalog_manager.cc:5697] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.394244 19424 catalog_manager.cc:5697] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 2 to 3, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:21.410907 19641 consensus_peers.cc:597] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.410020 20426 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:21.410962 20415 consensus_queue.cc:1048] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:21.427290 19424 catalog_manager.cc:5697] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.430111 19424 catalog_manager.cc:5697] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } }
I20260709 12:13:21.439965 19420 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41962
I20260709 12:13:21.445835 20411 heartbeater.cc:499] Master 127.10.114.126:40525 was elected leader, sending a full tablet report...
I20260709 12:13:21.454581 19745 raft_consensus.cc:1275] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.457231 19423 catalog_manager.cc:5697] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.458881 20319 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.459852 19423 catalog_manager.cc:5697] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 2, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.463109 19675 raft_consensus.cc:1275] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.465898 20439 consensus_queue.cc:1048] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.466454 19675 raft_consensus.cc:1275] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.469705 20418 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.521492 19746 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:21.526432 20426 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:21.528043 19715 consensus_peers.cc:597] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.551643 19567 consensus_peers.cc:597] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.556427 20329 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.566804 20368 raft_consensus.cc:1275] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.578748 20329 tablet_bootstrap.cc:492] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.579797 20329 ts_tablet_manager.cc:1403] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.220s	user 0.068s	sys 0.064s
I20260709 12:13:21.582684 20329 raft_consensus.cc:359] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.583439 20329 raft_consensus.cc:740] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.584177 19749 raft_consensus.cc:1275] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.584546 20329 consensus_queue.cc:260] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.586650 20235 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.587137 20329 ts_tablet_manager.cc:1434] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:21.588104 20329 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:21.611683 20482 log.cc:927] Time spent T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 12:13:21.629065 20235 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:21.631319 19641 consensus_peers.cc:597] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.636415 20329 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.637990 20329 tablet_bootstrap.cc:492] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.639317 20329 ts_tablet_manager.cc:1403] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.010s
I20260709 12:13:21.642347 20329 raft_consensus.cc:359] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.643154 20329 raft_consensus.cc:740] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.643960 20329 consensus_queue.cc:260] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.646561 20329 ts_tablet_manager.cc:1434] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:21.647521 20329 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:21.660873 19567 consensus_peers.cc:597] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.666854 20372 raft_consensus.cc:3060] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.715507 20329 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.716866 20329 tablet_bootstrap.cc:492] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.718128 20329 ts_tablet_manager.cc:1403] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.071s	user 0.037s	sys 0.023s
I20260709 12:13:21.721160 20329 raft_consensus.cc:359] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.722005 20329 raft_consensus.cc:740] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.723809 20329 consensus_queue.cc:260] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.726390 20329 ts_tablet_manager.cc:1434] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:21.727546 20329 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.753491 20329 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.754774 20329 tablet_bootstrap.cc:492] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.755622 20329 ts_tablet_manager.cc:1403] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:13:21.758744 20329 raft_consensus.cc:359] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.759336 20329 raft_consensus.cc:740] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.760164 20329 consensus_queue.cc:260] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:21.762358 20329 ts_tablet_manager.cc:1434] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:13:21.762826 19641 consensus_peers.cc:597] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.763494 20329 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.815620 20329 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.817997 20329 tablet_bootstrap.cc:492] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.818897 20329 ts_tablet_manager.cc:1403] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.008s
I20260709 12:13:21.822738 20329 raft_consensus.cc:359] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.823668 20329 raft_consensus.cc:740] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.824590 20329 consensus_queue.cc:260] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.826820 20329 ts_tablet_manager.cc:1434] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:21.827765 20329 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.859397 20329 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.860796 20329 tablet_bootstrap.cc:492] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.861756 20329 ts_tablet_manager.cc:1403] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.007s
I20260709 12:13:21.864843 20329 raft_consensus.cc:359] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.865799 20329 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.866623 20329 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.869755 20329 ts_tablet_manager.cc:1434] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:21.876718 20329 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:21.916447 20368 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.916986 20329 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.921098 20329 tablet_bootstrap.cc:492] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:21.922017 20329 ts_tablet_manager.cc:1403] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.004s
I20260709 12:13:21.925408 20329 raft_consensus.cc:359] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.926391 20329 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.927420 20329 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:21.942868 20329 ts_tablet_manager.cc:1434] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:13:21.944398 20329 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:23.391701 20502 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.392452 20502 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.385295 20319 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.394318 20503 raft_consensus.cc:493] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.397893 20503 raft_consensus.cc:515] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.394271 20319 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.446782 20319 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.444221 20462 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.438485 20500 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.459645 20506 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.448293 20230 raft_consensus.cc:493] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.464301 20501 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.464980 20501 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.467974 20501 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.468516 20501 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.454272 20319 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.469007 20501 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.456647 20507 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.473157 20230 raft_consensus.cc:515] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.477391 20504 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.478076 20504 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.479843 20230 leader_election.cc:290] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.480552 20504 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.481145 20504 raft_consensus.cc:493] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.481559 20502 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.482060 20504 raft_consensus.cc:515] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.482401 20502 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.483120 20502 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.460702 20500 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.451339 20462 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.473991 20319 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.484337 20504 leader_election.cc:290] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.493750 20319 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.474139 20506 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.488269 20500 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.491215 20462 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.511567 20230 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.513751 20502 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.485828 20507 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.520362 20504 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.536135 20511 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.537315 20511 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.538118 20504 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.540536 20504 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.540699 20511 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:23.541141 19622 debug-util.cc:398] Leaking SignalData structure 0x7b080029fb00 after lost signal to thread 10700
I20260709 12:13:23.541932 20503 leader_election.cc:290] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.542577 20503 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:23.542922 19622 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4aa0 after lost signal to thread 19458
I20260709 12:13:23.543043 20503 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:23.545323 19622 debug-util.cc:398] Leaking SignalData structure 0x7b080004fb00 after lost signal to thread 19625
W20260709 12:13:23.545789 19622 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9480 after lost signal to thread 19626
I20260709 12:13:23.554584 20507 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.529618 20230 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.558383 20230 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.558902 20230 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.559418 20230 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.560120 20329 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.521216 20319 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.521602 20462 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.566404 20230 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.527712 20510 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.575371 20510 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:23.570919 20319 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.569375 20462 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.564088 20502 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.572899 20503 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.591768 20329 tablet_bootstrap.cc:492] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:23.592976 20329 ts_tablet_manager.cc:1403] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 1.649s	user 0.042s	sys 0.046s
I20260709 12:13:23.568204 20512 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
W20260709 12:13:23.590523 19622 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6d20 after lost signal to thread 19699
I20260709 12:13:23.581499 20319 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.584934 20510 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.584350 20462 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.585821 20501 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.591145 20503 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.585338 20502 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.617209 20230 raft_consensus.cc:493] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.597370 20507 raft_consensus.cc:493] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.611539 20520 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.619495 20520 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.612181 20510 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.621477 20395 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.621826 20510 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.617769 20230 raft_consensus.cc:515] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.613029 20501 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.618605 20235 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.613307 20506 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.596822 20500 raft_consensus.cc:493] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.624483 20520 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.625929 20462 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.622193 20395 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.626533 20462 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.627524 20520 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:23.628134 20395 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.628062 20520 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.628675 20462 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.628960 20502 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.629627 20502 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.624743 20230 leader_election.cc:290] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.630155 20502 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.630858 20230 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.631026 20520 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:23.631351 20230 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.632282 20502 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:23.622108 20329 raft_consensus.cc:359] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.624229 20235 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.638737 20230 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.624869 20506 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.625074 20504 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.639897 20506 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.624949 20517 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.639919 20504 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.599588 20512 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.643925 20504 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.641235 20517 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.595816 20516 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:23.647241 20235 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.647517 20517 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.647296 20516 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.651033 20512 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.652312 20506 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.636780 20329 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.654158 20329 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:23.658285 20515 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:23.624158 20501 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.659478 20515 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:23.662263 20501 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:23.634652 20503 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:23.666265 20503 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:23.625206 20500 raft_consensus.cc:515] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:23.625346 20507 raft_consensus.cc:515] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.091776 20329 ts_tablet_manager.cc:1434] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.498s	user 0.008s	sys 0.000s
I20260709 12:13:24.095106 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.095867 20507 leader_election.cc:290] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.096771 20515 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.099215 20500 leader_election.cc:290] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.101243 20329 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:23.679774 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.114203 20319 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.114423 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.115037 20319 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.117452 20319 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.118094 20319 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.118754 20319 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.119131 20504 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.119763 20525 raft_consensus.cc:493] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.119928 20504 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.121021 20319 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.120625 20525 raft_consensus.cc:515] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.122408 20504 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.123831 20525 leader_election.cc:290] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:24.143889 19713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.197s	sys 0.258s
W20260709 12:13:24.144392 19713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.197s	sys 0.258s
I20260709 12:13:24.144948 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.133816 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.119082 20517 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.150705 20235 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.151721 20235 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.144346 20511 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.143400 20504 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.143563 20505 raft_consensus.cc:493] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.147459 20503 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
W20260709 12:13:24.151674 20324 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.011s	sys 0.033s
I20260709 12:13:24.150575 20319 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.196540 20235 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.153610 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.197445 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.153894 20525 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
W20260709 12:13:24.187245 20322 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.177s	sys 0.304s
W20260709 12:13:24.196772 20324 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.012s	sys 0.033s
I20260709 12:13:24.189167 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.189008 20520 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.194356 20513 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.188812 20523 raft_consensus.cc:493] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
W20260709 12:13:24.207119 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 57670.4us
I20260709 12:13:24.201246 20519 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:24.206327 20322 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.178s	sys 0.305s
I20260709 12:13:24.154166 20517 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.215588 20519 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.206027 20525 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.214061 20513 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.218632 20519 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.219828 20513 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.198736 20503 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.221433 20517 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.212132 20520 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.223929 20520 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.225446 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.227360 19747 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:24.195837 20504 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.233238 20524 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.240224 20524 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.242674 20524 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.235474 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.233316 20523 raft_consensus.cc:515] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.238214 20525 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.190083 20511 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.246186 20523 leader_election.cc:290] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.198326 20505 raft_consensus.cc:515] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.201684 20319 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.239471 20503 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.210606 20516 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.258958 20505 leader_election.cc:290] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.259685 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.261649 20319 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.261194 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.262794 19743 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.263770 20524 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.263816 20516 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.264554 20524 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.264659 20516 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.266966 20524 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.266988 20516 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.267902 20454 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.267969 20524 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.268509 20454 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.268579 20524 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.270908 20524 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.270992 20454 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.271445 20524 raft_consensus.cc:493] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.272011 20524 raft_consensus.cc:515] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.274284 20524 leader_election.cc:290] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.275159 20504 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.276969 20511 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.281987 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.283238 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.283815 19749 raft_consensus.cc:2468] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.284363 20501 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.284668 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.284925 20501 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:24.285949 19622 debug-util.cc:398] Leaking SignalData structure 0x7b080017d1c0 after lost signal to thread 19774
I20260709 12:13:24.286458 20329 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.287361 20501 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.287515 20329 tablet_bootstrap.cc:492] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:24.287976 20501 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.288425 20329 ts_tablet_manager.cc:1403] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.195s	user 0.021s	sys 0.000s
I20260709 12:13:24.288564 20501 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.290750 20323 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.291144 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.291736 20329 raft_consensus.cc:359] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.292531 20329 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.292629 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.293252 20329 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.293882 20501 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.294441 20516 raft_consensus.cc:2804] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.294847 20516 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.295218 20516 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.295884 20329 ts_tablet_manager.cc:1434] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:13:24.296846 20329 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:24.297835 20454 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.298363 20454 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.300742 20454 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.297360 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.303475 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.318730 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.318899 20330 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.319525 20330 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.320116 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.321830 20426 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.322515 20426 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.321687 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.324673 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.325079 20426 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.325711 20325 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.305112 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.326273 20325 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.327131 20368 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:24.327677 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.328282 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.328613 20325 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.329214 20325 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.337749 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.338204 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.338013 20325 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.339152 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.340343 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.591436 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.596068 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:24.376446 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 58352.6us
W20260709 12:13:24.422451 19622 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3980 after lost signal to thread 20406
I20260709 12:13:24.349500 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:24.598977 19622 debug-util.cc:398] Leaking SignalData structure 0x7b08001bae40 after lost signal to thread 20411
I20260709 12:13:24.345525 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.341859 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.608342 19668 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:24.346586 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.347810 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.611433 19670 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.343062 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.614634 19671 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.340401 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.344290 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.336501 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.619094 19674 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.619534 19675 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:24.421267 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.617380 19673 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.622294 19672 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.350185 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.337276 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.325505 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.632316 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.341606 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.355239 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.638168 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.639806 19667 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.348393 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.306207 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.395925 20319 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.331092 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.313421 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.306783 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.328384 20376 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:24.668767 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbdfddcaeb249b0a188ce6aa6240f1a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.340533 20325 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.334666 20330 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.346920 20426 raft_consensus.cc:493] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.312000 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.345489 20499 raft_consensus.cc:493] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.309131 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.678587 20499 raft_consensus.cc:515] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.680634 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.657193 20319 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.682469 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.684528 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.306949 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.676352 20426 raft_consensus.cc:515] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.305650 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.661355 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.331338 20495 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.370105 20504 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.633440 19746 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.310582 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.365758 20517 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.329873 20516 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.685235 20322 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:24.685484 20319 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.307725 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.321699 20418 raft_consensus.cc:493] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.717450 20418 raft_consensus.cc:515] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.720667 20418 leader_election.cc:290] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.383672 20498 raft_consensus.cc:493] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.722200 20498 raft_consensus.cc:515] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.306399 20510 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.359418 20525 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.726651 20525 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.728294 19669 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.352874 20529 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.730321 20529 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.731330 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.732421 19669 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.365909 20527 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.733851 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.733991 20527 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.370617 20534 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.408010 20538 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.735898 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.736752 20534 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.736860 20538 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.409742 20539 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.739684 20534 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.739491 20539 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.741503 20529 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.742195 20539 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.409363 20537 raft_consensus.cc:493] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.743510 20537 raft_consensus.cc:515] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.743839 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.380671 20536 raft_consensus.cc:493] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.746609 20525 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.746385 20536 raft_consensus.cc:515] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.749199 20536 leader_election.cc:290] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.412108 20540 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.491895 20542 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.751685 20540 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:24.752183 20527 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.559677 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.563771 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.572786 19640 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:24.754331 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 182047us
I20260709 12:13:24.754689 20540 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.725528 20498 leader_election.cc:290] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.345964 19420 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39136 (request call id 98) took 2494 ms. Trace:
I20260709 12:13:24.755973 19420 rpcz_store.cc:276] 0709 12:13:21.851448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.851616 (+   168us) service_pool.cc:224] Handling call
0709 12:13:24.345444 (+2493828us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2347977,"reported_tablets":3}
I20260709 12:13:24.626721 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.757440 19640 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:24.758092 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 131848us
I20260709 12:13:24.758586 20538 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:24.759011 19715 leader_election.cc:343] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.759500 20536 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:24.759950 20536 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.761418 20536 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:24.761986 20331 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:24.762482 20331 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.762868 20331 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:24.760460 19640 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.764669 20319 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.765115 20319 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.765553 20319 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.642827 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.643741 19713 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:24.767041 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 123753us
I20260709 12:13:24.767369 20508 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.767844 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.768105 20508 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.768761 20508 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.644335 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.646274 19742 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:24.770284 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:24.647102 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.647748 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.648764 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.650593 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.652599 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.649179 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.745568 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.686813 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.687937 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.698978 20524 raft_consensus.cc:2749] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:24.686558 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.689503 20426 leader_election.cc:290] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.690222 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.690688 20368 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:24.686302 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.780016 20373 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.786703 20323 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:24.787287 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.787724 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.787961 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.693886 20370 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.788525 20373 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.784974 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.790011 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.790841 19743 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.692030 20495 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.686761 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.692210 20504 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.777943 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.795187 19668 raft_consensus.cc:2468] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.694142 20499 leader_election.cc:290] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.695101 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.797925 19670 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.697340 20516 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:24.694018 20517 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.424254 20541 raft_consensus.cc:493] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.393926 20533 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.802989 20533 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.804829 19673 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.801591 19669 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:24.806370 20517 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.807623 20541 raft_consensus.cc:515] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:24.809725 20524 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:24.810261 20524 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:24.750581 20537 leader_election.cc:290] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:24.810796 20524 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:24.498489 19567 consensus_peers.cc:597] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.754884 20527 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:24.813982 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 316021us
W20260709 12:13:24.314647 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 1.74478e+06us
I20260709 12:13:24.779031 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:24.701269 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 101770us
I20260709 12:13:24.696112 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.835162 20329 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.835448 20376 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.778120 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:24.696637 19421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39122 (request call id 110) took 2847 ms. Trace:
I20260709 12:13:24.838646 19421 rpcz_store.cc:276] 0709 12:13:21.848717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.872544 (+ 23827us) service_pool.cc:224] Handling call
0709 12:13:22.426588 (+554044us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540015f090. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890f0b2 00007f1f21888759 00007f1f21820a76 00007f1f217f1d58 00007f1f218f004e 00007f1f1fdb12a4 00007f1f1fdb1232 00007f1f1fdb1161 00007f1f1fdb10dc
0709 12:13:24.696383 (+2269795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1943562,"reported_tablets":3,"spinlock_wait_cycles":68029312}
I20260709 12:13:24.779498 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:24.841591 20533 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.826354 20367 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.800190 20374 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
W20260709 12:13:24.846501 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 61538.7us
I20260709 12:13:24.751722 20542 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.777504 20366 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.818051 19667 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:24.826313 20504 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.836570 20329 tablet_bootstrap.cc:492] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:24.823026 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.832859 19713 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.852120 20329 ts_tablet_manager.cc:1403] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.556s	user 0.021s	sys 0.025s
W20260709 12:13:24.844200 19567 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.845567 20541 leader_election.cc:290] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:24.795794 20495 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.853152 19713 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.854323 20511 raft_consensus.cc:2804] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.854763 20527 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.854818 20511 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.855700 20511 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:24.858392 19567 consensus_peers.cc:597] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.855269 20527 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:24.859411 19567 consensus_peers.cc:597] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:24.860652 19567 consensus_peers.cc:597] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.864024 20542 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:24.867826 20523 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.883936 19640 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.868970 20523 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.898448 20523 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:24.868417 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 63486.7us
I20260709 12:13:24.899227 20329 raft_consensus.cc:359] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.885569 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.900097 20329 raft_consensus.cc:740] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.869863 19713 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:24.900767 19598 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.901223 20503 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.901718 20503 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.902240 20503 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.902717 20504 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.903239 20504 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:24.903707 20504 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.907970 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.917359 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.918605 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.917374 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.918821 20329 consensus_queue.cc:260] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:24.920189 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.900028 20322 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:24.910125 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.921831 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.922212 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.923033 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.908324 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.911044 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.909118 19593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88072bf4089a469889379d666c797134" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.912254 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.924304 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.930116 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.931047 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.932093 20329 ts_tablet_manager.cc:1434] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 12:13:24.932246 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.914081 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.915045 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.915700 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.941972 19743 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:24.942164 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.920372 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.913230 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:24.927453 20322 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:24.945024 19599 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.946170 20322 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:24.927671 20516 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:24.946650 20536 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:24.947424 20516 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.947925 20516 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:24.947943 19674 raft_consensus.cc:2368] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:24.937861 19639 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:24.949976 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.950804 19743 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:24.937974 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.928045 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.938695 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.926699 19600 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.939167 20329 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:24.929518 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.926800 19596 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:24.926000 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:24.950001 20510 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.959861 20510 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.960338 20510 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.956110 20529 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:24.961956 20529 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:24.962402 20529 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.873306 19423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41962 (request call id 2) took 3308 ms. Trace:
W20260709 12:13:24.997161 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 91861us
I20260709 12:13:24.977082 19423 rpcz_store.cc:276] 0709 12:13:21.564638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.573756 (+  9118us) service_pool.cc:224] Handling call
0709 12:13:24.873087 (+3299331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":749903,"reported_tablets":45}
I20260709 12:13:25.021982 19713 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.031989 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.038137 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.041690 20546 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.042250 20546 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:25.042675 20546 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.045265 19639 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.046795 20525 raft_consensus.cc:2749] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.081171 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.082963 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.088816 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.093629 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5953336e18402bac805e4d1e79cbfc" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.095563 20536 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:25.112665 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 66676us
I20260709 12:13:25.114714 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.123988 20331 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.125770 19740 raft_consensus.cc:1240] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:25.118625 19566 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.131386 20547 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.131734 20331 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:25.133571 20524 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.134742 20511 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.128798 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.139031 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.142741 20533 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.139635 20547 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.144639 20508 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.146723 20371 raft_consensus.cc:1240] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:25.142795 19566 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.162213 20495 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.162662 20495 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.162992 20495 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.157989 19748 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.158248 19749 raft_consensus.cc:1240] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.158401 20533 raft_consensus.cc:493] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.167461 20533 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.159940 19740 raft_consensus.cc:1240] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:25.160110 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 214111us
I20260709 12:13:25.172791 20322 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.150386 20524 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.153872 19639 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.142795 20542 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.161303 20508 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.173776 20527 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.176827 20542 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.175099 20319 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.178498 19666 raft_consensus.cc:2393] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:25.180490 20536 raft_consensus.cc:2749] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.181252 20541 consensus_queue.cc:1059] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:25.182297 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.182670 20538 raft_consensus.cc:3055] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:25.183064 20538 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.183756 19639 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.184139 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.184103 20538 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.185690 20235 raft_consensus.cc:2804] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.158653 20547 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.186113 20235 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.186846 20235 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.159745 20511 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.189976 20542 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:25.191232 20524 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.191570 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.192004 20524 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.190909 19639 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.192932 20524 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.193595 20536 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.194726 20538 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:25.209440 20235 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.215276 19639 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
W20260709 12:13:25.221021 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 81361.7us
I20260709 12:13:25.214869 20527 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.157655 20510 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.232685 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:25.234735 20503 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.235687 20510 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.176230 20495 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.244247 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.245247 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.221122 20540 consensus_queue.cc:1059] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:13:25.219089 20499 consensus_queue.cc:1059] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:13:25.251027 20495 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:25.251706 20495 raft_consensus.cc:3055] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.228215 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.246029 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b761cf2b4a4e1b94d77f416ca88f91" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.252787 19741 raft_consensus.cc:1240] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.252166 20495 raft_consensus.cc:740] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.258553 20495 consensus_queue.cc:260] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.259938 20495 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.256361 20235 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.251315 20542 raft_consensus.cc:3055] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.265784 20540 consensus_queue.cc:1059] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.266980 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.267320 20540 raft_consensus.cc:3055] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.267930 20540 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.268993 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.270179 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ebcb794f547e59406e697d62764da" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.270937 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.272688 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.273789 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.274865 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.262722 20542 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.280447 19666 raft_consensus.cc:1240] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.280620 20542 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.243314 20527 raft_consensus.cc:2804] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.281863 20527 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.282063 20542 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.282289 20527 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.278890 20503 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.283306 19600 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 4.
I20260709 12:13:25.283491 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.285269 20533 raft_consensus.cc:515] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.286528 19598 raft_consensus.cc:2393] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 3: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:25.269459 20540 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.287662 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.288570 20540 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:25.290372 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.262800 20319 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.291524 20523 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.292658 19742 raft_consensus.cc:1240] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.293955 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.294672 19743 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.302384 20499 consensus_queue.cc:1059] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.302706 20504 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.303903 20541 raft_consensus.cc:3055] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.304020 19674 raft_consensus.cc:1240] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.304342 20541 raft_consensus.cc:740] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.306340 20541 consensus_queue.cc:260] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.307590 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.308459 19742 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.243744 20529 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.307641 20541 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.311877 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
W20260709 12:13:25.313095 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.263445 19748 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:25.323033 19640 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.322853 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.328013 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.328323 20525 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.328920 20525 raft_consensus.cc:697] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:25.330158 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.330008 20525 consensus_queue.cc:237] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.330780 19674 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.332938 19743 raft_consensus.cc:2468] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:25.328946 20523 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.335315 19566 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.336321 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.318125 20529 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.343243 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb173ec27e04352b94a70d12816f13f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:25.344919 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 129835us
I20260709 12:13:25.345780 19639 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.346741 20517 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:25.343503 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 170830us
I20260709 12:13:25.347131 20517 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.347595 20517 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.347950 20322 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:25.349123 20322 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.345780 20510 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:25.354669 19594 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
W20260709 12:13:25.355228 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.356460 20517 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.340034 20533 leader_election.cc:290] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:25.360387 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.362310 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.342373 20538 raft_consensus.cc:2804] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.373854 19674 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
W20260709 12:13:25.378347 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800380380 after lost signal to thread 10700
I20260709 12:13:25.378666 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.378405 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.381623 20503 consensus_queue.cc:1059] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:13:25.358407 20552 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.402805 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a881b97f3de4486698fd614567764d79" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.365291 20527 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.340246 20504 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.363261 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.416699 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f29b5fa12a4b79b10b5115c86d8915" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.417481 19599 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:25.418052 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.419181 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.420439 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.422598 19674 raft_consensus.cc:1240] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.366505 20547 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.423636 19668 raft_consensus.cc:1240] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.424005 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.424815 20547 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.425918 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f525b72ac964395b5d6eeb9d9056795" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.426178 19593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.389848 20510 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:25.429921 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29a6ca896c346c288f2435cd3621579" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:25.406298 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08003c78c0 after lost signal to thread 19458
I20260709 12:13:25.407156 20503 raft_consensus.cc:3055] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.432917 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.433279 20503 raft_consensus.cc:740] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.434686 20503 consensus_queue.cc:260] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.436076 20503 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.438031 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.438477 20510 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.439705 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.407639 20551 raft_consensus.cc:2804] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.441605 20551 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.442082 20551 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:25.442190 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.443804 20527 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.409696 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.403255 20552 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:25.444646 20552 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:25.432948 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8be0 after lost signal to thread 19625
W20260709 12:13:25.447090 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8c40 after lost signal to thread 19626
I20260709 12:13:25.442688 19667 raft_consensus.cc:1240] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.413445 20517 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.422434 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:25.443822 19666 raft_consensus.cc:1240] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.453980 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.455763 20552 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:25.393113 19742 raft_consensus.cc:2468] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:25.458015 20552 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.458614 19565 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.458964 19566 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.459908 20495 raft_consensus.cc:2749] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.408425 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 59389.6us
I20260709 12:13:25.460700 20495 raft_consensus.cc:2804] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.462198 20495 raft_consensus.cc:697] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.462381 20322 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.464021 20322 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.326889 20546 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.467483 20546 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:25.468636 19594 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:25.386996 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.478096 19601 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:25.477878 19713 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.490451 19743 raft_consensus.cc:2393] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:25.494702 19598 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 4.
I20260709 12:13:25.495137 19673 raft_consensus.cc:1240] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.479316 20552 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.502171 20546 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.503165 20546 raft_consensus.cc:697] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.367085 20516 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.504638 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:25.504880 20322 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
W20260709 12:13:25.483235 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0d20 after lost signal to thread 19699
I20260709 12:13:25.507685 20510 raft_consensus.cc:2804] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.508155 20510 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.508572 20510 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:25.509196 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800270fa0 after lost signal to thread 19773
W20260709 12:13:25.509744 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8720 after lost signal to thread 19774
I20260709 12:13:25.506496 20322 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.512463 20547 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.479835 19599 raft_consensus.cc:2468] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:25.513115 20547 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.403556 20538 raft_consensus.cc:697] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.513741 20547 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.514803 20538 consensus_queue.cc:237] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.519724 20551 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.520738 19713 leader_election.cc:304] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.528312 20511 raft_consensus.cc:2749] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.529752 19740 raft_consensus.cc:1240] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.488809 20524 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.532429 20524 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.498749 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.496744 19673 raft_consensus.cc:1240] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:25.533610 19675 raft_consensus.cc:2393] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:25.512181 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.534766 19666 raft_consensus.cc:2393] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:25.534312 20499 consensus_queue.cc:1059] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.504653 20546 consensus_queue.cc:237] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.536654 20499 raft_consensus.cc:3055] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.502368 20552 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.537184 20499 raft_consensus.cc:740] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.537799 20552 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.539171 20499 consensus_queue.cc:260] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.529583 20516 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.536995 19423 catalog_manager.cc:5697] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.485915 20495 consensus_queue.cc:237] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.549845 20329 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.489303 19593 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:25.541188 20499 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.558288 19565 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
W20260709 12:13:25.512140 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08000e19c0 after lost signal to thread 20406
W20260709 12:13:25.575232 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 178996us
I20260709 12:13:25.579258 19565 leader_election.cc:304] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
W20260709 12:13:25.599997 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800095ce0 after lost signal to thread 20411
I20260709 12:13:25.609010 20329 tablet_bootstrap.cc:492] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:25.610248 20329 ts_tablet_manager.cc:1403] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.673s	user 0.018s	sys 0.010s
I20260709 12:13:25.607409 19565 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.600854 20533 raft_consensus.cc:2749] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.619123 19566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.622200 19565 leader_election.cc:304] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.620767 19639 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.625496 19639 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.623590 19421 catalog_manager.cc:5697] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 3, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:25.626338 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 119944us
I20260709 12:13:25.627708 20322 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.611932 20538 raft_consensus.cc:2749] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.629158 20516 raft_consensus.cc:2804] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.630182 20516 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:25.630395 20525 raft_consensus.cc:2749] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.630617 20516 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.633428 19639 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.635238 19639 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.636499 19639 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.636803 20319 raft_consensus.cc:2749] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.641440 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.620719 20542 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.644614 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.646376 20322 leader_election.cc:304] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.647600 19639 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.648692 20504 raft_consensus.cc:2749] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.649425 20510 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.650525 20524 raft_consensus.cc:2749] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.651402 19639 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.652176 20529 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.633958 20525 raft_consensus.cc:2749] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.653285 20524 raft_consensus.cc:2749] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.637513 20540 raft_consensus.cc:2749] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.643860 20527 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.666179 20527 raft_consensus.cc:697] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:25.667302 20527 consensus_queue.cc:237] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.643440 20551 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.636046 20517 raft_consensus.cc:2749] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.675140 19713 leader_election.cc:304] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.672976 20542 consensus_queue.cc:1059] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:25.677451 20542 raft_consensus.cc:3055] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.677959 20542 raft_consensus.cc:740] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:25.679158 20542 consensus_queue.cc:260] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.651865 20510 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.682353 20542 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.688623 20505 raft_consensus.cc:2749] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.691578 19713 leader_election.cc:304] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.695240 20329 raft_consensus.cc:359] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:25.699020 19564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.706095 20329 raft_consensus.cc:740] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.708683 20329 consensus_queue.cc:260] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:25.712430 20329 ts_tablet_manager.cc:1434] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260709 12:13:25.714177 20329 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:25.730212 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:25.731014 19601 raft_consensus.cc:2393] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:25.707031 20367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49098 (request call id 42) took 1032 ms. Trace:
W20260709 12:13:25.722115 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 75830.2us
I20260709 12:13:25.731642 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
W20260709 12:13:25.743978 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 52531.6us
I20260709 12:13:25.729923 20508 raft_consensus.cc:2749] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.742512 20552 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:25.758436 19715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.114.65:46269 timed out after 1.578s (SENT) [suppressed 102 similar messages]
I20260709 12:13:25.760197 19713 leader_election.cc:304] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.742682 20547 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.760273 19420 catalog_manager.cc:5697] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.766085 20552 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.773859 20505 raft_consensus.cc:2749] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.740083 20367 rpcz_store.cc:276] 0709 12:13:24.649334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.816916 (+167582us) service_pool.cc:224] Handling call
0709 12:13:24.826119 (+  9203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:25.324506 (+498387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.327059 (+  2553us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:25.378597 (+ 51538us) log.cc:844] Serialized 26 byte log entry
0709 12:13:25.423508 (+ 44911us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:25.617701 (+194193us) log.cc:844] Serialized 14 byte log entry
0709 12:13:25.637241 (+ 19540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.644211 (+  6970us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:25.660618 (+ 16407us) raft_consensus.cc:1685] finished
0709 12:13:25.660630 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.681763 (+ 21133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202192,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":81896,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":231,"thread_start_us":397109,"threads_started":3,"wal-append.queue_time_us":26562}
I20260709 12:13:25.776973 20547 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.782296 19599 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:25.751919 20516 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.784567 19713 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.785429 20505 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.785504 20516 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:25.793430 20322 leader_election.cc:400] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:25.793926 20322 leader_election.cc:403] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:25.796145 19715 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.797039 19715 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.797422 19641 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.798384 19715 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.798777 20516 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.798954 20527 raft_consensus.cc:2749] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.801823 19641 leader_election.cc:343] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.802341 19641 leader_election.cc:304] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.803627 19713 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.805015 19713 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.806787 19713 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.807404 20557 raft_consensus.cc:2749] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.807518 20546 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.808800 20503 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:25.809449 20503 raft_consensus.cc:697] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.803500 20508 raft_consensus.cc:2749] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.810469 20503 consensus_queue.cc:237] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:25.807397 20550 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.814052 20550 raft_consensus.cc:697] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.814944 20550 consensus_queue.cc:237] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.808868 20546 raft_consensus.cc:493] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:25.818548 20546 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.824436 19715 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:25.817963 19641 leader_election.cc:343] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.825627 19641 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.826969 20527 raft_consensus.cc:2749] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.827939 20508 raft_consensus.cc:2749] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.829317 19715 leader_election.cc:343] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.829782 19715 leader_election.cc:304] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.831171 20508 raft_consensus.cc:2804] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.833844 20508 raft_consensus.cc:697] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.833066 20511 raft_consensus.cc:2749] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.835021 20508 consensus_queue.cc:237] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:25.841873 19715 leader_election.cc:343] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.842453 19715 leader_election.cc:304] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.845346 20511 raft_consensus.cc:2749] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.850244 19713 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.853335 19713 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:25.854334 20511 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.854771 20523 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.855413 20523 raft_consensus.cc:697] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.856520 20523 consensus_queue.cc:237] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.862334 19567 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.861862 20511 consensus_queue.cc:1059] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:25.856189 19641 leader_election.cc:343] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.864744 19641 leader_election.cc:304] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.863878 19567 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.869922 20542 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.870389 20542 raft_consensus.cc:493] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
W20260709 12:13:25.870723 19715 leader_election.cc:343] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.869318 20499 raft_consensus.cc:2749] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.871440 19715 leader_election.cc:304] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:25.871455 19567 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.870780 20542 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.874629 20550 consensus_queue.cc:1059] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.876168 20557 raft_consensus.cc:2749] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.882349 19743 raft_consensus.cc:1275] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:25.885324 19641 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.886459 20527 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.868345 20505 raft_consensus.cc:2749] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.898919 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.900966 20557 raft_consensus.cc:2749] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.902539 20546 raft_consensus.cc:515] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.903744 19742 raft_consensus.cc:1240] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:25.905970 20546 leader_election.cc:290] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:25.907374 19641 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.907260 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.910581 20523 raft_consensus.cc:2749] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.923116 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 62177.8us
I20260709 12:13:25.908682 20319 consensus_queue.cc:1059] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:13:25.933327 20553 raft_consensus.cc:2749] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.935945 19641 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:25.937492 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.937820 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:25.941207 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.941632 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.925926 20505 raft_consensus.cc:3055] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.945116 20505 raft_consensus.cc:740] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.945865 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.946470 20505 consensus_queue.cc:260] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:25.947444 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.948449 20505 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.939100 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.951496 19713 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.958436 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.966588 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:25.969137 20577 consensus_queue.cc:1059] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.970520 19641 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.971971 19641 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:25.972798 20529 raft_consensus.cc:2749] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.973610 20529 raft_consensus.cc:2749] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.974637 20516 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:25.975294 20525 raft_consensus.cc:3055] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:25.975719 20525 raft_consensus.cc:740] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:25.977028 20329 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.976596 20525 consensus_queue.cc:260] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:25.959451 20517 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:25.978149 20517 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:25.978609 20517 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.973286 19641 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:25.986187 20577 raft_consensus.cc:3055] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:25.986758 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 116127us
I20260709 12:13:25.978654 20525 raft_consensus.cc:3060] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.986729 20577 raft_consensus.cc:740] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:25.990199 19715 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:25.999612 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:26.000859 20577 consensus_queue.cc:260] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:26.002059 20577 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.004680 20516 raft_consensus.cc:493] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:26.005517 20547 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:26.005340 20516 raft_consensus.cc:515] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.006105 20547 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:26.007894 20516 leader_election.cc:290] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:26.008172 20547 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:25.993976 20527 raft_consensus.cc:2749] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.009485 20367 raft_consensus.cc:1240] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:26.011654 19641 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.990327 20511 raft_consensus.cc:2749] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.037891 19599 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.016660 20329 tablet_bootstrap.cc:492] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:26.019646 19715 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:26.021598 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:26.022009 20575 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:26.022840 20542 raft_consensus.cc:515] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.024278 20367 raft_consensus.cc:1240] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:26.025327 20371 raft_consensus.cc:1240] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.026067 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.026324 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.026841 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.027550 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.050209 20550 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.059147 19641 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:26.060707 19641 consensus_peers.cc:597] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.061669 20527 raft_consensus.cc:2749] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.042373 20575 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:26.062608 20575 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.070487 20505 raft_consensus.cc:2764] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:26.028268 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.028365 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:26.029140 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.029914 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.039773 20329 ts_tablet_manager.cc:1403] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.326s	user 0.015s	sys 0.016s
I20260709 12:13:26.014955 20546 raft_consensus.cc:3055] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.078251 20546 raft_consensus.cc:740] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:26.079774 20546 consensus_queue.cc:260] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:26.090335 20542 leader_election.cc:290] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:26.092535 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:26.096469 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.096676 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05afddf2c6c406b81d2a504e08b994d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.097581 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:26.097755 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 78215.3us
I20260709 12:13:26.098582 19641 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:26.099226 20329 raft_consensus.cc:359] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.095669 20373 raft_consensus.cc:1240] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.093480 20517 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.113440 19666 raft_consensus.cc:1240] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:26.116777 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.109299 19421 catalog_manager.cc:5697] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 3, leader changed from 572e5980055c424db2e88348b978bd27 (127.10.114.65) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.117568 20368 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 1.
I20260709 12:13:26.115077 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:26.120680 20527 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:26.121152 20527 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:26.121573 20527 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.104975 19593 raft_consensus.cc:1275] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.122565 20542 consensus_queue.cc:1059] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:26.123672 20542 raft_consensus.cc:3055] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:26.111570 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e2ee4873a445579d2a95e3cb490114" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.124171 20542 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:26.103008 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.125176 20542 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.125967 19641 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:26.100957 20546 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:26.101505 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 54548.3us
I20260709 12:13:26.110389 20329 raft_consensus.cc:740] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.127882 20329 consensus_queue.cc:260] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.114858 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:26.113780 19715 consensus_peers.cc:597] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.113206 19423 catalog_manager.cc:5697] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.114485 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1941144d30204ecf9a3dd3587b1d7fce" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.115571 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.137794 20529 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:26.136706 20319 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:26.141646 20319 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:26.142055 20319 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.110060 20367 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:26.113871 20517 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:26.150867 20329 ts_tablet_manager.cc:1434] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 12:13:26.151139 20542 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.173112 19749 raft_consensus.cc:1275] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:26.175642 19745 raft_consensus.cc:1275] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:26.178053 20329 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:26.189670 19641 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.212553 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.221567 20575 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:26.260464 20374 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.253481 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.264671 20366 raft_consensus.cc:1240] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.261412 20370 raft_consensus.cc:1240] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:26.263352 20372 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.308627 20575 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:26.317276 20589 consensus_queue.cc:1048] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:26.320991 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.328007 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.330078 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:26.330924 20373 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.338304 20547 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:26.338999 20547 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:26.349774 20583 log.cc:927] Time spent T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:26.351517 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.352360 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.352751 20371 raft_consensus.cc:2393] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:26.353317 20375 raft_consensus.cc:2393] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:26.354300 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae9718b125b4fa8bffa5181c27d1e55" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:26.354399 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.355619 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:26.356998 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:26.361204 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:26.365072 20538 consensus_queue.cc:1048] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.359632 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.368368 20527 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:26.370998 20527 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:26.374742 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:26.376271 19747 raft_consensus.cc:1275] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.341465 20547 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:26.392267 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:26.394493 20375 raft_consensus.cc:2468] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:26.360034 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:26.411724 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:26.422866 20503 consensus_queue.cc:1059] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.422977 20505 consensus_queue.cc:1059] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:26.424552 20503 raft_consensus.cc:3055] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:26.424907 19567 leader_election.cc:343] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.425248 20503 raft_consensus.cc:740] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:26.425513 19567 leader_election.cc:304] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.426142 20503 consensus_queue.cc:260] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:26.426815 19567 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
W20260709 12:13:26.427338 19715 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.428045 19715 leader_election.cc:304] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.428318 20508 consensus_queue.cc:1059] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.429086 20366 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:26.429553 20508 raft_consensus.cc:2749] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:26.429857 20511 raft_consensus.cc:3055] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.430066 20371 raft_consensus.cc:1275] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:26.430339 20511 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:26.393420 20527 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:13:26.428053 19567 leader_election.cc:343] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.432514 19567 leader_election.cc:304] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.433179 20588 raft_consensus.cc:2749] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:26.434181 20588 raft_consensus.cc:2749] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.434265 19567 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:26.435285 20511 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:26.435745 19567 leader_election.cc:343] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.435810 20588 raft_consensus.cc:2749] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.436306 19567 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.436631 20511 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.436748 20367 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 4.
I20260709 12:13:26.437747 20368 raft_consensus.cc:1240] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:26.438158 20505 consensus_queue.cc:1059] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.436677 20589 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:26.427439 20503 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.393191 20319 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:26.439216 20505 raft_consensus.cc:3055] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.440954 20589 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:26.476753 19567 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.446035 20542 raft_consensus.cc:2749] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:26.484642 19566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.482986 20589 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.554106 20495 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:26.555779 20577 raft_consensus.cc:3055] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:26.587675 19598 raft_consensus.cc:1275] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:26.580197 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 103587us
I20260709 12:13:26.582340 19599 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:26.470810 20505 raft_consensus.cc:740] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:26.593109 19593 raft_consensus.cc:1275] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.593638 20319 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:26.596673 19567 leader_election.cc:343] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.595772 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 279004us
I20260709 12:13:26.587435 20577 raft_consensus.cc:740] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:26.595331 20505 consensus_queue.cc:260] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:26.625720 19567 leader_election.cc:304] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:26.629884 19599 raft_consensus.cc:1275] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.632391 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:26.617350 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:26.633634 19675 raft_consensus.cc:1240] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:26.622984 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
W20260709 12:13:26.646890 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 50272.7us
I20260709 12:13:26.637042 20329 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.649792 19667 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.651168 19668 raft_consensus.cc:1240] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.654712 19673 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:26.647845 19567 consensus_peers.cc:597] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.664708 19567 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:26.636790 20590 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:26.654568 20538 raft_consensus.cc:2749] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.666213 20505 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.669602 19593 raft_consensus.cc:1240] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:26.633591 20575 consensus_queue.cc:1048] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:13:26.695895 20329 tablet_bootstrap.cc:492] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:26.696854 20329 ts_tablet_manager.cc:1403] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.534s	user 0.028s	sys 0.009s
I20260709 12:13:26.648542 20546 consensus_queue.cc:1048] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:13:26.653848 20577 consensus_queue.cc:260] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:26.684365 20499 raft_consensus.cc:2749] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.731036 19749 raft_consensus.cc:1240] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:26.800345 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 114546us
W20260709 12:13:26.814533 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:26.841738 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.865973 19668 raft_consensus.cc:1275] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.781909 20577 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:26.876924 19567 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.870425 19667 raft_consensus.cc:3060] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.886628 19567 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:26.885488 19712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:26.895721 20595 log.cc:927] Time spent T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:13:26.890607 20591 consensus_queue.cc:1059] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:13:26.921103 19566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.932430 20495 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:26.934554 20329 raft_consensus.cc:359] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.935441 20329 raft_consensus.cc:740] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.936264 20329 consensus_queue.cc:260] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:26.959630 19669 raft_consensus.cc:2468] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:26.894886 20538 consensus_queue.cc:1059] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 12:13:26.956382 20373 consensus_meta.cc:287] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.004s
W20260709 12:13:26.977795 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 101210us
I20260709 12:13:26.973802 20373 raft_consensus.cc:2468] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
W20260709 12:13:26.982705 19567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:26.978682 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 343346us
W20260709 12:13:26.979378 20598 log.cc:927] Time spent T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 12:13:26.987123 19712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.029101 20495 raft_consensus.cc:3055] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.029644 20495 raft_consensus.cc:740] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:27.030611 20495 consensus_queue.cc:260] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:27.011723 20575 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.031692 20495 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.031708 20575 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:27.034494 20511 consensus_meta.cc:287] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.024s
W20260709 12:13:26.951328 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 261114us
I20260709 12:13:27.036218 20575 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:27.036574 20592 log.cc:927] Time spent T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.309s	user 0.004s	sys 0.000s
I20260709 12:13:27.042647 20609 raft_consensus.cc:3055] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.043174 20609 raft_consensus.cc:740] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:27.044211 20609 consensus_queue.cc:260] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.044942 20322 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.047592 20547 raft_consensus.cc:2749] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.032197 20589 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
W20260709 12:13:27.005396 20503 consensus_meta.cc:287] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.002s
I20260709 12:13:27.051956 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.052311 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.053642 20329 ts_tablet_manager.cc:1434] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.356s	user 0.010s	sys 0.008s
I20260709 12:13:27.054083 19600 raft_consensus.cc:1240] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.054761 20329 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:27.056823 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.058645 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.058943 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.023496 19667 raft_consensus.cc:1275] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.060004 19423 catalog_manager.cc:5697] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.061890 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.064687 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:27.066998 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:27.070518 20322 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.074607 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:27.074075 19423 catalog_manager.cc:5697] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.076152 20589 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:27.075937 19423 catalog_manager.cc:5697] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 3 to 4, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 4 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.077612 20609 raft_consensus.cc:3060] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:27.077649 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 66508.8us
I20260709 12:13:27.079269 20614 raft_consensus.cc:2749] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.080668 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.089151 20322 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.090222 20614 raft_consensus.cc:2749] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.020955 19673 raft_consensus.cc:1275] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.093909 20591 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:27.094732 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 223906us
I20260709 12:13:27.094543 20591 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.092343 20523 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:27.106281 20322 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.107362 20614 raft_consensus.cc:2749] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.107968 20591 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.109381 20322 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.112964 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.114765 20503 consensus_queue.cc:1059] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.115978 20503 raft_consensus.cc:3055] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.116355 20614 raft_consensus.cc:2749] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.116387 20503 raft_consensus.cc:740] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.117594 20503 consensus_queue.cc:260] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.118197 20322 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.118834 20503 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.120664 20614 raft_consensus.cc:2749] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.091413 19423 catalog_manager.cc:5697] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 2 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.122049 20322 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.123376 20614 raft_consensus.cc:2749] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.124595 20322 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.125370 20614 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.126560 20322 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.127327 20614 raft_consensus.cc:2749] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.128106 20577 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.128564 20322 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.132071 20614 raft_consensus.cc:2749] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.106422 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:27.134301 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.134186 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.134528 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa021c2a57f94b72b6f4e27aadcb0d94" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.135370 20374 raft_consensus.cc:2393] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 3: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:27.142688 20577 consensus_queue.cc:1059] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.144376 20523 raft_consensus.cc:3055] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.144924 20523 raft_consensus.cc:740] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.146260 20523 consensus_queue.cc:260] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:27.147959 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.148716 20373 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.150421 20523 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.153172 20557 consensus_queue.cc:1059] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:27.153795 20329 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.155777 20593 raft_consensus.cc:3055] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.156314 20593 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:27.157198 20593 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.163203 20329 tablet_bootstrap.cc:492] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:27.165474 20372 raft_consensus.cc:1240] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.166142 20367 raft_consensus.cc:1240] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.191494 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.192260 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.193686 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.166939 20368 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:27.166821 20366 raft_consensus.cc:1240] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.170140 20376 raft_consensus.cc:1240] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:27.197628 20624 log.cc:927] Time spent T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:27.169448 20373 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:27.184465 20371 raft_consensus.cc:1240] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:27.185992 19567 leader_election.cc:343] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.164135 20329 ts_tablet_manager.cc:1403] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.005s
I20260709 12:13:27.194311 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:27.202318 19567 consensus_peers.cc:597] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:27.203033 19567 consensus_peers.cc:597] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:27.203943 19567 leader_election.cc:343] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:27.186956 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.206305 19715 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:27.176570 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.185151 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.194312 20618 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.210114 20616 raft_consensus.cc:2749] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.209731 20618 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.187263 20542 consensus_queue.cc:1059] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:27.172799 20375 raft_consensus.cc:1240] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.214177 19567 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.215637 20613 raft_consensus.cc:2804] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.216256 20613 raft_consensus.cc:697] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:27.217439 20613 consensus_queue.cc:237] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.221771 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.222448 20591 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.223047 20591 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.223531 20618 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.213685 20589 raft_consensus.cc:3055] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.224436 20589 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:27.177676 20593 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.225297 20591 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.188194 20503 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:13:27.227818 19594 raft_consensus.cc:2468] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:27.172143 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.231446 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.231726 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.232515 20329 raft_consensus.cc:359] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:27.233264 20329 raft_consensus.cc:740] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.225380 20589 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.238199 20329 consensus_queue.cc:260] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:27.188028 19713 leader_election.cc:304] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:27.239782 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.240722 19747 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:27.241571 20322 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.244755 19641 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:27.247056 19601 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
W20260709 12:13:27.247471 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 59538.2us
I20260709 12:13:27.248451 20322 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.247499 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.251293 19640 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.252660 20591 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.254992 19640 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:27.256788 19713 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:27.248800 20557 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.254413 20575 raft_consensus.cc:2804] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.260905 20329 ts_tablet_manager.cc:1434] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 12:13:27.249945 20547 raft_consensus.cc:2749] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:27.264274 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 54636.4us
I20260709 12:13:27.264792 20614 raft_consensus.cc:2749] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.265345 20503 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.273185 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.276233 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.254208 20616 consensus_queue.cc:1048] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:27.280138 20618 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.280702 19640 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
W20260709 12:13:27.291392 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 46783.9us
I20260709 12:13:27.293087 20525 raft_consensus.cc:2749] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.293571 20529 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:27.293828 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 45489.8us
I20260709 12:13:27.295642 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.303370 19673 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:27.254886 20577 consensus_queue.cc:1048] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:13:27.287897 20375 raft_consensus.cc:2393] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:27.280144 20511 raft_consensus.cc:2804] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.303957 20322 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.317857 20367 raft_consensus.cc:2393] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:27.284977 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.287832 20373 raft_consensus.cc:1240] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.319047 20372 raft_consensus.cc:2376] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3. Re-sending same reply.
I20260709 12:13:27.286432 20575 raft_consensus.cc:697] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
W20260709 12:13:27.304996 19712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.320590 20575 consensus_queue.cc:237] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.299863 20618 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.321787 20618 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.286276 20557 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.287204 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.288602 20591 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.329943 20322 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.333724 20322 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.324880 20511 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.287268 20503 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.337566 20376 raft_consensus.cc:2393] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:27.338120 20511 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.340656 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:27.354295 20366 raft_consensus.cc:2393] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 3: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:27.340888 20589 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.341912 20370 raft_consensus.cc:1240] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:27.379511 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 83350.2us
I20260709 12:13:27.335144 20547 raft_consensus.cc:2749] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:27.385842 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 97605.3us
W20260709 12:13:27.387512 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 53901.4us
I20260709 12:13:27.389495 20322 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.370795 20614 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.419788 20547 raft_consensus.cc:2749] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.427695 20631 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.428511 20368 raft_consensus.cc:1240] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:27.445900 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 56478.1us
I20260709 12:13:27.447139 20322 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.449976 20503 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
W20260709 12:13:27.457038 19565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.457940 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.458323 20557 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.461079 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.461810 19747 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:27.463346 19640 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:27.464450 20557 raft_consensus.cc:2804] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.464861 20557 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.465241 20557 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.468753 20329 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:27.484584 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.492913 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:27.495194 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 48145.9us
I20260709 12:13:27.496564 20604 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.497761 20547 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.497728 20604 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.499637 20322 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.500833 20547 raft_consensus.cc:2804] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.501348 20547 raft_consensus.cc:697] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:27.502444 20547 consensus_queue.cc:237] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:27.513976 19567 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.514673 19715 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.517359 19641 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.521485 19641 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.523684 20322 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.507730 20508 consensus_queue.cc:1059] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:13:27.540946 19641 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.543994 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.544643 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354051e3784a78b453ce8d710d547d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.546160 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:27.558156 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.559056 20607 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.559551 20637 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:13:27.561832 19593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bddd172e9b48829a3a0e923ecf94a7" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.562599 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.562992 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.555248 20499 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:27.564095 20499 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.557340 20640 consensus_queue.cc:1059] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:13:27.569797 20640 raft_consensus.cc:3055] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.570216 20640 raft_consensus.cc:740] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.571086 20640 consensus_queue.cc:260] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.522854 20613 raft_consensus.cc:2749] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.549841 20609 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.574671 19641 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.522746 20525 raft_consensus.cc:2749] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.526480 20577 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.541705 20641 raft_consensus.cc:2749] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.573601 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d555f82bd1764821a44971e502c2f604" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.587460 20640 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.556914 20322 leader_election.cc:304] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.588793 20631 raft_consensus.cc:2749] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.596385 20322 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.582712 20593 raft_consensus.cc:2749] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.582722 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.609612 20641 raft_consensus.cc:2749] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.611284 20322 leader_election.cc:304] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:27.634318 20511 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.635977 19641 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:27.615396 20638 consensus_queue.cc:1059] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:13:27.622428 20603 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:27.625501 20609 raft_consensus.cc:2749] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.650178 20322 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.597872 20577 raft_consensus.cc:697] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.629988 20604 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:27.638510 19641 leader_election.cc:304] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:27.644685 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:27.657258 19601 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.637902 20641 raft_consensus.cc:2749] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.584112 20600 consensus_queue.cc:1059] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:13:27.600157 20613 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.638352 20593 raft_consensus.cc:2749] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:27.740401 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 102955us
I20260709 12:13:27.747789 19600 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:27.751762 20508 raft_consensus.cc:3055] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.752259 20508 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.708125 20613 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:27.754161 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 108101us
I20260709 12:13:27.754944 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:27.756103 20613 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.757010 20577 consensus_queue.cc:237] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.758390 20503 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.759058 20503 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.759311 20557 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.745101 19641 leader_election.cc:304] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:27.695662 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:27.742731 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 94181.5us
I20260709 12:13:27.702550 20591 raft_consensus.cc:2749] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.770789 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.771070 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.655941 20603 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.778630 19674 raft_consensus.cc:1275] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.709040 20511 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:27.737795 20631 raft_consensus.cc:2749] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:27.774220 19715 consensus_peers.cc:597] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:27.774507 19601 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:27.771996 19675 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:27.698529 20618 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.794561 19565 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
W20260709 12:13:27.793819 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 148616us
I20260709 12:13:27.797034 19666 raft_consensus.cc:2393] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 3: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:27.816331 19673 raft_consensus.cc:2368] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
I20260709 12:13:27.753265 20508 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.820837 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.821941 19747 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:27.797423 20499 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.790248 19669 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:27.798839 20609 raft_consensus.cc:2749] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:27.815618 20613 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:27.841452 19565 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:27.844094 20557 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.844774 20619 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.845014 20503 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:27.845326 20619 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.845759 20619 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.846720 20542 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:27.847316 20542 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.847761 20542 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:27.850451 20643 log.cc:927] Time spent T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:13:27.855247 20329 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.856498 20329 tablet_bootstrap.cc:492] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:27.857271 20329 ts_tablet_manager.cc:1403] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.389s	user 0.040s	sys 0.045s
I20260709 12:13:27.864810 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:27.794708 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 49723.9us
I20260709 12:13:27.872092 20366 raft_consensus.cc:3060] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.872660 20603 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.873145 20374 raft_consensus.cc:1240] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.874943 20654 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:13:27.842922 20613 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.838204 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.878404 19746 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:27.879020 20613 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.877768 19601 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:27.880622 20618 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.888082 20607 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.887885 20593 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.894541 20593 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.896523 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:27.897368 19601 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.899288 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:27.899919 19673 raft_consensus.cc:3060] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.900048 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.900713 19674 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:27.902251 19565 leader_election.cc:400] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
I20260709 12:13:27.902701 19565 leader_election.cc:403] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:27.906268 19667 raft_consensus.cc:1275] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.907028 20593 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:27.907445 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.907583 20637 consensus_queue.cc:1059] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.908326 19672 raft_consensus.cc:2393] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 2: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:27.910121 20550 raft_consensus.cc:3055] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.910579 20550 raft_consensus.cc:740] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.911542 20550 consensus_queue.cc:260] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:27.913118 20550 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.913770 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:27.916494 19713 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:27.918512 20603 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.939661 19673 raft_consensus.cc:2468] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:27.929913 19713 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:27.939860 19601 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:27.942039 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.930729 20640 raft_consensus.cc:2804] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.936934 20374 raft_consensus.cc:1275] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.942781 19747 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 2.
I20260709 12:13:27.955672 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.958412 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:27.962977 20576 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:27.947631 20640 raft_consensus.cc:697] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:27.965736 20640 consensus_queue.cc:237] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.968914 20329 raft_consensus.cc:359] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.970026 20508 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.950702 20503 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.972029 20503 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.972411 20503 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.920799 20619 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:27.970101 20329 raft_consensus.cc:740] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.977483 20575 raft_consensus.cc:3055] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.984146 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:27.985116 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:27.986963 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:28.026468 19749 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.989921 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:27.993297 19639 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:28.000393 19423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39136 (request call id 101) took 1393 ms. Trace:
I20260709 12:13:28.027223 19598 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 1.
I20260709 12:13:28.025514 20517 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:28.029263 20517 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:28.031028 19639 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:28.008675 20368 raft_consensus.cc:1275] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:28.024326 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 44938.7us
I20260709 12:13:28.019366 20329 consensus_queue.cc:260] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:27.981630 19713 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
W20260709 12:13:28.039278 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 57827.2us
I20260709 12:13:28.023904 20575 raft_consensus.cc:740] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:28.050496 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:28.052399 19673 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.031625 19743 raft_consensus.cc:3060] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.057387 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.058490 20368 raft_consensus.cc:2393] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 3: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:28.033496 20609 raft_consensus.cc:2804] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:28.059365 20609 raft_consensus.cc:697] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:28.060292 20609 consensus_queue.cc:237] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.060788 20618 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.061259 20618 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.048369 20517 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:28.027549 19423 rpcz_store.cc:276] 0709 12:13:26.606771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.617599 (+ 10828us) service_pool.cc:224] Handling call
0709 12:13:28.000287 (+1382688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:27.261890 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:27.262772 (+   882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:27.262824 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:13:27.262854 (+    30us) tablet.cc:662] Decoding operations
0709 12:13:27.263717 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:27.263841 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:27.263883 (+    42us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:27.264447 (+   564us) tablet.cc:701] Row locks acquired
0709 12:13:27.264496 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:13:27.264703 (+   207us) write_op.cc:270] Start()
0709 12:13:27.264866 (+   163us) write_op.cc:276] Timestamp: P: 1783599207264643 usec, L: 0
0709 12:13:27.264899 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:13:27.266825 (+  1926us) log.cc:844] Serialized 1705 byte log entry
0709 12:13:27.415692 (+148867us) op_driver.cc:464] REPLICATION: finished
0709 12:13:27.609274 (+193582us) write_op.cc:301] APPLY: starting
0709 12:13:27.609390 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:27.609580 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:27.609735 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:27.610434 (+   699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:27.610648 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:13:27.610701 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:27.610969 (+   268us) log.cc:844] Serialized 40 byte log entry
0709 12:13:27.611182 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:27.611305 (+   123us) write_op.cc:454] Released schema lock
0709 12:13:27.611358 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:27.611753 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:27.611787 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9455,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":182724,"apply.run_cpu_time_us":2494,"apply.run_wall_time_us":2495,"num_ops":4,"prepare.queue_time_us":123457,"prepare.run_cpu_time_us":4411,"prepare.run_wall_time_us":5291,"replication_time_us":125635,"thread_start_us":156924,"threads_started":2}]]}
I20260709 12:13:28.051709 20495 consensus_queue.cc:1048] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:28.070952 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:28.071815 19599 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:28.061623 20618 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.077555 20329 ts_tablet_manager.cc:1434] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.216s	user 0.011s	sys 0.001s
I20260709 12:13:28.079890 19639 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:28.086730 20603 raft_consensus.cc:2749] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
I20260709 12:13:28.090907 19566 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:28.092878 20525 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.097472 20525 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.100416 20525 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.103385 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:28.104116 19742 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:28.105414 19640 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.106957 20557 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:28.107380 20557 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.107767 20557 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.111434 20600 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.112051 20600 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.100625 20591 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.113886 20591 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.116900 20591 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.100716 20656 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.117731 20523 consensus_queue.cc:1048] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.079116 19673 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:28.118234 20656 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:28.119025 20656 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.124711 19749 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:28.128291 19640 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.129833 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:28.131775 19749 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.132346 19598 raft_consensus.cc:1275] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:28.135697 19565 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:28.141224 19745 raft_consensus.cc:3060] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:28.147058 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 56245.4us
I20260709 12:13:28.156498 19749 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:28.067137 20575 consensus_queue.cc:260] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.159729 20499 raft_consensus.cc:2764] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:28.169095 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:28.169992 19742 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:28.175957 19640 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.142012 20508 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.153964 20603 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:28.140568 20607 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:28.129397 20503 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.174332 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.188791 20657 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:28.158751 20631 consensus_queue.cc:1048] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:28.195024 20619 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:28.242854 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 70346.2us
I20260709 12:13:28.244287 19747 raft_consensus.cc:2368] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
I20260709 12:13:28.204322 20603 raft_consensus.cc:697] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:28.204814 20557 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.256637 19745 raft_consensus.cc:1275] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:28.199854 20508 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.213306 20657 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.308461 20374 raft_consensus.cc:2393] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
W20260709 12:13:28.311056 20630 log.cc:927] Time spent T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:28.303328 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:28.318342 20657 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.315264 20607 raft_consensus.cc:697] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:28.322032 20547 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:28.322247 19743 raft_consensus.cc:2468] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:28.396257 20577 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:28.398221 20668 log.cc:927] Time spent T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:13:28.398917 20542 consensus_meta.cc:287] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.001s
I20260709 12:13:28.399506 20542 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:28.399900 20670 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.400626 20670 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.403414 20670 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.405594 20557 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.406536 20557 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.407105 20557 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.410910 20607 consensus_queue.cc:237] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.413110 19594 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:28.414940 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.416134 20368 raft_consensus.cc:2393] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:28.419240 20542 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:28.422410 20631 consensus_queue.cc:1048] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:28.328364 20600 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.469753 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:28.483508 19749 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:28.496619 19640 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.497998 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:28.500494 19749 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:28.460130 20547 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:28.513136 19640 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.516680 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:28.517727 20366 raft_consensus.cc:2393] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:28.518810 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:28.388316 20603 consensus_queue.cc:237] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.501369 20503 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:28.522652 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.496963 20557 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:28.549271 19673 raft_consensus.cc:1275] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:28.515282 20618 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:28.535398 20366 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.562095 20374 raft_consensus.cc:2393] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
W20260709 12:13:28.550400 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 209501us
I20260709 12:13:28.581036 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.582482 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.588449 20374 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:28.588662 20368 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:28.578161 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:28.595189 20366 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:28.595714 20367 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:28.597518 19715 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.531533 20656 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:28.607718 20656 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:28.609529 20547 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:28.561576 20508 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.580106 20675 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:28.616489 20675 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.616928 20675 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.585441 20674 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.620445 20674 raft_consensus.cc:697] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:28.621040 20640 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.620779 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:28.623165 19740 raft_consensus.cc:2393] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 3: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:28.621591 20674 consensus_queue.cc:237] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.613031 20618 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:28.628487 19715 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:28.629132 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 77544.4us
W20260709 12:13:28.644505 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 93095.5us
I20260709 12:13:28.647099 19715 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:28.570220 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:28.661677 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:28.643860 20508 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:28.665813 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 118036us
I20260709 12:13:28.669061 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:28.672427 19675 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.621598 20640 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.657754 20638 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.651895 20683 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:28.673820 20508 raft_consensus.cc:493] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.667624 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:28.692981 20638 raft_consensus.cc:493] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.676694 20547 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.688134 20550 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.675536 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:28.667078 19668 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:28.677222 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:28.710716 20508 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.694294 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:28.699319 20683 raft_consensus.cc:493] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.726990 20547 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.700976 20677 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.739643 19592 raft_consensus.cc:2368] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 3. Current term is 4.
I20260709 12:13:28.721312 20638 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.743041 19595 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.758162 20374 raft_consensus.cc:1275] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:28.743376 20683 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.762698 19666 raft_consensus.cc:2393] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 3: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:28.764266 20547 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:28.765810 19672 raft_consensus.cc:1275] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.725473 20550 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:28.803562 19675 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:28.751688 20367 raft_consensus.cc:2393] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 3: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
W20260709 12:13:28.809765 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 141914us
I20260709 12:13:28.811352 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:28.812161 19675 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:28.812225 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
W20260709 12:13:28.813845 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 133027us
I20260709 12:13:28.813938 20322 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:28.818535 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:28.819156 20322 leader_election.cc:400] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319) with higher term. Message: Invalid argument: T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 3. Current term is 4.
I20260709 12:13:28.819526 20322 leader_election.cc:403] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:28.821645 19565 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:28.823787 19566 leader_election.cc:400] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
I20260709 12:13:28.825788 19566 leader_election.cc:403] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:28.819995 20658 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.817447 20550 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:28.747704 20677 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:28.839713 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:28.823274 20547 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319) with higher term. Message: Invalid argument: T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 3. Current term is 4.
I20260709 12:13:28.840575 19675 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:28.826547 20603 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:28.821336 20577 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:13:28.910229 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:28.910872 20691 log.cc:927] Time spent T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:13:28.857964 20695 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.916738 20695 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.917160 20695 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:28.975915 20657 consensus_meta.cc:287] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.001s
I20260709 12:13:28.976171 19595 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:28.976572 20657 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:28.978935 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:28.979976 19745 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
W20260709 12:13:28.983871 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 158304us
I20260709 12:13:28.858441 20640 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:28.902755 20550 consensus_queue.cc:1048] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
W20260709 12:13:28.999323 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 156331us
I20260709 12:13:29.002987 19639 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:29.010445 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:29.011883 20657 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.003228 20557 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.003537 19669 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:29.006223 19592 raft_consensus.cc:1275] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.996785 20677 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:28.840099 20658 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.000245 20591 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:28.978634 20587 raft_consensus.cc:2749] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 2. Current term is 3.
W20260709 12:13:29.019264 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.040727 19713 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.007277 19745 raft_consensus.cc:1275] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.984436 20547 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.031771 20708 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.020249 20603 raft_consensus.cc:697] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:29.040869 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.019470 20575 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:29.048696 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 45806us
I20260709 12:13:29.006506 20699 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.059532 19600 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:29.058599 20672 raft_consensus.cc:2749] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:29.072853 19713 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:29.022490 20557 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.063668 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.078501 20550 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.052224 20547 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.080613 19743 raft_consensus.cc:1275] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:29.083230 20374 raft_consensus.cc:2393] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:29.083587 20603 consensus_queue.cc:237] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.084548 20707 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.085400 20658 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.050237 20591 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.067618 20508 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.105082 20707 raft_consensus.cc:493] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.080111 20680 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.061201 20699 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.062911 20708 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.112519 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.122838 20708 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.100898 20550 raft_consensus.cc:697] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:29.090337 20695 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.140066 20695 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.140066 20547 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.141593 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:29.141891 20547 raft_consensus.cc:493] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.089437 20672 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:29.142498 20547 raft_consensus.cc:515] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.143800 20591 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.144838 20547 leader_election.cc:290] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.107651 20557 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.162372 19749 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:29.114077 20707 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:29.163693 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 43656.2us
I20260709 12:13:29.145430 20547 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.112142 20675 raft_consensus.cc:515] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.110004 20683 raft_consensus.cc:515] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.178143 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.198841 19673 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:29.125110 20680 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.202998 20690 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.203164 20666 log.cc:927] Time spent T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 1.000s	user 0.007s	sys 0.009s
I20260709 12:13:29.203212 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50704 (request call id 297) took 1071 ms. Trace:
I20260709 12:13:29.181921 20547 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.203776 20690 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.203821 19670 rpcz_store.cc:276] 0709 12:13:28.131615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.134248 (+  2633us) service_pool.cc:224] Handling call
0709 12:13:29.190592 (+1056344us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b580006f098. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:13:29.195589 (+  4997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.202721 (+  7132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.202761 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:29.202813 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:29.202860 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.202935 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:29.203119 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15613184}
I20260709 12:13:29.208357 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.213840 19674 raft_consensus.cc:2368] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 3. Current term is 4.
I20260709 12:13:29.195521 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.218835 20370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49104 (request call id 117) took 1086 ms. Trace:
I20260709 12:13:29.191759 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.228760 20680 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.199893 19743 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:29.202880 20676 consensus_queue.cc:1048] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:13:29.232913 19594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32850 (request call id 383) took 1302 ms. Trace:
I20260709 12:13:29.233287 19596 raft_consensus.cc:1275] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:29.233466 19594 rpcz_store.cc:276] 0709 12:13:27.930750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.937521 (+  6771us) service_pool.cc:224] Handling call
0709 12:13:29.232678 (+1295157us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001a45d4. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:13:29.232816 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284418432}
I20260709 12:13:29.234176 20716 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.194818 20550 consensus_queue.cc:237] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.237052 20716 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.237763 19741 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:29.220840 20370 rpcz_store.cc:276] 0709 12:13:28.132218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.134704 (+  2486us) service_pool.cc:224] Handling call
0709 12:13:29.190218 (+1055514us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b5800506d98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:13:29.195995 (+  5777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.201906 (+  5911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.218387 (+ 16481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:29.218477 (+    90us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:29.218531 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.218606 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:29.218745 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8488704}
I20260709 12:13:29.248116 20717 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.248804 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.248746 20717 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.249833 19746 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:29.253845 20720 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.254757 20716 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.254522 20720 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.255811 20716 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:29.256650 20716 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.257665 20717 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:29.264323 20547 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.264724 20508 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.268842 20675 leader_election.cc:290] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.270303 20699 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.244405 20638 raft_consensus.cc:515] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.272131 19742 raft_consensus.cc:2368] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.261067 20676 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.275671 19640 leader_election.cc:400] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.283648 19640 leader_election.cc:403] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:29.285717 20322 leader_election.cc:400] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 3. Current term is 4.
I20260709 12:13:29.291723 20720 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.274760 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.293603 19742 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:29.294610 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.295818 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:29.296543 19742 raft_consensus.cc:2368] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.296118 20707 raft_consensus.cc:515] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.297370 19745 raft_consensus.cc:2393] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 3: Already voted for candidate df754e24c604440998ec5ed4153e9925 in this term.
I20260709 12:13:29.297986 19640 leader_election.cc:400] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.298362 19640 leader_election.cc:403] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:29.299443 20707 leader_election.cc:290] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.273501 20638 leader_election.cc:290] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.300206 20687 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.307106 20329 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:29.286164 20675 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.278311 20676 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.308578 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
W20260709 12:13:29.301518 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 244058us
I20260709 12:13:29.322842 20676 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.327004 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.327816 19745 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:29.329120 19640 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.334652 20683 leader_election.cc:290] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.334746 20609 raft_consensus.cc:2804] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.336527 20609 raft_consensus.cc:493] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.336908 20609 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.340888 20720 raft_consensus.cc:493] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.341571 20720 raft_consensus.cc:515] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.347666 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.348850 20720 leader_election.cc:290] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.345969 20716 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.352278 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.358197 20609 raft_consensus.cc:515] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.359823 19639 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:29.361944 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.362665 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:29.362795 20372 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:29.363382 19745 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.367815 19421 catalog_manager.cc:5697] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 3, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } }
I20260709 12:13:29.369488 20675 raft_consensus.cc:2749] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.370584 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.350920 20373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49104 (request call id 119) took 1099 ms. Trace:
I20260709 12:13:29.374624 20687 raft_consensus.cc:2749] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:29.375444 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.376793 20372 raft_consensus.cc:2393] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:29.377663 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.378435 20371 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:29.373322 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.393944 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:29.418401 19745 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
W20260709 12:13:29.454098 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 59622.8us
I20260709 12:13:29.387986 20375 raft_consensus.cc:2393] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:29.493490 19640 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.494635 19640 leader_election.cc:304] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.497112 19673 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:29.400182 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac728d3e6f7413194553b8493db9ad8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.379488 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50728 (request call id 383) took 1135 ms. Trace:
I20260709 12:13:29.386533 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.400856 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
W20260709 12:13:29.482254 20666 log.cc:927] Time spent T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:29.396162 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.399960 20366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.398926 20701 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.383592 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.520267 20370 raft_consensus.cc:3060] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.388415 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.490188 20638 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:13:29.518217 20708 raft_consensus.cc:2804] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.481644 20631 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.506981 20591 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:29.525417 20609 leader_election.cc:290] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.503774 19713 leader_election.cc:304] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.493324 20716 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.403041 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.508769 20589 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.372391 20373 rpcz_store.cc:276] 0709 12:13:28.251611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.304883 (+ 53272us) service_pool.cc:224] Handling call
0709 12:13:29.350078 (+1045195us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b5800506d98. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:13:29.350321 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.350565 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.350593 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:29.350645 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:29.350678 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.350740 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:29.350856 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12201344}
I20260709 12:13:29.510486 20675 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:29.402683 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.506022 20557 raft_consensus.cc:493] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.506518 20707 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.506758 20720 raft_consensus.cc:493] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.531611 19745 raft_consensus.cc:1275] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:29.522079 20371 raft_consensus.cc:3060] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.529956 20372 raft_consensus.cc:2393] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df754e24c604440998ec5ed4153e9925 in current term 3: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:29.389957 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.503450 20673 consensus_queue.cc:1048] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:13:29.506187 19669 rpcz_store.cc:276] 0709 12:13:28.244396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.247862 (+  3466us) service_pool.cc:224] Handling call
0709 12:13:29.379272 (+1131410us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54008da754. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f1b99c571 00007f1f1ba372fa 00007f1f209f8b17 00007f1f19f736d4 00007f1f19f73662 00007f1f19f73591 00007f1f19f7350c 00007f1f19f727c2 00007f1f19d6e48c 00007f1f19d6d8c6 00007f1f19d6d26f
0709 12:13:29.379388 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535598976}
I20260709 12:13:29.529495 20366 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 1.
I20260709 12:13:29.535993 20697 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.546465 20683 raft_consensus.cc:2804] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.551458 20675 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.547778 20701 raft_consensus.cc:697] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:29.549208 20376 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:29.548550 20708 raft_consensus.cc:697] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:29.540289 20631 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:29.605842 20730 log.cc:927] Time spent T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 12:13:29.633654 20683 raft_consensus.cc:697] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:29.606284 20697 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.650324 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:29.650993 19670 raft_consensus.cc:3060] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.651825 20697 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.550081 20716 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.652446 19595 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:29.654359 20716 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:29.630192 20714 log.cc:927] Time spent T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.443s	user 0.004s	sys 0.000s
I20260709 12:13:29.632804 20631 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:29.600433 20542 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:13:29.549926 20589 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.638316 20683 consensus_queue.cc:237] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:29.658550 20589 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:29.648496 20708 consensus_queue.cc:237] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.640674 20703 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:29.661576 20703 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.559721 20557 raft_consensus.cc:515] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.642328 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.663978 20703 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.664273 19592 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:29.642755 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.642328 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56dd21d8f0714b5e9855a7b741f56cf8" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:29.642869 20323 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.622529 20675 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.665513 19667 raft_consensus.cc:3060] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:29.666133 20631 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.666961 20631 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.667325 20631 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.666299 20323 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.669399 20323 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:29.670182 20695 raft_consensus.cc:2804] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.670578 20695 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.670886 20695 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.673815 20716 raft_consensus.cc:2804] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.674283 20716 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.674607 20716 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.626540 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b302db5638420a9a5c34f1a2016ae7" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:29.678614 20368 raft_consensus.cc:3060] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.679443 19639 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:29.680444 20690 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:29.680895 20525 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.646649 20701 consensus_queue.cc:237] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.677794 20604 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:29.683298 20604 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:29.564630 20720 raft_consensus.cc:515] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:29.649494 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff9f6251ac44db9b2768886ba30f320" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:29.686162 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.686509 20694 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:29.687052 20694 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.665303 20557 leader_election.cc:290] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:29.681298 20525 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
W20260709 12:13:29.696242 19641 consensus_peers.cc:597] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:29.700606 19593 raft_consensus.cc:1275] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:29.700986 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.701442 19593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32834 (request call id 260) took 1044 ms. Trace:
I20260709 12:13:29.701980 19596 raft_consensus.cc:2393] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 2: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:29.701898 19593 rpcz_store.cc:276] 0709 12:13:28.657321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.662632 (+  5311us) service_pool.cc:224] Handling call
0709 12:13:29.697730 (+1035098us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b5800004598. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1890eb71 00007f1f1890ea22 00007f1f218278d9 00007f1f20981ee0 00007f1f20a4b0ab 00007f1f20a4b131 00007f1f20a0cfc0 00007f1f209f7929 00007f1f209f73d2 00007f1f19f6ebd4
0709 12:13:29.700200 (+  2470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.701147 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.701357 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6996352}
I20260709 12:13:29.696128 20525 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.710404 19593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6697ba38fa643d2829f82139140437a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.711706 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.700656 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.716078 19641 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: df754e24c604440998ec5ed4153e9925
I20260709 12:13:29.585835 20707 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:29.691524 20604 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:29.729234 19641 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:29.770334 19715 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:29.740749 19641 consensus_peers.cc:597] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:29.774158 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a652f7acae11499b8631edbb9126b6d4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:29.803581 19715 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:29.846534 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 103874us
W20260709 12:13:29.846628 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 96695.2us
W20260709 12:13:29.848634 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 75480.1us
W20260709 12:13:29.849812 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 112338us
I20260709 12:13:29.732582 20557 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:29.856833 19567 consensus_peers.cc:597] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:29.750696 20656 raft_consensus.cc:2749] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:29.747761 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:29.855162 20557 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
W20260709 12:13:29.854368 20723 log.cc:927] Time spent T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:13:29.867676 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.868750 19671 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:29.844015 20508 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:29.882952 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.859262 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.866305 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.884583 20576 raft_consensus.cc:2749] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:29.868844 20374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:29.883466 20557 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:29.889431 20508 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.891721 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.939989 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.868561 20503 consensus_queue.cc:1048] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:13:29.968518 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.865151 20323 leader_election.cc:304] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:29.977726 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.976179 19601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:29.957762 20508 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.957132 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:29.891742 19740 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:30.016242 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:29.994203 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 141880us
I20260709 12:13:29.970341 20517 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:30.019618 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8f0895419f44028178397e52ffe4ed" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:30.017406 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 213993us
I20260709 12:13:29.957437 19596 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.093427 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:30.094709 20322 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.095579 19565 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.096779 19565 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:29.970750 20631 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:30.104228 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 233704us
I20260709 12:13:30.026021 20724 raft_consensus.cc:2749] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.029724 19669 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 1.
I20260709 12:13:30.115759 20654 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.107581 19670 raft_consensus.cc:2468] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
W20260709 12:13:30.097919 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 242236us
W20260709 12:13:30.136694 20371 consensus_meta.cc:287] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.006s
W20260709 12:13:30.133020 20370 consensus_meta.cc:287] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.595s	user 0.015s	sys 0.001s
I20260709 12:13:30.030826 20517 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
W20260709 12:13:30.179895 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 85270us
I20260709 12:13:30.162464 20707 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:30.174942 20376 consensus_meta.cc:287] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 12:13:30.171867 20724 raft_consensus.cc:2749] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.170266 20370 raft_consensus.cc:2468] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:30.168087 20371 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:30.179157 20604 raft_consensus.cc:2749] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.194578 20322 leader_election.cc:304] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.184108 20323 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:30.185179 20376 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 4.
I20260709 12:13:30.216297 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.228331 20371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:30.229956 20631 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:30.231634 20733 log.cc:927] Time spent T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
W20260709 12:13:30.233184 20735 log.cc:927] Time spent T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:13:30.224845 20724 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:30.238003 20724 raft_consensus.cc:493] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:30.243252 20724 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:30.243775 20695 consensus_meta.cc:287] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
I20260709 12:13:30.244256 20695 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.245616 20517 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:30.250653 19667 consensus_meta.cc:287] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.004s
I20260709 12:13:30.220875 20604 raft_consensus.cc:493] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.251816 20604 raft_consensus.cc:515] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:30.251187 19667 raft_consensus.cc:2468] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 4.
W20260709 12:13:30.265851 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 71458.2us
I20260709 12:13:30.267244 20322 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:30.239607 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.269162 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
W20260709 12:13:30.271198 19672 consensus_meta.cc:287] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:13:30.271668 19672 raft_consensus.cc:2468] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
W20260709 12:13:30.272698 20525 consensus_meta.cc:287] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 12:13:30.222899 20749 raft_consensus.cc:2749] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.281915 20525 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:30.286173 20695 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:30.273180 20368 consensus_meta.cc:287] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:13:30.254304 20604 leader_election.cc:290] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.287357 20368 raft_consensus.cc:2468] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
W20260709 12:13:30.286404 20675 consensus_meta.cc:287] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.001s
W20260709 12:13:30.288419 20732 log.cc:927] Time spent T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
I20260709 12:13:30.288758 20675 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.290143 19673 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:30.291476 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:30.227687 20370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec016e46aa0b42909cc2783d5a41af25" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:30.296217 20525 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.291288 20675 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:30.301164 20508 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:30.302824 19715 leader_election.cc:304] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:30.300294 20716 consensus_meta.cc:287] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.003s
I20260709 12:13:30.305246 20748 raft_consensus.cc:2804] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.305897 20748 raft_consensus.cc:697] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.306875 20748 consensus_queue.cc:237] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.307555 19672 raft_consensus.cc:1275] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.308844 19713 leader_election.cc:304] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:30.305253 20716 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.310421 20694 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:30.310758 20503 raft_consensus.cc:2804] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.310947 20374 raft_consensus.cc:2368] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:30.311362 20503 raft_consensus.cc:697] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.312129 20716 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.312356 20503 consensus_queue.cc:237] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:30.313071 20739 log.cc:927] Time spent T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
I20260709 12:13:30.312800 20557 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.300513 20724 raft_consensus.cc:515] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:30.304579 19715 leader_election.cc:304] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:30.304620 20757 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:30.321059 19715 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:30.328686 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 220358us
I20260709 12:13:30.334059 20368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:30.335100 20368 raft_consensus.cc:2393] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 in current term 2: Already voted for candidate 572e5980055c424db2e88348b978bd27 in this term.
I20260709 12:13:30.337456 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.320406 20757 raft_consensus.cc:493] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.342494 20757 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.321566 19668 raft_consensus.cc:1240] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:30.322256 20575 raft_consensus.cc:2804] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:30.354909 20575 raft_consensus.cc:697] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.356686 20575 consensus_queue.cc:237] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.357777 20720 leader_election.cc:290] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.327710 20707 raft_consensus.cc:2749] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.362836 20508 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:30.364512 20724 leader_election.cc:290] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:30.365572 19567 consensus_peers.cc:597] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:30.366586 19595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:30.367493 19595 raft_consensus.cc:2393] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 2: Already voted for candidate 3fead653f118481bbe2fd33fc1357863 in this term.
I20260709 12:13:30.368060 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:30.368332 19567 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.369524 19567 consensus_peers.cc:597] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:30.387532 20368 raft_consensus.cc:1275] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:30.407485 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
W20260709 12:13:30.414954 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 104536us
I20260709 12:13:30.418416 20757 raft_consensus.cc:515] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:30.420588 20557 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:30.420984 20757 leader_election.cc:290] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:30.423087 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:30.423448 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:30.423843 19675 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.424093 19671 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.429387 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.430557 19740 raft_consensus.cc:1275] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.431813 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.438679 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:30.439787 20322 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.441606 20329 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.442657 20329 tablet_bootstrap.cc:492] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:30.442477 20322 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.443343 20724 raft_consensus.cc:2749] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.443451 20689 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.444088 20724 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:30.444037 20689 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:30.447552 20689 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.443397 20329 ts_tablet_manager.cc:1403] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 1.137s	user 0.027s	sys 0.015s
W20260709 12:13:30.449486 19641 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.449976 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 117270us
I20260709 12:13:30.450271 20693 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.452380 19641 leader_election.cc:400] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269) with higher term. Message: Invalid argument: T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
I20260709 12:13:30.452145 20329 raft_consensus.cc:359] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.452513 19595 raft_consensus.cc:1275] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.452718 19641 leader_election.cc:403] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:30.452903 20329 raft_consensus.cc:740] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.449297 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:30.458376 20711 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.459717 19667 raft_consensus.cc:1275] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:30.461366 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.462646 19675 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.471238 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88a723a68914de697e0cfeecbe67feb" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:30.473845 20322 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:30.480789 19749 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 2.
I20260709 12:13:30.463300 20329 consensus_queue.cc:260] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.490078 20757 raft_consensus.cc:2749] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.490670 20323 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.490922 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.492166 19668 raft_consensus.cc:1275] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.492362 20557 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.549577 19673 raft_consensus.cc:1275] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.549790 20322 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:30.494045 19600 raft_consensus.cc:1275] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.494845 19567 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:30.496728 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:30.498924 19671 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.507447 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca90458485a4134b58207db6d06437c" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.554324 20322 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:30.555696 19671 raft_consensus.cc:1240] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Rejecting Update request from peer df754e24c604440998ec5ed4153e9925 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.509341 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:30.510633 20367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe94d451da2a4b8e976fbbb83fef20c0" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:30.540243 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c322c0a8eff47689b5f8ce4ec0ff377" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.563155 19748 raft_consensus.cc:3060] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.535569 19640 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.557723 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.557899 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.558013 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aeb9c640288454589feb69100b7fc08" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.548349 20698 consensus_queue.cc:1059] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:13:30.558619 20760 raft_consensus.cc:2804] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:30.573762 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 83233.1us
I20260709 12:13:30.558746 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5727af21d244c4e9a1553f6cbd29dd4" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:30.559373 20662 raft_consensus.cc:493] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:30.576819 20711 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.560000 20373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:30.567816 20716 raft_consensus.cc:2804] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.555493 20609 raft_consensus.cc:2749] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269) with higher term. Message: Invalid argument: T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3.
W20260709 12:13:30.578666 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 83925.3us
I20260709 12:13:30.579280 20720 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:30.534883 20603 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:13:30.580967 20603 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.581192 20682 raft_consensus.cc:3055] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:30.581949 19566 leader_election.cc:304] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.582412 20682 raft_consensus.cc:740] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.583746 19746 raft_consensus.cc:2368] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:30.584203 20682 consensus_queue.cc:260] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.584723 20708 raft_consensus.cc:2749] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.582764 20689 consensus_queue.cc:1048] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:30.585613 20716 raft_consensus.cc:697] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:30.561789 19594 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.586603 20371 raft_consensus.cc:1240] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:30.566507 19596 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.586630 20716 consensus_queue.cc:237] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.572620 19743 raft_consensus.cc:3060] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.577106 20662 raft_consensus.cc:515] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:30.582968 20760 raft_consensus.cc:697] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:30.591653 20760 consensus_queue.cc:237] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.592629 20662 leader_election.cc:290] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.573638 19592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.588471 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a908ea554d7e491cb92f45b6bea563fe" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:30.545881 20724 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:30.594425 20372 raft_consensus.cc:3060] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.594766 20724 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:30.595350 20329 ts_tablet_manager.cc:1434] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.004s
I20260709 12:13:30.597137 20724 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:30.561301 20376 raft_consensus.cc:1240] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:30.599362 20375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
I20260709 12:13:30.600154 20375 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 2.
I20260709 12:13:30.555284 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7998edb98a1a43b78e23e41850537ec2" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.602015 20367 raft_consensus.cc:1275] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:30.602588 20751 log.cc:927] Time spent T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.373s	user 0.000s	sys 0.005s
I20260709 12:13:30.605270 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:30.602064 19740 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.612332 20329 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:30.613833 20682 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:30.616093 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 47903.7us
I20260709 12:13:30.637612 20372 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:30.639003 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.645284 19748 raft_consensus.cc:2468] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.642306 19713 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
W20260709 12:13:30.646303 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 77678.1us
I20260709 12:13:30.647596 19640 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.654850 19713 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:30.653223 20638 consensus_queue.cc:1048] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:13:30.658408 19715 leader_election.cc:304] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:30.667971 20756 consensus_queue.cc:1048] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.674502 19641 leader_election.cc:304] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:30.676239 19640 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:30.649608 20576 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:30.676577 20683 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:30.686062 20576 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.686609 20576 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.686822 20590 raft_consensus.cc:2804] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.687425 20590 raft_consensus.cc:697] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.688344 20590 consensus_queue.cc:237] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:30.690207 19743 raft_consensus.cc:2468] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.655278 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:30.681299 20525 raft_consensus.cc:2749] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.691989 20634 consensus_queue.cc:1059] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:30.692255 19594 raft_consensus.cc:2468] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:30.693038 20638 raft_consensus.cc:3055] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.693383 20638 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:30.694250 20638 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:30.695712 20638 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.698144 20525 raft_consensus.cc:2749] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.698858 19740 raft_consensus.cc:2468] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:30.678756 20712 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:13:30.703915 19600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:30.654109 20323 leader_election.cc:304] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.709868 20688 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:30.710032 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 61752.4us
I20260709 12:13:30.710479 20688 raft_consensus.cc:697] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:30.711078 20323 leader_election.cc:400] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:30.711392 20323 leader_election.cc:403] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:30.711455 20688 consensus_queue.cc:237] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.712065 20724 raft_consensus.cc:2749] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.713064 20724 raft_consensus.cc:2749] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141) with higher term. Message: Invalid argument: T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 for earlier term 2. Current term is 3.
I20260709 12:13:30.724697 20372 raft_consensus.cc:3060] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.724843 20713 consensus_queue.cc:1059] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:30.727793 20322 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.734935 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.721654 20687 consensus_queue.cc:1059] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:30.735510 20322 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:30.733687 20720 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:30.749243 20695 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.749579 20613 raft_consensus.cc:2749] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:30.774019 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5924755bd54b58b1ffc3f0d229730b" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:30.790817 19640 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.786104 19742 raft_consensus.cc:1275] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.789820 20323 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:30.798789 20695 raft_consensus.cc:2804] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.799394 20695 raft_consensus.cc:697] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:30.800422 20695 consensus_queue.cc:237] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.819705 19596 raft_consensus.cc:2468] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 4.
I20260709 12:13:30.821412 19592 raft_consensus.cc:1240] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:30.784003 20576 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.833952 20529 raft_consensus.cc:3055] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:30.834625 20529 raft_consensus.cc:740] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:30.845085 20607 raft_consensus.cc:3055] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.845808 20607 raft_consensus.cc:740] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:30.846714 20607 consensus_queue.cc:260] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.847966 20607 raft_consensus.cc:3060] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.848367 19744 raft_consensus.cc:2468] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:30.851437 19640 leader_election.cc:304] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925
I20260709 12:13:30.852624 20322 leader_election.cc:304] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:30.845283 20576 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:30.863396 19674 raft_consensus.cc:1275] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:30.866276 20529 consensus_queue.cc:260] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:30.867844 20529 raft_consensus.cc:3060] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.876694 20720 raft_consensus.cc:2804] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:30.882838 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:30.883054 20525 raft_consensus.cc:2749] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:30.913924 20711 consensus_queue.cc:1048] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:13:30.882269 20618 consensus_queue.cc:1048] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:13:30.911339 20376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "df754e24c604440998ec5ed4153e9925" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27"
I20260709 12:13:30.958563 20376 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.961869 20760 raft_consensus.cc:493] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:30.962544 20760 raft_consensus.cc:515] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:30.964928 20760 leader_election.cc:290] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:30.965480 20720 raft_consensus.cc:697] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:30.966537 20720 consensus_queue.cc:237] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
W20260709 12:13:30.968433 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.981668 19674 raft_consensus.cc:1275] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:31.015816 19671 raft_consensus.cc:1275] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.026664 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:31.030522 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13720c08f1984c45a3a13db51fb4b552" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:31.120393 19674 raft_consensus.cc:1275] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.085906 20373 raft_consensus.cc:1275] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.133141 19640 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 572e5980055c424db2e88348b978bd27
I20260709 12:13:31.150054 20618 raft_consensus.cc:2804] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:31.153955 19746 raft_consensus.cc:1240] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:31.170679 20607 consensus_queue.cc:1059] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:31.173095 20767 log.cc:927] Time spent T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.486s	user 0.003s	sys 0.000s
I20260709 12:13:31.163854 20618 raft_consensus.cc:697] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:31.199090 20329 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.231323 20329 tablet_bootstrap.cc:492] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:31.232259 20329 ts_tablet_manager.cc:1403] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.620s	user 0.022s	sys 0.019s
I20260709 12:13:31.237753 20618 consensus_queue.cc:237] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
W20260709 12:13:31.241750 20774 log.cc:927] Time spent T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:13:31.224347 19746 raft_consensus.cc:1275] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:31.254558 19567 consensus_peers.cc:597] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:31.261281 19671 raft_consensus.cc:1275] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:13:31.261581 19567 consensus_peers.cc:597] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:31.256935 20329 raft_consensus.cc:359] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:31.262331 20329 raft_consensus.cc:740] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.261739 19671 pending_rounds.cc:85] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Aborting all ops after (but not including) 1
I20260709 12:13:31.256393 19744 raft_consensus.cc:1275] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.263638 19671 pending_rounds.cc:107] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:31.260344 20322 leader_election.cc:304] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:31.264011 19671 raft_consensus.cc:2889] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.264107 20329 consensus_queue.cc:260] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:31.264674 20695 raft_consensus.cc:2749] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:31.269265 20329 ts_tablet_manager.cc:1434] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 12:13:31.248015 20376 raft_consensus.cc:2468] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df754e24c604440998ec5ed4153e9925 in term 3.
I20260709 12:13:31.268617 19670 raft_consensus.cc:1275] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.267845 20760 consensus_queue.cc:1048] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:13:31.277990 20689 raft_consensus.cc:2749] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.274816 20695 consensus_queue.cc:1048] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:13:31.290131 20716 consensus_queue.cc:1048] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:31.301780 20724 consensus_queue.cc:1048] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:31.316924 20777 log.cc:927] Time spent T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:31.311088 20716 consensus_queue.cc:1048] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:13:31.326457 19749 raft_consensus.cc:1240] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Rejecting Update request from peer 4d030f5782db4855b3dc85fc01917a47 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:31.354838 19592 raft_consensus.cc:1275] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.356971 20690 consensus_queue.cc:1048] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:31.343616 20716 raft_consensus.cc:493] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:31.365844 20716 raft_consensus.cc:515] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:31.378593 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:31.379200 20372 raft_consensus.cc:1275] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.400812 19715 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:31.398900 20716 leader_election.cc:290] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:31.417939 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925588a0372f4594bbbffa180cc7ab38" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:31.424877 19749 raft_consensus.cc:2393] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 572e5980055c424db2e88348b978bd27 in current term 4: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:31.405414 20698 raft_consensus.cc:2804] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.403965 20503 consensus_queue.cc:1048] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:31.444912 20701 raft_consensus.cc:3055] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.419577 20546 consensus_queue.cc:1048] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:31.441166 20370 raft_consensus.cc:1275] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.440243 20698 raft_consensus.cc:697] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Leader. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:31.457738 20698 consensus_queue.cc:237] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:31.445468 20701 raft_consensus.cc:740] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:31.505360 20366 raft_consensus.cc:1275] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:31.506996 20793 log.cc:927] Time spent T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:13:31.521189 20779 log.cc:927] Time spent T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27: Append to log took a long time: real 0.260s	user 0.002s	sys 0.002s
W20260709 12:13:31.530866 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 51738.3us
I20260709 12:13:31.528568 20613 raft_consensus.cc:493] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4d030f5782db4855b3dc85fc01917a47)
I20260709 12:13:31.482731 20701 consensus_queue.cc:260] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:31.542351 20701 raft_consensus.cc:3060] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.536536 20745 consensus_queue.cc:1048] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:31.546792 20699 consensus_queue.cc:1048] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:31.540149 19592 raft_consensus.cc:1275] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:31.548250 20711 consensus_queue.cc:1048] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:31.552857 19641 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:31.555258 20613 raft_consensus.cc:515] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:31.567042 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:31.570271 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d765db7288b4a1f86414e48476ffbab" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:31.573787 20329 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:31.575361 20724 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:31.588227 20372 raft_consensus.cc:1275] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.598630 19673 raft_consensus.cc:1275] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:31.599361 19673 pending_rounds.cc:85] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Aborting all ops after (but not including) 2
I20260709 12:13:31.599685 19673 pending_rounds.cc:107] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:31.599984 19673 raft_consensus.cc:2889] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.561642 20613 leader_election.cc:290] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:31.605463 20609 consensus_queue.cc:1048] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:31.609694 20807 consensus_queue.cc:1048] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:31.603763 20699 consensus_queue.cc:1048] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:31.631258 19741 raft_consensus.cc:1275] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:31.638314 19421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39130 (request call id 108) took 3466 ms. Trace:
I20260709 12:13:31.638777 19421 rpcz_store.cc:276] 0709 12:13:28.172172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.177938 (+  5766us) service_pool.cc:224] Handling call
0709 12:13:31.638245 (+3460307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:29.565454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:29.566113 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:29.566152 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:13:29.566171 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:29.566552 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:29.566616 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:29.566644 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:29.566865 (+   221us) tablet.cc:701] Row locks acquired
0709 12:13:29.566898 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:13:29.567053 (+   155us) write_op.cc:270] Start()
0709 12:13:29.567171 (+   118us) write_op.cc:276] Timestamp: P: 1783599209567007 usec, L: 0
0709 12:13:29.567195 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:29.567931 (+   736us) log.cc:844] Serialized 540 byte log entry
0709 12:13:30.416171 (+848240us) op_driver.cc:464] REPLICATION: finished
0709 12:13:30.646305 (+230134us) write_op.cc:301] APPLY: starting
0709 12:13:30.652717 (+  6412us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:30.664372 (+ 11655us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:30.664546 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:30.664816 (+   270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:30.665018 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:30.665071 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:30.665458 (+   387us) log.cc:844] Serialized 22 byte log entry
0709 12:13:30.666384 (+   926us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.666493 (+   109us) write_op.cc:454] Released schema lock
0709 12:13:30.666543 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:30.666985 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.667021 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":138178,"apply.run_cpu_time_us":2178,"apply.run_wall_time_us":98036,"num_ops":1,"prepare.queue_time_us":143942,"prepare.run_cpu_time_us":12042,"prepare.run_wall_time_us":180866,"raft.queue_time_us":126170,"raft.run_cpu_time_us":31366,"raft.run_wall_time_us":131039,"replication_time_us":848795,"thread_start_us":435063,"threads_started":4,"wal-append.queue_time_us":406112}]]}
I20260709 12:13:31.636920 19424 catalog_manager.cc:5697] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:31.690716 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 126197us
I20260709 12:13:31.777578 19565 leader_election.cc:304] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:31.736809 20323 leader_election.cc:304] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 572e5980055c424db2e88348b978bd27; no voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925
I20260709 12:13:31.815088 20695 raft_consensus.cc:3060] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.815891 20710 raft_consensus.cc:2749] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.845398 20329 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.846786 20329 tablet_bootstrap.cc:492] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:31.847600 20329 ts_tablet_manager.cc:1403] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.274s	user 0.029s	sys 0.041s
I20260709 12:13:31.851083 20329 raft_consensus.cc:359] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:31.851874 20329 raft_consensus.cc:740] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
W20260709 12:13:31.827657 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 99101.7us
I20260709 12:13:31.852645 20329 consensus_queue.cc:260] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:31.855525 20329 ts_tablet_manager.cc:1434] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:31.856524 20329 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:31.901707 20757 consensus_queue.cc:1048] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:31.918874 20815 log.cc:927] Time spent T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:13:31.915832 20695 raft_consensus.cc:2749] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:31.932277 19746 raft_consensus.cc:1275] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:31.935426 20618 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:32.024773 19565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 62846.5us
W20260709 12:13:32.033188 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 75654.3us
W20260709 12:13:32.034228 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 76581.7us
I20260709 12:13:32.053218 20374 raft_consensus.cc:1275] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:32.059854 20587 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:32.074136 20587 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:32.076471 20587 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:32.080353 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47" is_pre_election: true
I20260709 12:13:32.081560 19670 raft_consensus.cc:2393] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 in current term 3: Already voted for candidate 4d030f5782db4855b3dc85fc01917a47 in this term.
I20260709 12:13:32.099674 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:32.101621 19749 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:32.122646 19566 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:32.124614 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:32.138070 20821 log.cc:927] Time spent T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:13:32.132091 20752 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:32.214972 20752 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df754e24c604440998ec5ed4153e9925)
I20260709 12:13:32.262960 20374 raft_consensus.cc:1275] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:32.269306 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 44585.9us
I20260709 12:13:32.274493 19669 raft_consensus.cc:1275] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer df754e24c604440998ec5ed4153e9925: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:32.275077 19669 pending_rounds.cc:85] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Aborting all ops after (but not including) 1
I20260709 12:13:32.275336 19669 pending_rounds.cc:107] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:32.275586 19669 raft_consensus.cc:2889] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.255383 20752 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.307821 20803 consensus_queue.cc:1048] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:13:32.350328 20829 consensus_queue.cc:1048] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:32.383652 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 66437.3us
W20260709 12:13:32.413748 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 173430us
I20260709 12:13:32.469128 20829 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.470245 20829 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:32.414779 20576 consensus_queue.cc:1048] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:13:32.484827 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 79940.6us
I20260709 12:13:32.475353 20829 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:32.512310 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 76840.9us
W20260709 12:13:32.514092 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 62122.7us
I20260709 12:13:32.537611 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:32.561748 19596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863" is_pre_election: true
I20260709 12:13:32.562749 19740 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:32.616737 20752 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:32.620441 19640 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:32.621994 19596 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 3.
I20260709 12:13:32.625828 20752 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:32.635694 20688 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:32.636305 20688 raft_consensus.cc:493] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.636691 20688 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:32.645720 19566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 75943.2us
I20260709 12:13:32.650658 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:32.660334 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:32.662266 19740 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:32.663952 19566 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:32.664819 20587 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.665337 20587 raft_consensus.cc:697] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:32.666244 20587 consensus_queue.cc:237] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:32.642584 19421 catalog_manager.cc:5697] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 4, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 4 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } }
I20260709 12:13:32.673137 19421 catalog_manager.cc:5697] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } }
I20260709 12:13:32.674755 19421 catalog_manager.cc:5697] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } }
I20260709 12:13:32.686655 19421 catalog_manager.cc:5697] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } }
I20260709 12:13:32.688396 19421 catalog_manager.cc:5697] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 3, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to df754e24c604440998ec5ed4153e9925 (127.10.114.68). New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.695432 19421 catalog_manager.cc:5697] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.698077 20790 raft_consensus.cc:493] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.698697 20790 raft_consensus.cc:515] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:32.693967 20688 raft_consensus.cc:515] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:32.701349 19421 catalog_manager.cc:5697] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.705355 19421 catalog_manager.cc:5697] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:32.706552 20834 log.cc:927] Time spent T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Append to log took a long time: real 0.161s	user 0.003s	sys 0.000s
I20260709 12:13:32.707050 19421 catalog_manager.cc:5697] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.709926 19421 catalog_manager.cc:5697] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.711304 19421 catalog_manager.cc:5697] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } }
I20260709 12:13:32.712855 19421 catalog_manager.cc:5697] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } }
I20260709 12:13:32.714125 19421 catalog_manager.cc:5697] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.715400 19421 catalog_manager.cc:5697] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.716890 19421 catalog_manager.cc:5697] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.718223 19421 catalog_manager.cc:5697] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.720207 20329 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.719786 19421 catalog_manager.cc:5697] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:32.721407 20329 tablet_bootstrap.cc:492] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:32.726099 20329 ts_tablet_manager.cc:1403] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.870s	user 0.020s	sys 0.024s
I20260709 12:13:32.726711 20790 leader_election.cc:290] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
W20260709 12:13:32.727041 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 252890us
I20260709 12:13:32.730783 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:32.732048 20329 raft_consensus.cc:359] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:32.732857 20329 raft_consensus.cc:740] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.733618 20329 consensus_queue.cc:260] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:32.744612 20329 ts_tablet_manager.cc:1434] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:13:32.745651 20329 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:32.760057 19669 raft_consensus.cc:2368] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4.
W20260709 12:13:32.815310 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 77271us
W20260709 12:13:32.818851 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 51194.7us
W20260709 12:13:32.823241 19567 consensus_peers.cc:597] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:32.865471 20372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d159542ccac45e9b41498d3b8d8855e" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "572e5980055c424db2e88348b978bd27" is_pre_election: true
W20260709 12:13:32.879040 19639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 45745.5us
I20260709 12:13:32.965155 19565 leader_election.cc:400] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Vote denied by peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579) with higher term. Message: Invalid argument: T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4.
I20260709 12:13:32.989737 19641 leader_election.cc:304] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
W20260709 12:13:32.991348 19641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 53006.9us
I20260709 12:13:33.081128 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:33.093415 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8399862a368c4cc485d207717c3e484f" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:33.096751 19741 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.082489 20618 raft_consensus.cc:2749] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:33.106845 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 69793.7us
I20260709 12:13:33.101931 20688 leader_election.cc:290] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
W20260709 12:13:33.143776 19641 consensus_peers.cc:597] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:33.182542 19567 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.208673 20834 log.cc:927] Time spent T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 12:13:33.242470 20329 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:33.280731 19741 raft_consensus.cc:2468] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:33.299698 19640 leader_election.cc:304] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:33.302659 20329 tablet_bootstrap.cc:492] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:33.303700 20329 ts_tablet_manager.cc:1403] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.558s	user 0.035s	sys 0.017s
I20260709 12:13:33.310863 20833 raft_consensus.cc:2804] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:33.374497 20329 raft_consensus.cc:359] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:33.386652 20329 raft_consensus.cc:740] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.352866 20833 raft_consensus.cc:697] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:33.395087 19424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41962 (request call id 9) took 4383 ms. Trace:
I20260709 12:13:33.392917 20329 consensus_queue.cc:260] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:33.409032 20329 ts_tablet_manager.cc:1434] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260709 12:13:33.430848 20833 consensus_queue.cc:237] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:33.395566 19424 rpcz_store.cc:276] 0709 12:13:29.006350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.006533 (+   183us) service_pool.cc:224] Handling call
0709 12:13:33.389690 (+4383157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:32.063591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:32.221727 (+158136us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:32.223759 (+  2032us) write_op.cc:435] Acquired schema lock
0709 12:13:32.238369 (+ 14610us) tablet.cc:662] Decoding operations
0709 12:13:32.272550 (+ 34181us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:32.272622 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:32.272650 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:32.272885 (+   235us) tablet.cc:701] Row locks acquired
0709 12:13:32.272900 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:13:32.273058 (+   158us) write_op.cc:270] Start()
0709 12:13:32.273187 (+   129us) write_op.cc:276] Timestamp: P: 1783599212273011 usec, L: 0
0709 12:13:32.273215 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:13:32.274005 (+   790us) log.cc:844] Serialized 540 byte log entry
0709 12:13:32.705810 (+431805us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007f1f18914343 00007f1f18914240 00007f1f182a31d4 00007f1f21fe1304 00007f1f21fe1299 00007f1f187cedb1 00007f1f1886cc85 00007f1f1886d6a2 00007f1f1b5df1db 00007f1f1b5daaaf 00007f1f1b5ce86e 00007f1f1b5cdbb6 00007f1f1b5cd7d8 00007f1f1b5d7221 00007f1f1b5d71d9 00007f1f1b5d7169
0709 12:13:33.125958 (+420148us) op_driver.cc:464] REPLICATION: finished
0709 12:13:33.266236 (+140278us) write_op.cc:301] APPLY: starting
0709 12:13:33.288070 (+ 21834us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:33.299155 (+ 11085us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:33.301443 (+  2288us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:33.318384 (+ 16941us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:33.321717 (+  3333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:33.321782 (+    65us) write_op.cc:312] APPLY: finished
0709 12:13:33.322020 (+   238us) log.cc:844] Serialized 22 byte log entry
0709 12:13:33.322243 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.322340 (+    97us) write_op.cc:454] Released schema lock
0709 12:13:33.322396 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:33.322814 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.322843 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":957236,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":114240,"apply.run_cpu_time_us":2240,"apply.run_wall_time_us":75460,"num_ops":1,"prepare.queue_time_us":367209,"prepare.run_cpu_time_us":33003,"prepare.run_wall_time_us":437247,"raft.queue_time_us":384547,"raft.run_cpu_time_us":53769,"raft.run_wall_time_us":204029,"replication_time_us":838678,"spinlock_wait_cycles":4060544,"thread_start_us":817080,"threads_started":4,"wal-append.queue_time_us":216045}]]}
I20260709 12:13:33.469930 19595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f7b8d5106e4679be8e8f50d28f2adc"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:33.471021 19595 raft_consensus.cc:606] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:33.471498 19595 raft_consensus.cc:614] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:33.474747 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 47047.2us
I20260709 12:13:33.494712 19741 raft_consensus.cc:1240] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:33.498170 20806 consensus_queue.cc:1059] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.499166 20806 raft_consensus.cc:3055] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:33.499531 20806 raft_consensus.cc:740] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:33.500654 20806 consensus_queue.cc:260] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:33.521958 20806 raft_consensus.cc:3060] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:33.529752 20329 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:33.547940 19672 raft_consensus.cc:1240] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Rejecting Update request from peer 3fead653f118481bbe2fd33fc1357863 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:33.565289 19423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39122 (request call id 119) took 5477 ms. Trace:
I20260709 12:13:33.566028 19423 rpcz_store.cc:276] 0709 12:13:28.087590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.103606 (+ 16016us) service_pool.cc:224] Handling call
0709 12:13:33.565203 (+5461597us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568842,"reported_tablets":7}
I20260709 12:13:33.573599 19421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39130 (request call id 109) took 1390 ms. Trace:
I20260709 12:13:33.574143 19421 rpcz_store.cc:276] 0709 12:13:32.183597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.193321 (+  9724us) service_pool.cc:224] Handling call
0709 12:13:33.573487 (+1380166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:32.727597 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:32.728218 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:32.728271 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:13:32.728288 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:32.729947 (+  1659us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:32.729996 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:32.730031 (+    35us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:13:32.743848 (+ 13817us) tablet.cc:701] Row locks acquired
0709 12:13:32.743864 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:13:32.744029 (+   165us) write_op.cc:270] Start()
0709 12:13:32.744158 (+   129us) write_op.cc:276] Timestamp: P: 1783599212743977 usec, L: 0
0709 12:13:32.744175 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:13:32.744955 (+   780us) log.cc:844] Serialized 6741 byte log entry
0709 12:13:33.279003 (+534048us) op_driver.cc:464] REPLICATION: finished
0709 12:13:33.323194 (+ 44191us) write_op.cc:301] APPLY: starting
0709 12:13:33.323286 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:33.323694 (+   408us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:33.323809 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:33.342871 (+ 19062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:33.343283 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:13:33.343361 (+    78us) write_op.cc:312] APPLY: finished
0709 12:13:33.343924 (+   563us) log.cc:844] Serialized 118 byte log entry
0709 12:13:33.352345 (+  8421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.392332 (+ 39987us) write_op.cc:454] Released schema lock
0709 12:13:33.398416 (+  6084us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:33.416053 (+ 17637us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.418150 (+  2097us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":703,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":43962,"apply.run_cpu_time_us":6453,"apply.run_wall_time_us":88145,"num_ops":17,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":5405,"prepare.run_wall_time_us":17625,"replication_time_us":534682,"thread_start_us":70730,"threads_started":1}]]}
W20260709 12:13:33.578969 19567 consensus_peers.cc:597] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:33.581156 19420 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39136 (request call id 102) took 5485 ms. Trace:
I20260709 12:13:33.582156 19420 rpcz_store.cc:276] 0709 12:13:28.095841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.096562 (+   721us) service_pool.cc:224] Handling call
0709 12:13:33.581079 (+5484517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25475,"reported_tablets":11}
I20260709 12:13:33.619710 19420 catalog_manager.cc:5697] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } }
W20260709 12:13:33.697263 19641 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:33.712109 19672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "868515b0534a4a8abf8679260fa290bd"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:33.713024 19672 raft_consensus.cc:606] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
W20260709 12:13:33.714216 19567 consensus_peers.cc:597] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:33.713951 19423 catalog_manager.cc:5697] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df754e24c604440998ec5ed4153e9925" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } }
I20260709 12:13:33.716305 19423 catalog_manager.cc:5697] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 2 to 4, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.728765 19595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:33.729962 19595 raft_consensus.cc:606] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:33.733464 19598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:33.734211 19598 raft_consensus.cc:606] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:33.799753 20329 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:33.800910 20329 tablet_bootstrap.cc:492] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:33.801666 20329 ts_tablet_manager.cc:1403] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.272s	user 0.028s	sys 0.003s
I20260709 12:13:33.804842 20329 raft_consensus.cc:359] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.805568 20329 raft_consensus.cc:740] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.806536 20329 consensus_queue.cc:260] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.809705 20329 ts_tablet_manager.cc:1434] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:33.810678 20329 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:33.819492 19743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372"
dest_uuid: "df754e24c604440998ec5ed4153e9925"
mode: GRACEFUL
new_leader_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:13:33.820415 19743 raft_consensus.cc:606] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Received request to transfer leadership to TS 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:33.821971 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:33.824211 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.839179 20844 raft_consensus.cc:993] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:33.839802 20844 raft_consensus.cc:1081] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:33.848978 20329 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:33.850186 20329 tablet_bootstrap.cc:492] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:33.850899 20329 ts_tablet_manager.cc:1403] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260709 12:13:33.826797 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.855239 20329 raft_consensus.cc:359] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.855991 20329 raft_consensus.cc:740] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.856734 20329 consensus_queue.cc:260] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.857836 20372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49116
I20260709 12:13:33.858597 20372 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.859022 20372 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.859859 20329 ts_tablet_manager.cc:1434] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:33.860868 20329 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:33.861366 19595 raft_consensus.cc:1275] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:33.861907 19595 pending_rounds.cc:85] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Aborting all ops after (but not including) 2
I20260709 12:13:33.862197 19595 pending_rounds.cc:107] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:33.862500 19595 raft_consensus.cc:2889] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:33.864509 20787 consensus_queue.cc:1048] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.888712 20329 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:33.891505 20329 tablet_bootstrap.cc:492] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:33.893568 20329 ts_tablet_manager.cc:1403] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
I20260709 12:13:33.879101 20372 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.899258 20372 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:33.900629 20329 raft_consensus.cc:359] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:33.901579 20329 raft_consensus.cc:740] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.904047 20329 consensus_queue.cc:260] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:33.905504 19598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:33.906195 19598 raft_consensus.cc:3055] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.906522 19598 raft_consensus.cc:740] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:33.907307 19598 consensus_queue.cc:260] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:33.908187 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac84a47779154a7db8a00ff0d0412204" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:33.908844 19672 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.909406 20329 ts_tablet_manager.cc:1434] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:33.910416 20329 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
W20260709 12:13:33.911154 20851 consensus_queue.cc:1175] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4d030f5782db4855b3dc85fc01917a47" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:13:33.908252 19598 raft_consensus.cc:3060] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.934811 19598 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:33.927456 20712 raft_consensus.cc:993] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:33.943879 20322 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:33.967671 20807 raft_consensus.cc:2804] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.968559 20807 raft_consensus.cc:697] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:33.950943 20806 raft_consensus.cc:1081] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:34.016323 20375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49116
I20260709 12:13:34.026420 20375 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.027005 20375 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.998618 20807 consensus_queue.cc:237] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:34.037705 20366 raft_consensus.cc:3060] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:13:34.039623 20869 log.cc:927] Time spent T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:34.062687 19672 raft_consensus.cc:2468] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:34.071069 19741 raft_consensus.cc:1275] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:34.074028 20833 consensus_queue.cc:1048] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.072739 20375 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:34.123824 20745 raft_consensus.cc:993] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: : Instructing follower 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:34.123948 20375 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:34.124464 20745 raft_consensus.cc:1081] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Signalling peer 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:34.134621 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:34.135423 19599 raft_consensus.cc:3055] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.135756 19599 raft_consensus.cc:740] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:34.161824 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacfce93aefc4889a06015b277ff1b20" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:34.162757 19743 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.165413 19595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:32834
I20260709 12:13:34.166376 19595 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.166846 19595 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.173931 19599 consensus_queue.cc:260] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:34.179193 19599 raft_consensus.cc:3060] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.189245 20329 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.234269 20329 tablet_bootstrap.cc:492] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:34.235134 20329 ts_tablet_manager.cc:1403] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.325s	user 0.024s	sys 0.024s
I20260709 12:13:34.257519 20329 raft_consensus.cc:359] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:34.266742 20329 raft_consensus.cc:740] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:34.275720 19599 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:34.280763 19743 raft_consensus.cc:2468] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:34.283560 20322 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:34.291086 20873 raft_consensus.cc:2804] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.291782 20873 raft_consensus.cc:697] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:34.291990 20329 consensus_queue.cc:260] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:34.296610 20329 ts_tablet_manager.cc:1434] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 12:13:34.305740 20329 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:34.305703 19595 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:34.308561 19595 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:34.292805 20873 consensus_queue.cc:237] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:34.312453 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:34.314014 19741 raft_consensus.cc:3055] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:34.314482 19741 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:34.317379 19741 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:34.320236 19741 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.322973 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:34.323786 19668 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:34.337643 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:45319, user_credentials={real_user=slave}} blocked reactor thread for 52806.5us
I20260709 12:13:34.379182 19424 catalog_manager.cc:5697] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 2 to 3, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.384666 19668 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:34.386409 19565 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:34.387861 19741 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:34.389459 20495 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.392458 20495 raft_consensus.cc:697] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:34.396634 20495 consensus_queue.cc:237] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:34.437227 19595 raft_consensus.cc:1275] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.439239 20873 consensus_queue.cc:1048] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.520120 20329 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.522730 20329 tablet_bootstrap.cc:492] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:34.529453 20329 ts_tablet_manager.cc:1403] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.232s	user 0.024s	sys 0.004s
I20260709 12:13:34.546264 20329 raft_consensus.cc:359] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:34.557054 20329 raft_consensus.cc:740] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:34.558081 20329 consensus_queue.cc:260] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:34.560458 19668 raft_consensus.cc:1275] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.560672 20329 ts_tablet_manager.cc:1434] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:34.565668 20873 consensus_queue.cc:1048] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.581804 20329 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Bootstrap starting.
I20260709 12:13:34.593988 19421 catalog_manager.cc:5697] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 2 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.609813 19424 catalog_manager.cc:5697] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.617918 20329 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.621984 20329 tablet_bootstrap.cc:492] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Bootstrap complete.
I20260709 12:13:34.624413 20329 ts_tablet_manager.cc:1403] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.000s
I20260709 12:13:34.628290 20329 raft_consensus.cc:359] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:34.629222 20329 raft_consensus.cc:740] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572e5980055c424db2e88348b978bd27, State: Initialized, Role: FOLLOWER
I20260709 12:13:34.630169 20329 consensus_queue.cc:260] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:34.632946 20329 ts_tablet_manager.cc:1434] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:34.801047 19599 raft_consensus.cc:1275] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.832190 20807 consensus_queue.cc:1048] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:34.855983 19741 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.862324 20844 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:34.938774 19741 raft_consensus.cc:1275] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.942589 20724 consensus_queue.cc:1048] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:34.953259 19668 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.961694 20809 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:13:35.008699 20374 raft_consensus.cc:3060] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.011053 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.306885 19668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:35.307931 19668 raft_consensus.cc:606] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:35.311975 19668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:35.312675 19668 raft_consensus.cc:606] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:35.316780 19668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:35.317502 19668 raft_consensus.cc:606] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:35.320672 19741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad"
dest_uuid: "df754e24c604440998ec5ed4153e9925"
mode: GRACEFUL
new_leader_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:13:35.321382 19741 raft_consensus.cc:606] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Received request to transfer leadership to TS 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:35.333104 19672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e853e43f31754497af8a31670524bf48"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:35.333825 19672 raft_consensus.cc:606] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:35.337746 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:35.340011 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:35.341094 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:35.530256 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 56103.1us
I20260709 12:13:35.534510 20833 raft_consensus.cc:993] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.535151 20833 raft_consensus.cc:1081] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.546272 20861 raft_consensus.cc:993] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: : Instructing follower 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:35.547272 20898 raft_consensus.cc:1081] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Signalling peer 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:35.566637 19599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:32834
I20260709 12:13:35.575114 19599 raft_consensus.cc:493] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.575593 19599 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.584549 19599 raft_consensus.cc:515] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:35.588425 19599 leader_election.cc:290] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:35.590274 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:35.591295 19741 raft_consensus.cc:3055] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:35.592164 19741 raft_consensus.cc:740] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:35.593365 19741 consensus_queue.cc:260] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:35.594846 19741 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.595904 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c784ec6891b74c94b92d9c582a90b4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:35.596596 19672 raft_consensus.cc:3060] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.614723 20374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49098
I20260709 12:13:35.615504 20374 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.615885 20374 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.623534 20787 raft_consensus.cc:993] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.629504 20787 raft_consensus.cc:1081] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.633725 19672 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:35.635075 19741 raft_consensus.cc:2468] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:35.628268 20374 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.636112 19565 leader_election.cc:304] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:35.639269 20374 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:35.640033 20809 raft_consensus.cc:2804] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.642230 20375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49098
I20260709 12:13:35.642627 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:35.643985 20375 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.644042 19599 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.644531 20375 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.647670 20809 raft_consensus.cc:697] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:35.648847 20809 consensus_queue.cc:237] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:35.661755 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9c0649834fdfb63ddf5de8171790" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:35.662623 19672 raft_consensus.cc:3055] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:35.662997 19672 raft_consensus.cc:740] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:35.659809 19599 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:35.667936 20322 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:35.669816 20787 raft_consensus.cc:993] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.670285 20787 raft_consensus.cc:1081] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.670838 20873 raft_consensus.cc:2804] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:35.671557 20873 raft_consensus.cc:697] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:35.672636 20873 consensus_queue.cc:237] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.675079 19672 consensus_queue.cc:260] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.676889 20374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49098
I20260709 12:13:35.677587 20374 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.678006 20374 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.681128 20375 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.677958 19672 raft_consensus.cc:3060] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.690445 20375 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:35.692425 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:35.693262 19741 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.694972 19672 raft_consensus.cc:2468] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:35.701181 19423 catalog_manager.cc:5697] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 3 to 4, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 4 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.702704 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3762e9a9190d4cc78877b5e3c924edf1" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:35.710251 19672 raft_consensus.cc:3055] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:35.710696 19672 raft_consensus.cc:740] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:35.711725 19672 consensus_queue.cc:260] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.717788 19672 raft_consensus.cc:3060] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:35.740655 19741 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:35.742197 20323 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:35.744189 20724 raft_consensus.cc:2804] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:35.744537 20374 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.753067 19424 catalog_manager.cc:5697] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 2 to 3, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.760211 20374 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:35.764788 19672 raft_consensus.cc:2468] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 3.
I20260709 12:13:35.762496 20724 raft_consensus.cc:697] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:35.770491 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:35.771171 19599 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.771552 20724 consensus_queue.cc:237] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.774971 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfa19e6ee804f05badf77fafb8aaede" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:35.775771 19672 raft_consensus.cc:3055] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.776154 19672 raft_consensus.cc:740] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:35.777205 19672 consensus_queue.cc:260] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.778824 19672 raft_consensus.cc:3060] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.783598 19599 raft_consensus.cc:2468] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:35.791625 20322 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:35.797137 20688 raft_consensus.cc:993] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.800074 20688 raft_consensus.cc:1081] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:35.804419 19672 raft_consensus.cc:2468] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:35.812338 20873 raft_consensus.cc:2804] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:35.842042 20873 raft_consensus.cc:697] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:35.843187 20873 consensus_queue.cc:237] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:35.822485 20367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e853e43f31754497af8a31670524bf48"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49098
I20260709 12:13:35.847378 20367 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.848507 20367 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.871824 20367 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.875578 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:35.876343 19670 raft_consensus.cc:3055] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:35.876699 19670 raft_consensus.cc:740] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:35.877714 19670 consensus_queue.cc:260] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.879194 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:35.879238 19670 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.880023 19741 raft_consensus.cc:3060] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.891040 20367 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:35.890810 19424 catalog_manager.cc:5697] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 2 to 3, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 3 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:35.892988 19424 catalog_manager.cc:5697] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 1 to 2, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.890937 19741 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 4.
I20260709 12:13:35.909436 19670 raft_consensus.cc:2468] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 4.
I20260709 12:13:35.910231 20323 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:35.912015 20873 raft_consensus.cc:2804] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.912546 20873 raft_consensus.cc:697] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 4 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:35.913550 20873 consensus_queue.cc:237] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:35.936878 19424 catalog_manager.cc:5697] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 3 to 4, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 4 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.128906 19597 raft_consensus.cc:1275] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:36.130739 20873 consensus_queue.cc:1048] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:36.172444 19670 raft_consensus.cc:1275] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:36.175227 20873 consensus_queue.cc:1048] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:36.199954 19741 raft_consensus.cc:1275] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.209007 20809 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:36.236260 19672 raft_consensus.cc:1275] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.242503 19668 raft_consensus.cc:1275] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:36.244516 20724 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:36.253624 20844 consensus_queue.cc:1048] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:36.321202 19742 raft_consensus.cc:1275] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:36.328704 19672 raft_consensus.cc:1275] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.330924 20911 consensus_queue.cc:1048] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:36.329595 20873 consensus_queue.cc:1048] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:36.368006 19599 raft_consensus.cc:1275] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.377426 20873 consensus_queue.cc:1048] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:36.443738 19742 raft_consensus.cc:1275] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.446019 20873 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:36.467005 19672 raft_consensus.cc:1275] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.468752 20912 consensus_queue.cc:1048] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:36.492045 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.670310 19740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247"
dest_uuid: "df754e24c604440998ec5ed4153e9925"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:13:36.671114 19740 raft_consensus.cc:606] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:36.707219 19597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:36.707978 19597 raft_consensus.cc:606] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:36.728773 19740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad"
dest_uuid: "df754e24c604440998ec5ed4153e9925"
mode: GRACEFUL
new_leader_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:13:36.731916 19740 raft_consensus.cc:606] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Received request to transfer leadership to TS 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:36.735533 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:36.737816 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:36.738765 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.794158 20809 raft_consensus.cc:993] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:36.794777 20809 raft_consensus.cc:1081] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
W20260709 12:13:36.859277 19567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:46269, user_credentials={real_user=slave}} blocked reactor thread for 78904.5us
I20260709 12:13:36.864379 20366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49116
I20260709 12:13:36.865119 20366 raft_consensus.cc:493] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:36.865573 20366 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.885497 20366 raft_consensus.cc:515] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:36.888458 20366 leader_election.cc:290] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:36.888962 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:36.889715 19597 raft_consensus.cc:3055] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:36.889777 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa2642f7104207a8efe0e665a3b269" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:36.890100 19597 raft_consensus.cc:740] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:36.890395 19670 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.890949 19597 consensus_queue.cc:260] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:36.892246 19597 raft_consensus.cc:3060] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.899533 19670 raft_consensus.cc:2468] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:36.911062 20322 leader_election.cc:304] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:36.912173 20912 raft_consensus.cc:2804] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:36.912756 20912 raft_consensus.cc:697] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:36.913797 20912 consensus_queue.cc:237] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:36.911593 20861 raft_consensus.cc:993] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:36.922677 19597 raft_consensus.cc:2468] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 2.
I20260709 12:13:36.922104 20861 raft_consensus.cc:1081] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:36.930529 20367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49104
I20260709 12:13:36.931231 20367 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:36.931704 20367 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.940136 20367 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:36.941386 19420 catalog_manager.cc:5697] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 1 to 2, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.942440 20367 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 election: Requested vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:36.945611 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:36.946220 19597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dcab19c6084c678008d8f7f05a6247" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:36.946545 19740 raft_consensus.cc:3055] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:36.946853 19597 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.946993 19740 raft_consensus.cc:740] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:36.948140 19740 consensus_queue.cc:260] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:36.949465 19740 raft_consensus.cc:3060] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.960723 19597 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 5.
I20260709 12:13:36.971671 19740 raft_consensus.cc:2468] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 5.
I20260709 12:13:36.973194 20323 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:36.974249 20912 raft_consensus.cc:2804] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:36.974798 20912 raft_consensus.cc:697] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 5 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:36.975889 20912 consensus_queue.cc:237] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:37.051393 19420 catalog_manager.cc:5697] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 4 to 5, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 5 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.076710 20861 raft_consensus.cc:993] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: : Instructing follower 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:37.077433 20861 raft_consensus.cc:1081] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Signalling peer 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:37.080572 19597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:32834
I20260709 12:13:37.081251 19597 raft_consensus.cc:493] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:37.081707 19597 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.095283 19597 raft_consensus.cc:515] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:37.097848 19597 leader_election.cc:290] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:37.098208 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:37.098975 19740 raft_consensus.cc:3055] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.099416 19740 raft_consensus.cc:740] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df754e24c604440998ec5ed4153e9925, State: Running, Role: LEADER
I20260709 12:13:37.097805 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e9c841139946a1a52d0c744d8be4ad" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:37.100024 19672 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.105762 19740 consensus_queue.cc:260] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:37.109252 19740 raft_consensus.cc:3060] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.127555 19672 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:37.134832 19565 leader_election.cc:304] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:37.132629 19740 raft_consensus.cc:2468] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:37.136731 20844 raft_consensus.cc:2804] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:37.137284 20844 raft_consensus.cc:697] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:37.138334 20844 consensus_queue.cc:237] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:37.192838 19420 catalog_manager.cc:5697] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 2 to 3, leader changed from df754e24c604440998ec5ed4153e9925 (127.10.114.68) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.325464 19597 raft_consensus.cc:1275] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.328588 19672 raft_consensus.cc:1275] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.334079 20911 consensus_queue.cc:1048] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:37.347859 20911 consensus_queue.cc:1048] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:37.533586 19597 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:37.537377 20911 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:37.556912 19742 raft_consensus.cc:1275] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:37.558738 20911 consensus_queue.cc:1048] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:37.599107 19672 raft_consensus.cc:1275] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:37.613741 20844 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:37.648303 19740 raft_consensus.cc:1275] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:37.650401 20938 consensus_queue.cc:1048] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:37.834900 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.957935 19594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "4d030f5782db4855b3dc85fc01917a47"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:37.958734 19594 raft_consensus.cc:606] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Received request to transfer leadership to TS 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:37.960584 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:37.962774 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:37.963698 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.377477 20844 raft_consensus.cc:993] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 4d030f5782db4855b3dc85fc01917a47 to start an election
I20260709 12:13:38.384651 20960 raft_consensus.cc:1081] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Signalling peer 4d030f5782db4855b3dc85fc01917a47 to start an election
I20260709 12:13:38.387672 19672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
 from {username='slave'} at 127.0.0.1:50704
I20260709 12:13:38.388481 19672 raft_consensus.cc:493] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.388935 19672 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.399402 19672 raft_consensus.cc:515] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:38.402761 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:38.403522 19594 raft_consensus.cc:3055] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:38.403842 19594 raft_consensus.cc:740] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:38.404762 19594 consensus_queue.cc:260] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:38.406136 19594 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.416347 19594 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:38.417383 19672 leader_election.cc:290] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:38.419206 19740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dcbe812aef4998990804a1ed2af372" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:38.420037 19740 raft_consensus.cc:3060] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.420573 19639 leader_election.cc:304] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:38.422077 20787 raft_consensus.cc:2804] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:38.422516 20787 raft_consensus.cc:697] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:38.423362 20787 consensus_queue.cc:237] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:38.450261 19420 catalog_manager.cc:5697] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 3 to 4, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.463119 19740 raft_consensus.cc:2468] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:38.865516 19742 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:38.868152 20964 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:38.895859 19594 raft_consensus.cc:1275] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:38.898622 20946 consensus_queue.cc:1048] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:39.026716 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:39.121033 19672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:39.121789 19672 raft_consensus.cc:606] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Received request to transfer leadership to TS 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:39.135027 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:39.137395 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:39.138475 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:39.531903 20964 raft_consensus.cc:993] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:39.532912 20946 raft_consensus.cc:1081] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Signalling peer 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:39.536070 19599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:32850
I20260709 12:13:39.536650 19599 raft_consensus.cc:493] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.536969 19599 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.547612 19599 raft_consensus.cc:515] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:39.552541 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:39.553211 19670 raft_consensus.cc:3055] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.553591 19670 raft_consensus.cc:740] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:39.554466 19670 consensus_queue.cc:260] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:39.555675 19670 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.556226 19599 leader_election.cc:290] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:39.557873 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6702a791d14f5986fb8d9f62527a1b" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:39.558429 19741 raft_consensus.cc:3060] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.564627 19670 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:39.566133 19565 leader_election.cc:304] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:39.567031 20844 raft_consensus.cc:2804] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.567485 20844 raft_consensus.cc:697] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:39.568389 20844 consensus_queue.cc:237] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:39.578428 19741 raft_consensus.cc:2468] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 4.
I20260709 12:13:39.600309 19420 catalog_manager.cc:5697] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 3 to 4, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 4 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.018872 19741 raft_consensus.cc:1275] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:40.020753 20938 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.036991 19672 raft_consensus.cc:1275] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:40.040259 20844 consensus_queue.cc:1048] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.188570 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:40.229104 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 90360.9us
I20260709 12:13:40.289753 19599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "4d030f5782db4855b3dc85fc01917a47"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:40.290455 19599 raft_consensus.cc:606] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Received request to transfer leadership to TS 4d030f5782db4855b3dc85fc01917a47
I20260709 12:13:40.309751 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:40.311995 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:40.312911 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.399955 20844 raft_consensus.cc:993] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 4d030f5782db4855b3dc85fc01917a47 to start an election
I20260709 12:13:40.406358 20844 raft_consensus.cc:1081] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Signalling peer 4d030f5782db4855b3dc85fc01917a47 to start an election
I20260709 12:13:40.408185 19670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
 from {username='slave'} at 127.0.0.1:50704
I20260709 12:13:40.408962 19670 raft_consensus.cc:493] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:40.409409 19670 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.421576 19670 raft_consensus.cc:515] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:40.425549 19670 leader_election.cc:290] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:40.425736 19599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:40.427899 19599 raft_consensus.cc:3055] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.428289 19599 raft_consensus.cc:740] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:40.429173 19599 consensus_queue.cc:260] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:40.430584 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247f50197bf344b88a8e8bea4eac96af" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:40.431408 19741 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.454157 19741 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:40.456430 19640 leader_election.cc:304] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47, df754e24c604440998ec5ed4153e9925; no voters: 
I20260709 12:13:40.458034 20964 raft_consensus.cc:2804] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.458722 20964 raft_consensus.cc:697] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Becoming Leader. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:40.459821 20964 consensus_queue.cc:237] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:40.486117 19599 raft_consensus.cc:3060] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.492589 19420 catalog_manager.cc:5697] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 reported cstate change: term changed from 3 to 4, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "4d030f5782db4855b3dc85fc01917a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.500118 19599 raft_consensus.cc:2468] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d030f5782db4855b3dc85fc01917a47 in term 4.
I20260709 12:13:40.964112 19597 raft_consensus.cc:1275] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:40.965457 20787 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:41.034116 19741 raft_consensus.cc:1275] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Refusing update from remote peer 4d030f5782db4855b3dc85fc01917a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.036945 20787 consensus_queue.cc:1048] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:41.190384 20322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:46579, user_credentials={real_user=slave}} blocked reactor thread for 50406.6us
I20260709 12:13:41.374128 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.457096 19672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7"
dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
mode: GRACEFUL
new_leader_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:43192
I20260709 12:13:41.457875 19672 raft_consensus.cc:606] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Received request to transfer leadership to TS 3fead653f118481bbe2fd33fc1357863
I20260709 12:13:41.465075 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:41.469173 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:41.470216 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.807888 20964 raft_consensus.cc:993] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: : Instructing follower 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:41.808642 20964 raft_consensus.cc:1081] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Signalling peer 3fead653f118481bbe2fd33fc1357863 to start an election
I20260709 12:13:41.810904 19597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
 from {username='slave'} at 127.0.0.1:32850
I20260709 12:13:41.811570 19597 raft_consensus.cc:493] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.811949 19597 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.821516 19597 raft_consensus.cc:515] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:41.827234 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:41.827939 19672 raft_consensus.cc:3055] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.828248 19672 raft_consensus.cc:740] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d030f5782db4855b3dc85fc01917a47, State: Running, Role: LEADER
I20260709 12:13:41.831274 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a0f8f7464e49748ac20bb80dde66b7" candidate_uuid: "3fead653f118481bbe2fd33fc1357863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df754e24c604440998ec5ed4153e9925"
I20260709 12:13:41.838912 19741 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.829027 19672 consensus_queue.cc:260] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:41.840397 19672 raft_consensus.cc:3060] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.856531 19672 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:41.836573 19597 leader_election.cc:290] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Requested vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141)
I20260709 12:13:41.858403 19565 leader_election.cc:304] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 4d030f5782db4855b3dc85fc01917a47; no voters: 
I20260709 12:13:41.859583 20960 raft_consensus.cc:2804] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.860502 20960 raft_consensus.cc:697] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Becoming Leader. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:41.863489 19741 raft_consensus.cc:2468] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fead653f118481bbe2fd33fc1357863 in term 3.
I20260709 12:13:41.861645 20960 consensus_queue.cc:237] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } }
I20260709 12:13:41.885111 19420 catalog_manager.cc:5697] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 reported cstate change: term changed from 2 to 3, leader changed from 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67) to 3fead653f118481bbe2fd33fc1357863 (127.10.114.66). New cstate: current_term: 3 leader_uuid: "3fead653f118481bbe2fd33fc1357863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.371093 19670 raft_consensus.cc:1275] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.376034 21002 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:42.465098 19741 raft_consensus.cc:1275] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Refusing update from remote peer 3fead653f118481bbe2fd33fc1357863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.471325 21008 consensus_queue.cc:1048] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:42.552340 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:42.747449 20323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.68:40141, user_credentials={real_user=slave}} blocked reactor thread for 119390us
I20260709 12:13:42.760883 19594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a"
dest_uuid: "3fead653f118481bbe2fd33fc1357863"
mode: GRACEFUL
new_leader_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:42.761675 19594 raft_consensus.cc:606] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Received request to transfer leadership to TS 572e5980055c424db2e88348b978bd27
I20260709 12:13:42.763278 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:42.766448 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:42.767238 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:42.969424 21014 raft_consensus.cc:993] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: : Instructing follower 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:42.970206 20960 raft_consensus.cc:1081] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Signalling peer 572e5980055c424db2e88348b978bd27 to start an election
I20260709 12:13:42.983166 20375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a"
dest_uuid: "572e5980055c424db2e88348b978bd27"
 from {username='slave'} at 127.0.0.1:49116
I20260709 12:13:42.983889 20375 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:42.984259 20375 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.994467 20375 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:43.002115 20375 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 election: Requested vote from peers 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319), 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579)
I20260709 12:13:43.006609 19594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3fead653f118481bbe2fd33fc1357863"
I20260709 12:13:43.007474 19594 raft_consensus.cc:3055] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:43.008894 19594 raft_consensus.cc:740] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3fead653f118481bbe2fd33fc1357863, State: Running, Role: LEADER
I20260709 12:13:43.010823 19594 consensus_queue.cc:260] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:43.012512 19594 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.018400 19594 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 5.
I20260709 12:13:43.022841 20322 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27; no voters: 
I20260709 12:13:43.024089 21015 raft_consensus.cc:2804] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:43.024628 21015 raft_consensus.cc:697] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 5 LEADER]: Becoming Leader. State: Replica: 572e5980055c424db2e88348b978bd27, State: Running, Role: LEADER
I20260709 12:13:43.027175 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c344a86e8d03425aaead9ea7d59b338a" candidate_uuid: "572e5980055c424db2e88348b978bd27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4d030f5782db4855b3dc85fc01917a47"
I20260709 12:13:43.027928 19668 raft_consensus.cc:3060] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.027573 21015 consensus_queue.cc:237] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:43.057874 19668 raft_consensus.cc:2468] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572e5980055c424db2e88348b978bd27 in term 5.
I20260709 12:13:43.071849 19420 catalog_manager.cc:5697] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 reported cstate change: term changed from 4 to 5, leader changed from 3fead653f118481bbe2fd33fc1357863 (127.10.114.66) to 572e5980055c424db2e88348b978bd27 (127.10.114.65). New cstate: current_term: 5 leader_uuid: "572e5980055c424db2e88348b978bd27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.552229 19597 raft_consensus.cc:1275] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:43.553721 21015 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:43.591725 19668 raft_consensus.cc:1275] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Refusing update from remote peer 572e5980055c424db2e88348b978bd27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:43.594043 20986 consensus_queue.cc:1048] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:43.850553 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:43.899410 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:43.900876 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:43.901482 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:44.053591 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:44.100819 10697 tablet_server.cc:179] TabletServer@127.10.114.65:46269 shutting down...
W20260709 12:13:44.130609 19567 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 12:13:44.134398 19567 consensus_peers.cc:597] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.143076 19567 consensus_peers.cc:597] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.150257 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:44.151439 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.152617 10697 raft_consensus.cc:2243] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.153257 10697 raft_consensus.cc:2272] T 868515b0534a4a8abf8679260fa290bd P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.154657 19715 consensus_peers.cc:597] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.156857 10697 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:44.157388 19715 consensus_peers.cc:597] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.157881 10697 raft_consensus.cc:2243] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.158463 10697 raft_consensus.cc:2272] T dae9718b125b4fa8bffa5181c27d1e55 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.160723 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.161422 10697 raft_consensus.cc:2243] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.161903 10697 raft_consensus.cc:2272] T b07ebcb794f547e59406e697d62764da P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.164321 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.164991 10697 raft_consensus.cc:2243] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.165930 10697 raft_consensus.cc:2272] T 6bfa19e6ee804f05badf77fafb8aaede P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.168417 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.169070 10697 raft_consensus.cc:2243] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.169601 10697 raft_consensus.cc:2272] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.171799 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.172663 10697 raft_consensus.cc:2243] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.173173 10697 raft_consensus.cc:2272] T 1941144d30204ecf9a3dd3587b1d7fce P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.176054 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.176892 10697 raft_consensus.cc:2243] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.178046 10697 raft_consensus.cc:2272] T ac84a47779154a7db8a00ff0d0412204 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.180471 19641 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.182018 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.183125 10697 raft_consensus.cc:2243] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.183651 10697 raft_consensus.cc:2272] T a29a6ca896c346c288f2435cd3621579 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.186712 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.187822 10697 raft_consensus.cc:2243] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.188411 10697 raft_consensus.cc:2272] T fe94d451da2a4b8e976fbbb83fef20c0 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.191738 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.192739 10697 raft_consensus.cc:2243] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.193310 10697 raft_consensus.cc:2272] T a908ea554d7e491cb92f45b6bea563fe P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.196492 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.197377 10697 raft_consensus.cc:2243] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.197970 10697 raft_consensus.cc:2272] T 8f525b72ac964395b5d6eeb9d9056795 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.200322 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.201113 10697 raft_consensus.cc:2243] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.202142 10697 raft_consensus.cc:2272] T c344a86e8d03425aaead9ea7d59b338a P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.205438 10697 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:44.206095 19641 consensus_peers.cc:597] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.206355 10697 raft_consensus.cc:2243] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.207574 10697 raft_consensus.cc:2272] T 7998edb98a1a43b78e23e41850537ec2 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.210000 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.210678 10697 raft_consensus.cc:2243] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.211166 10697 raft_consensus.cc:2272] T 925588a0372f4594bbbffa180cc7ab38 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.213913 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.214751 10697 raft_consensus.cc:2243] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.215536 10697 raft_consensus.cc:2272] T 56dd21d8f0714b5e9855a7b741f56cf8 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.218575 19715 consensus_peers.cc:597] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.218851 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.219908 10697 raft_consensus.cc:2243] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.221015 10697 raft_consensus.cc:2272] T a344ca7b35de49269ba122ad135ff08d P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.223245 19715 consensus_peers.cc:597] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.224020 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.224778 10697 raft_consensus.cc:2243] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.225243 10697 raft_consensus.cc:2272] T ec016e46aa0b42909cc2783d5a41af25 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.227607 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.228233 10697 raft_consensus.cc:2243] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.228694 10697 raft_consensus.cc:2272] T 41b302db5638420a9a5c34f1a2016ae7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.231185 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.231833 10697 raft_consensus.cc:2243] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.232335 10697 raft_consensus.cc:2272] T 8aeb9c640288454589feb69100b7fc08 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.235363 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.236279 10697 raft_consensus.cc:2243] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.237213 10697 raft_consensus.cc:2272] T d5fa2642f7104207a8efe0e665a3b269 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.240836 19641 consensus_peers.cc:597] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.241779 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.242875 10697 raft_consensus.cc:2243] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.243973 10697 raft_consensus.cc:2272] T e853e43f31754497af8a31670524bf48 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.248979 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.250109 10697 raft_consensus.cc:2243] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.250777 10697 raft_consensus.cc:2272] T 97e2ee4873a445579d2a95e3cb490114 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.252068 19715 consensus_peers.cc:597] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.254016 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.255117 10697 raft_consensus.cc:2243] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.255762 10697 raft_consensus.cc:2272] T d555f82bd1764821a44971e502c2f604 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.257424 19715 consensus_peers.cc:597] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.259285 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.260293 10697 raft_consensus.cc:2243] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.260855 10697 raft_consensus.cc:2272] T ea8f0895419f44028178397e52ffe4ed P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.260979 19715 consensus_peers.cc:597] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.262934 19567 consensus_peers.cc:597] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.264147 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.265152 10697 raft_consensus.cc:2243] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.266093 10697 raft_consensus.cc:2272] T 00dcab19c6084c678008d8f7f05a6247 P 572e5980055c424db2e88348b978bd27 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.268529 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.269162 10697 raft_consensus.cc:2243] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.269724 10697 raft_consensus.cc:2272] T 8ff9f6251ac44db9b2768886ba30f320 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.272675 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.273506 10697 raft_consensus.cc:2243] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.274740 10697 raft_consensus.cc:2272] T 73f7b8d5106e4679be8e8f50d28f2adc P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.278105 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.279003 10697 raft_consensus.cc:2243] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.279584 10697 raft_consensus.cc:2272] T d6697ba38fa643d2829f82139140437a P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.280054 19715 consensus_peers.cc:597] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.285180 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.286293 10697 raft_consensus.cc:2243] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.286972 10697 raft_consensus.cc:2272] T fa021c2a57f94b72b6f4e27aadcb0d94 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.290192 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.291070 10697 raft_consensus.cc:2243] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.291706 10697 raft_consensus.cc:2272] T 5cb173ec27e04352b94a70d12816f13f P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.291818 19715 consensus_peers.cc:597] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.295081 10697 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:44.295181 19641 consensus_peers.cc:597] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.296108 10697 raft_consensus.cc:2243] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.296741 10697 raft_consensus.cc:2272] T 0ca90458485a4134b58207db6d06437c P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.296168 19641 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.300076 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.300994 10697 raft_consensus.cc:2243] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.301571 10697 raft_consensus.cc:2272] T 66354051e3784a78b453ce8d710d547d P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.304826 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.305691 10697 raft_consensus.cc:2243] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.306900 10697 raft_consensus.cc:2272] T d5727af21d244c4e9a1553f6cbd29dd4 P 572e5980055c424db2e88348b978bd27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.309955 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.310753 10697 raft_consensus.cc:2243] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.311276 10697 raft_consensus.cc:2272] T 13720c08f1984c45a3a13db51fb4b552 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.314476 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.315385 10697 raft_consensus.cc:2243] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.316026 10697 raft_consensus.cc:2272] T b05afddf2c6c406b81d2a504e08b994d P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.319309 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.320089 10697 raft_consensus.cc:2243] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.320632 10697 raft_consensus.cc:2272] T a652f7acae11499b8631edbb9126b6d4 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.323194 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.323868 10697 raft_consensus.cc:2243] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.324306 10697 raft_consensus.cc:2272] T 88072bf4089a469889379d666c797134 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.326797 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.327489 10697 raft_consensus.cc:2243] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.328078 10697 raft_consensus.cc:2272] T 85bddd172e9b48829a3a0e923ecf94a7 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.330653 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.331312 10697 raft_consensus.cc:2243] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.332151 10697 raft_consensus.cc:2272] T 0f1b9c0649834fdfb63ddf5de8171790 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.334594 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.335147 10697 raft_consensus.cc:2243] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.335580 10697 raft_consensus.cc:2272] T f89165741a8b41d0981531ad0cfb5b20 P 572e5980055c424db2e88348b978bd27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.337800 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.338424 10697 raft_consensus.cc:2243] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.338878 10697 raft_consensus.cc:2272] T 9d159542ccac45e9b41498d3b8d8855e P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.341054 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.341606 10697 raft_consensus.cc:2243] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.342535 10697 raft_consensus.cc:2272] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.345103 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.345723 10697 raft_consensus.cc:2243] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.346256 10697 raft_consensus.cc:2272] T 2ac728d3e6f7413194553b8493db9ad8 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.348358 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.349036 10697 raft_consensus.cc:2243] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.349988 10697 raft_consensus.cc:2272] T bacfce93aefc4889a06015b277ff1b20 P 572e5980055c424db2e88348b978bd27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.352433 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:44.353390 10697 raft_consensus.cc:2243] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.354526 10697 raft_consensus.cc:2272] T 3762e9a9190d4cc78877b5e3c924edf1 P 572e5980055c424db2e88348b978bd27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.357000 19567 consensus_peers.cc:597] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.364233 19641 consensus_peers.cc:597] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.365746 19715 consensus_peers.cc:597] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.393812 19715 consensus_peers.cc:597] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.401023 19567 consensus_peers.cc:597] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.416292 19567 consensus_peers.cc:597] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.439973 19641 consensus_peers.cc:597] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.440861 19567 consensus_peers.cc:597] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.447393 10697 tablet_server.cc:196] TabletServer@127.10.114.65:46269 shutdown complete.
W20260709 12:13:44.450891 19567 consensus_peers.cc:597] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.451776 19567 consensus_peers.cc:597] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.487157 19567 consensus_peers.cc:597] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.513234 19715 consensus_peers.cc:597] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.516481 19715 consensus_peers.cc:597] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.532239 19567 consensus_peers.cc:597] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 -> Peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Couldn't send request to peer 572e5980055c424db2e88348b978bd27. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.556556 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
W20260709 12:13:44.568084 19713 consensus_peers.cc:597] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.574118 19639 consensus_peers.cc:597] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.616348 19713 consensus_peers.cc:597] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.618912 19713 consensus_peers.cc:597] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.624476 19639 consensus_peers.cc:597] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.628166 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:44.629171 10697 tablet_replica.cc:333] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.630337 10697 raft_consensus.cc:2243] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.631074 10697 raft_consensus.cc:2272] T 247f50197bf344b88a8e8bea4eac96af P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.635878 10697 tablet_replica.cc:333] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.637283 10697 raft_consensus.cc:2243] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.658746 10697 raft_consensus.cc:2272] T c784ec6891b74c94b92d9c582a90b4ad P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.658946 19639 consensus_peers.cc:597] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.661322 10697 tablet_replica.cc:333] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.662225 10697 raft_consensus.cc:2243] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.662849 10697 raft_consensus.cc:2272] T d6697ba38fa643d2829f82139140437a P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.665429 10697 tablet_replica.cc:333] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.666437 10697 raft_consensus.cc:2243] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.672175 10697 raft_consensus.cc:2272] T ec016e46aa0b42909cc2783d5a41af25 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.673805 19639 consensus_peers.cc:597] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.675328 10697 tablet_replica.cc:333] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.677649 10697 raft_consensus.cc:2243] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.678277 10697 raft_consensus.cc:2272] T ea8f0895419f44028178397e52ffe4ed P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.681062 10697 tablet_replica.cc:333] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.681846 10697 raft_consensus.cc:2243] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.682482 10697 raft_consensus.cc:2272] T 5d765db7288b4a1f86414e48476ffbab P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.685334 10697 tablet_replica.cc:333] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.686278 10697 raft_consensus.cc:2243] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.686787 10697 raft_consensus.cc:2272] T f89165741a8b41d0981531ad0cfb5b20 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.689989 10697 tablet_replica.cc:333] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.690868 10697 raft_consensus.cc:2243] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.691530 10697 raft_consensus.cc:2272] T 868515b0534a4a8abf8679260fa290bd P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.694661 10697 tablet_replica.cc:333] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.695693 10697 raft_consensus.cc:2243] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.696272 10697 raft_consensus.cc:2272] T b05afddf2c6c406b81d2a504e08b994d P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.699491 10697 tablet_replica.cc:333] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.700450 10697 raft_consensus.cc:2243] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.701016 10697 raft_consensus.cc:2272] T c344a86e8d03425aaead9ea7d59b338a P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.701323 19639 consensus_peers.cc:597] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.704092 10697 tablet_replica.cc:333] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.707441 10697 raft_consensus.cc:2243] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.708819 10697 raft_consensus.cc:2272] T 8f525b72ac964395b5d6eeb9d9056795 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.712218 10697 tablet_replica.cc:333] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.713322 10697 raft_consensus.cc:2243] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.717726 10697 raft_consensus.cc:2272] T af5924755bd54b58b1ffc3f0d229730b P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.721197 10697 tablet_replica.cc:333] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.726835 10697 raft_consensus.cc:2243] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.727594 10697 raft_consensus.cc:2272] T d5727af21d244c4e9a1553f6cbd29dd4 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.731240 10697 tablet_replica.cc:333] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.732191 10697 raft_consensus.cc:2243] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.732808 10697 raft_consensus.cc:2272] T 66354051e3784a78b453ce8d710d547d P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.736150 10697 tablet_replica.cc:333] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.737322 10697 raft_consensus.cc:2243] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.738533 10697 raft_consensus.cc:2272] T 0ca90458485a4134b58207db6d06437c P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.741937 10697 tablet_replica.cc:333] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
W20260709 12:13:44.742597 19713 consensus_peers.cc:597] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.742805 10697 raft_consensus.cc:2243] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.750145 10697 raft_consensus.cc:2272] T 5cb173ec27e04352b94a70d12816f13f P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.756718 19639 consensus_peers.cc:597] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.757764 10697 tablet_replica.cc:333] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
W20260709 12:13:44.766839 19639 consensus_peers.cc:597] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.845559 19713 consensus_peers.cc:597] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:44.856609 19639 consensus_peers.cc:597] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.857506 10697 raft_consensus.cc:2243] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.863101 10697 raft_consensus.cc:2272] T 8399862a368c4cc485d207717c3e484f P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.880645 10697 tablet_replica.cc:333] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
W20260709 12:13:44.890353 19713 consensus_peers.cc:597] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.894057 10697 raft_consensus.cc:2243] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.895704 10697 raft_consensus.cc:2272] T a908ea554d7e491cb92f45b6bea563fe P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.904855 10697 tablet_replica.cc:333] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.906807 10697 raft_consensus.cc:2243] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.909958 10697 raft_consensus.cc:2272] T b07ebcb794f547e59406e697d62764da P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.915835 10697 tablet_replica.cc:333] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
W20260709 12:13:44.917145 19639 consensus_peers.cc:597] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.918341 10697 raft_consensus.cc:2243] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.920032 10697 raft_consensus.cc:2272] T 07a0f8f7464e49748ac20bb80dde66b7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.924484 10697 tablet_replica.cc:333] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.925962 10697 raft_consensus.cc:2243] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.929039 10697 raft_consensus.cc:2272] T fe94d451da2a4b8e976fbbb83fef20c0 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.929661 19639 consensus_peers.cc:597] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.935958 10697 tablet_replica.cc:333] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.937655 10697 raft_consensus.cc:2243] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.939502 10697 raft_consensus.cc:2272] T a29a6ca896c346c288f2435cd3621579 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.943377 10697 tablet_replica.cc:333] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.944321 10697 raft_consensus.cc:2243] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.945284 10697 raft_consensus.cc:2272] T 0f1b9c0649834fdfb63ddf5de8171790 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.949429 10697 tablet_replica.cc:333] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.951412 10697 raft_consensus.cc:2243] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.952905 10697 raft_consensus.cc:2272] T e3e9c841139946a1a52d0c744d8be4ad P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.955960 19639 consensus_peers.cc:597] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.957273 10697 tablet_replica.cc:333] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.958220 10697 raft_consensus.cc:2243] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.958884 10697 raft_consensus.cc:2272] T 6bfa19e6ee804f05badf77fafb8aaede P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.961800 10697 tablet_replica.cc:333] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.962539 10697 raft_consensus.cc:2243] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.963141 10697 raft_consensus.cc:2272] T bacfce93aefc4889a06015b277ff1b20 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.966135 10697 tablet_replica.cc:333] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.967119 10697 raft_consensus.cc:2243] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.967806 10697 raft_consensus.cc:2272] T f4b761cf2b4a4e1b94d77f416ca88f91 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.973875 10697 tablet_replica.cc:333] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.975128 10697 raft_consensus.cc:2243] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.976506 10697 raft_consensus.cc:2272] T f4dcbe812aef4998990804a1ed2af372 P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.980792 10697 tablet_replica.cc:333] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.981984 10697 raft_consensus.cc:2243] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.983166 10697 raft_consensus.cc:2272] T ac84a47779154a7db8a00ff0d0412204 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.990072 10697 tablet_replica.cc:333] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.991321 10697 raft_consensus.cc:2243] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.992641 10697 raft_consensus.cc:2272] T a881b97f3de4486698fd614567764d79 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.998063 10697 tablet_replica.cc:333] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:44.999406 10697 raft_consensus.cc:2243] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.000386 10697 raft_consensus.cc:2272] T 1941144d30204ecf9a3dd3587b1d7fce P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.002769 19639 consensus_peers.cc:597] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.005692 10697 tablet_replica.cc:333] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.007229 10697 raft_consensus.cc:2243] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.008471 10697 raft_consensus.cc:2272] T d88a723a68914de697e0cfeecbe67feb P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.013279 10697 tablet_replica.cc:333] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.014860 10697 raft_consensus.cc:2243] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.015976 10697 raft_consensus.cc:2272] T 8aeb9c640288454589feb69100b7fc08 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.020751 10697 tablet_replica.cc:333] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.021497 10697 raft_consensus.cc:2243] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.022766 10697 raft_consensus.cc:2272] T dae9718b125b4fa8bffa5181c27d1e55 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.025965 10697 tablet_replica.cc:333] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.026643 10697 raft_consensus.cc:2243] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.028079 10697 raft_consensus.cc:2272] T ea6702a791d14f5986fb8d9f62527a1b P 3fead653f118481bbe2fd33fc1357863 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.031915 19639 consensus_peers.cc:597] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.032027 10697 tablet_replica.cc:333] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.033172 10697 raft_consensus.cc:2243] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.034025 10697 raft_consensus.cc:2272] T d5fa2642f7104207a8efe0e665a3b269 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.037525 10697 tablet_replica.cc:333] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.038472 10697 raft_consensus.cc:2243] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.041000 10697 raft_consensus.cc:2272] T 88072bf4089a469889379d666c797134 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.048017 10697 tablet_replica.cc:333] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.049034 10697 raft_consensus.cc:2243] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:13:45.049520 19713 consensus_peers.cc:597] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 -> Peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Couldn't send request to peer 3fead653f118481bbe2fd33fc1357863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.050781 10697 raft_consensus.cc:2272] T 85bddd172e9b48829a3a0e923ecf94a7 P 3fead653f118481bbe2fd33fc1357863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.055016 10697 tablet_replica.cc:333] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.055948 10697 raft_consensus.cc:2243] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.057665 10697 raft_consensus.cc:2272] T d555f82bd1764821a44971e502c2f604 P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.060421 10697 tablet_replica.cc:333] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.061021 10697 raft_consensus.cc:2243] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.061589 10697 raft_consensus.cc:2272] T 97e2ee4873a445579d2a95e3cb490114 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.064090 10697 tablet_replica.cc:333] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.064618 10697 raft_consensus.cc:2243] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.065153 10697 raft_consensus.cc:2272] T da5953336e18402bac805e4d1e79cbfc P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.068157 10697 tablet_replica.cc:333] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.069095 10697 raft_consensus.cc:2243] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.070250 10697 raft_consensus.cc:2272] T 00dcab19c6084c678008d8f7f05a6247 P 3fead653f118481bbe2fd33fc1357863 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.074437 10697 tablet_replica.cc:333] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.075294 10697 raft_consensus.cc:2243] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.076150 10697 raft_consensus.cc:2272] T 73f7b8d5106e4679be8e8f50d28f2adc P 3fead653f118481bbe2fd33fc1357863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.079794 10697 tablet_replica.cc:333] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863: stopping tablet replica
I20260709 12:13:45.080811 10697 raft_consensus.cc:2243] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.081607 10697 raft_consensus.cc:2272] T 41f29b5fa12a4b79b10b5115c86d8915 P 3fead653f118481bbe2fd33fc1357863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.152840 21028 raft_consensus.cc:493] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.153906 21028 raft_consensus.cc:515] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:45.159411 21028 leader_election.cc:290] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.162171 19641 leader_election.cc:336] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
W20260709 12:13:45.162883 19639 leader_election.cc:336] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.163353 19639 leader_election.cc:304] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.164103 21028 raft_consensus.cc:2749] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.239635 21048 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.240458 21048 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.244117 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a344ca7b35de49269ba122ad135ff08d" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:45.249217 21048 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.259900 21041 raft_consensus.cc:493] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.260646 21041 raft_consensus.cc:515] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.263090 21041 leader_election.cc:290] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.264128 19641 leader_election.cc:336] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.264657 19641 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:45.265462 21048 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:45.268220 19713 leader_election.cc:336] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
W20260709 12:13:45.269892 19715 leader_election.cc:336] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.270404 19715 leader_election.cc:304] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.271219 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:13:45.271260 21041 raft_consensus.cc:2749] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.380765 21041 raft_consensus.cc:493] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.381512 21041 raft_consensus.cc:515] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.386435 21041 leader_election.cc:290] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.389055 19715 leader_election.cc:336] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
W20260709 12:13:45.390013 19713 leader_election.cc:336] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.390406 19713 leader_election.cc:304] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.391175 21041 raft_consensus.cc:2749] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.400429 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
W20260709 12:13:45.433570 19713 consensus_peers.cc:597] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:45.482547 19713 consensus_peers.cc:597] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:45.483511 19713 consensus_peers.cc:597] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.493264 21041 raft_consensus.cc:493] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.494035 21041 raft_consensus.cc:515] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.495232 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:45.496590 21041 leader_election.cc:290] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.496747 10697 tablet_replica.cc:333] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.498378 10697 raft_consensus.cc:2243] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.499729 10697 raft_consensus.cc:2272] T 247f50197bf344b88a8e8bea4eac96af P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.500519 19713 leader_election.cc:336] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:45.501731 19715 leader_election.cc:336] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.502111 19715 leader_election.cc:304] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.502777 21041 raft_consensus.cc:2749] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.503422 10697 tablet_replica.cc:333] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.504205 10697 raft_consensus.cc:2243] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.504771 10697 raft_consensus.cc:2272] T 3762e9a9190d4cc78877b5e3c924edf1 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.504871 21048 raft_consensus.cc:493] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.505491 21048 raft_consensus.cc:515] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:45.508054 21048 leader_election.cc:290] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:45.508514 10697 tablet_replica.cc:333] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.508737 21041 raft_consensus.cc:493] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.509819 10697 raft_consensus.cc:2243] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.510541 10697 raft_consensus.cc:2272] T a344ca7b35de49269ba122ad135ff08d P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.509392 21041 raft_consensus.cc:515] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.512979 21041 leader_election.cc:290] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.513852 10697 tablet_replica.cc:333] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
W20260709 12:13:45.513757 19641 leader_election.cc:336] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.515043 10697 raft_consensus.cc:2243] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.515861 10697 raft_consensus.cc:2272] T 7998edb98a1a43b78e23e41850537ec2 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.516745 19639 leader_election.cc:336] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.517294 19639 leader_election.cc:304] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.518112 21048 raft_consensus.cc:2749] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:45.518633 19713 leader_election.cc:336] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.519285 10697 tablet_replica.cc:333] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
W20260709 12:13:45.519294 19715 leader_election.cc:336] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.519946 19715 leader_election.cc:304] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.520272 10697 raft_consensus.cc:2243] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.520622 21041 raft_consensus.cc:2749] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.521019 10697 raft_consensus.cc:2272] T fe94d451da2a4b8e976fbbb83fef20c0 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.523887 10697 tablet_replica.cc:333] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.524716 10697 raft_consensus.cc:2243] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.525358 10697 raft_consensus.cc:2272] T c784ec6891b74c94b92d9c582a90b4ad P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.528064 10697 tablet_replica.cc:333] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.528846 10697 raft_consensus.cc:2243] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.529637 10697 raft_consensus.cc:2272] T d5727af21d244c4e9a1553f6cbd29dd4 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.532086 10697 tablet_replica.cc:333] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.532815 10697 raft_consensus.cc:2243] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.533901 10697 raft_consensus.cc:2272] T 868515b0534a4a8abf8679260fa290bd P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.535006 21028 raft_consensus.cc:493] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.535519 21028 raft_consensus.cc:515] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:45.537271 10697 tablet_replica.cc:333] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.537907 21028 leader_election.cc:290] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:45.538482 10697 raft_consensus.cc:2243] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.538403 21048 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.539424 10697 raft_consensus.cc:2272] T d88a723a68914de697e0cfeecbe67feb P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.539976 21048 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.541080 21028 raft_consensus.cc:493] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.541827 21028 raft_consensus.cc:515] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } } peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } }
I20260709 12:13:45.543023 10697 tablet_replica.cc:333] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.543267 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e853e43f31754497af8a31670524bf48" candidate_uuid: "4d030f5782db4855b3dc85fc01917a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "df754e24c604440998ec5ed4153e9925" is_pre_election: true
I20260709 12:13:45.544063 10697 raft_consensus.cc:2243] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.544494 21041 raft_consensus.cc:493] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.544822 10697 raft_consensus.cc:2272] T 5bbdfddcaeb249b0a188ce6aa6240f1a P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.545256 21041 raft_consensus.cc:515] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.548270 10697 tablet_replica.cc:333] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.548513 21041 leader_election.cc:290] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:45.549249 10697 raft_consensus.cc:2243] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.548471 21048 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers df754e24c604440998ec5ed4153e9925 (127.10.114.68:40141), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.544076 21028 leader_election.cc:290] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:45.550027 10697 raft_consensus.cc:2272] T c344a86e8d03425aaead9ea7d59b338a P 4d030f5782db4855b3dc85fc01917a47 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.554363 19713 leader_election.cc:336] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.554713 10697 tablet_replica.cc:333] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.555824 10697 raft_consensus.cc:2243] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:45.555852 19641 leader_election.cc:336] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.556530 10697 raft_consensus.cc:2272] T af5924755bd54b58b1ffc3f0d229730b P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.557381 19639 leader_election.cc:336] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.560462 10697 tablet_replica.cc:333] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.561558 10697 raft_consensus.cc:2243] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.562914 10697 raft_consensus.cc:2272] T 5d765db7288b4a1f86414e48476ffbab P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.563025 19639 leader_election.cc:304] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:45.563771 19715 leader_election.cc:336] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.564561 21028 raft_consensus.cc:2749] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:45.566033 19713 consensus_peers.cc:597] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.566126 10697 tablet_replica.cc:333] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.566159 19715 leader_election.cc:304] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
W20260709 12:13:45.566838 19641 leader_election.cc:336] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.567294 21041 raft_consensus.cc:2749] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:45.567421 19641 leader_election.cc:336] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.567435 10697 raft_consensus.cc:2243] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.568003 19641 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 572e5980055c424db2e88348b978bd27, df754e24c604440998ec5ed4153e9925
I20260709 12:13:45.568416 10697 raft_consensus.cc:2272] T 9c322c0a8eff47689b5f8ce4ec0ff377 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.571357 19639 leader_election.cc:336] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.571975 10697 tablet_replica.cc:333] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.571867 19639 leader_election.cc:304] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d030f5782db4855b3dc85fc01917a47; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.572348 21028 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.572799 21048 raft_consensus.cc:2749] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.573014 10697 raft_consensus.cc:2243] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.573814 10697 raft_consensus.cc:2272] T 9d159542ccac45e9b41498d3b8d8855e P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.577152 10697 tablet_replica.cc:333] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
W20260709 12:13:45.577874 19713 consensus_peers.cc:597] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.578183 10697 raft_consensus.cc:2243] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:45.578644 19713 consensus_peers.cc:597] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.579262 10697 raft_consensus.cc:2272] T f89165741a8b41d0981531ad0cfb5b20 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.581724 10697 tablet_replica.cc:333] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.582374 10697 raft_consensus.cc:2243] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.582849 10697 raft_consensus.cc:2272] T fa021c2a57f94b72b6f4e27aadcb0d94 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.585170 10697 tablet_replica.cc:333] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.585870 10697 raft_consensus.cc:2243] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.586346 10697 raft_consensus.cc:2272] T 13720c08f1984c45a3a13db51fb4b552 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.588672 10697 tablet_replica.cc:333] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.589286 10697 raft_consensus.cc:2243] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.589772 10697 raft_consensus.cc:2272] T 07a0f8f7464e49748ac20bb80dde66b7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.592561 10697 tablet_replica.cc:333] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.592557 21043 raft_consensus.cc:493] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.593631 10697 raft_consensus.cc:2243] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.593344 21043 raft_consensus.cc:515] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.594321 10697 raft_consensus.cc:2272] T 56dd21d8f0714b5e9855a7b741f56cf8 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.595881 21043 leader_election.cc:290] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.597549 10697 tablet_replica.cc:333] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.598460 10697 raft_consensus.cc:2243] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:13:45.599514 19713 leader_election.cc:336] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.599784 10697 raft_consensus.cc:2272] T 925588a0372f4594bbbffa180cc7ab38 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.600723 19715 leader_election.cc:336] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.601231 19715 leader_election.cc:304] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.602013 21043 raft_consensus.cc:2749] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.603053 10697 tablet_replica.cc:333] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.603830 10697 raft_consensus.cc:2243] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.604948 10697 raft_consensus.cc:2272] T f4dcbe812aef4998990804a1ed2af372 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.607882 10697 tablet_replica.cc:333] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.608825 10697 raft_consensus.cc:2243] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.609817 10697 raft_consensus.cc:2272] T f4b761cf2b4a4e1b94d77f416ca88f91 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.612000 10697 tablet_replica.cc:333] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.612551 10697 raft_consensus.cc:2243] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.613015 10697 raft_consensus.cc:2272] T e853e43f31754497af8a31670524bf48 P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.615379 10697 tablet_replica.cc:333] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.615958 10697 raft_consensus.cc:2243] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.616407 10697 raft_consensus.cc:2272] T d5fa2642f7104207a8efe0e665a3b269 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.618703 10697 tablet_replica.cc:333] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.619315 10697 raft_consensus.cc:2243] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.619864 10697 raft_consensus.cc:2272] T ea6702a791d14f5986fb8d9f62527a1b P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.623039 10697 tablet_replica.cc:333] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.623941 10697 raft_consensus.cc:2243] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.624703 10697 raft_consensus.cc:2272] T 88072bf4089a469889379d666c797134 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.627827 10697 tablet_replica.cc:333] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
W20260709 12:13:45.628444 19713 consensus_peers.cc:597] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.628784 10697 raft_consensus.cc:2243] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.629707 10697 raft_consensus.cc:2272] T 85bddd172e9b48829a3a0e923ecf94a7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.632586 10697 tablet_replica.cc:333] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.633183 10697 raft_consensus.cc:2243] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.633697 10697 raft_consensus.cc:2272] T d555f82bd1764821a44971e502c2f604 P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.635962 10697 tablet_replica.cc:333] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.636546 10697 raft_consensus.cc:2243] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.637682 10697 raft_consensus.cc:2272] T da5953336e18402bac805e4d1e79cbfc P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.641312 10697 tablet_replica.cc:333] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.642313 10697 raft_consensus.cc:2243] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.643708 10697 raft_consensus.cc:2272] T 97e2ee4873a445579d2a95e3cb490114 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.647084 10697 tablet_replica.cc:333] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.647984 10697 raft_consensus.cc:2243] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.648737 10697 raft_consensus.cc:2272] T 0f1b9c0649834fdfb63ddf5de8171790 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.651619 10697 tablet_replica.cc:333] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.652474 10697 raft_consensus.cc:2243] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.653054 10697 raft_consensus.cc:2272] T e3e9c841139946a1a52d0c744d8be4ad P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.655311 19713 consensus_peers.cc:597] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.655932 21041 raft_consensus.cc:493] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.655964 10697 tablet_replica.cc:333] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.656526 21041 raft_consensus.cc:515] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.656981 10697 raft_consensus.cc:2243] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.657863 10697 raft_consensus.cc:2272] T 6bfa19e6ee804f05badf77fafb8aaede P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.658768 21041 leader_election.cc:290] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.661626 10697 tablet_replica.cc:333] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
W20260709 12:13:45.661981 19713 leader_election.cc:336] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.662660 10697 raft_consensus.cc:2243] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.663584 10697 raft_consensus.cc:2272] T a652f7acae11499b8631edbb9126b6d4 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.663583 19715 leader_election.cc:336] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.664445 19715 leader_election.cc:304] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.665350 21041 raft_consensus.cc:2749] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.667671 10697 tablet_replica.cc:333] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.668545 10697 raft_consensus.cc:2243] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.669754 10697 raft_consensus.cc:2272] T b05afddf2c6c406b81d2a504e08b994d P 4d030f5782db4855b3dc85fc01917a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.672272 10697 tablet_replica.cc:333] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.673054 10697 raft_consensus.cc:2243] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.674157 10697 raft_consensus.cc:2272] T 41b302db5638420a9a5c34f1a2016ae7 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.676563 10697 tablet_replica.cc:333] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.677199 10697 raft_consensus.cc:2243] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.678243 10697 raft_consensus.cc:2272] T 41f29b5fa12a4b79b10b5115c86d8915 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.680779 10697 tablet_replica.cc:333] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.681424 10697 raft_consensus.cc:2243] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.682499 10697 raft_consensus.cc:2272] T 8399862a368c4cc485d207717c3e484f P 4d030f5782db4855b3dc85fc01917a47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.684914 10697 tablet_replica.cc:333] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.685461 10697 raft_consensus.cc:2243] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.686026 10697 raft_consensus.cc:2272] T 8ff9f6251ac44db9b2768886ba30f320 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.688591 10697 tablet_replica.cc:333] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.689163 10697 raft_consensus.cc:2243] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.689751 10697 raft_consensus.cc:2272] T ac84a47779154a7db8a00ff0d0412204 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.692328 10697 tablet_replica.cc:333] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.693099 10697 raft_consensus.cc:2243] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.694262 10697 raft_consensus.cc:2272] T a881b97f3de4486698fd614567764d79 P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.694708 21043 raft_consensus.cc:493] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 572e5980055c424db2e88348b978bd27)
I20260709 12:13:45.695441 21043 raft_consensus.cc:515] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d030f5782db4855b3dc85fc01917a47" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 46579 } } peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } }
I20260709 12:13:45.697817 10697 tablet_replica.cc:333] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.698139 21043 leader_election.cc:290] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579), 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269)
I20260709 12:13:45.698875 10697 raft_consensus.cc:2243] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.700273 10697 raft_consensus.cc:2272] T 1941144d30204ecf9a3dd3587b1d7fce P 4d030f5782db4855b3dc85fc01917a47 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:45.701015 19713 leader_election.cc:336] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:45.702673 19715 leader_election.cc:336] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.703097 19715 leader_election.cc:304] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 4d030f5782db4855b3dc85fc01917a47, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.703486 10697 tablet_replica.cc:333] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47: stopping tablet replica
I20260709 12:13:45.703835 21043 raft_consensus.cc:2749] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.704516 10697 raft_consensus.cc:2243] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.705183 10697 raft_consensus.cc:2272] T 2ac728d3e6f7413194553b8493db9ad8 P 4d030f5782db4855b3dc85fc01917a47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.715112 21041 raft_consensus.cc:493] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:45.715876 21041 raft_consensus.cc:515] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.719264 21041 leader_election.cc:290] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.723119 19713 leader_election.cc:336] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
W20260709 12:13:45.724294 19715 leader_election.cc:336] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:45.724855 19715 leader_election.cc:304] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.725733 21041 raft_consensus.cc:2749] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:45.762264 19713 consensus_peers.cc:597] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:45.770362 19713 consensus_peers.cc:597] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 -> Peer 4d030f5782db4855b3dc85fc01917a47 (127.10.114.67:46579): Couldn't send request to peer 4d030f5782db4855b3dc85fc01917a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.803822 21041 raft_consensus.cc:493] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:45.804502 21041 raft_consensus.cc:515] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.806927 21041 leader_election.cc:290] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.811654 19715 leader_election.cc:336] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
W20260709 12:13:45.812995 19713 leader_election.cc:336] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.813439 19713 leader_election.cc:304] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.814241 21041 raft_consensus.cc:2749] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.814596 21043 raft_consensus.cc:493] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:45.815271 21043 raft_consensus.cc:515] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:45.817929 21043 leader_election.cc:290] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
W20260709 12:13:45.825098 19715 leader_election.cc:336] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
W20260709 12:13:45.833089 19713 leader_election.cc:336] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:45.833694 19713 leader_election.cc:304] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:45.834578 21043 raft_consensus.cc:2749] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.852393 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:13:45.949090 10697 tablet_server.cc:179] TabletServer@127.10.114.68:0 shutting down...
I20260709 12:13:46.006176 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:46.006997 10697 tablet_replica.cc:333] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.007787 10697 raft_consensus.cc:2243] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.008400 10697 raft_consensus.cc:2272] T 247f50197bf344b88a8e8bea4eac96af P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.010928 10697 tablet_replica.cc:333] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.011713 10697 raft_consensus.cc:2243] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.012250 10697 raft_consensus.cc:2272] T e3e9c841139946a1a52d0c744d8be4ad P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.014644 10697 tablet_replica.cc:333] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.015318 10697 raft_consensus.cc:2243] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.015795 10697 raft_consensus.cc:2272] T 3762e9a9190d4cc78877b5e3c924edf1 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.018460 10697 tablet_replica.cc:333] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.019204 10697 raft_consensus.cc:2243] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.019698 10697 raft_consensus.cc:2272] T 7998edb98a1a43b78e23e41850537ec2 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.022106 10697 tablet_replica.cc:333] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.022771 10697 raft_consensus.cc:2243] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.023726 10697 raft_consensus.cc:2272] T 5bbdfddcaeb249b0a188ce6aa6240f1a P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.026154 10697 tablet_replica.cc:333] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.026822 10697 raft_consensus.cc:2243] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.027347 10697 raft_consensus.cc:2272] T c784ec6891b74c94b92d9c582a90b4ad P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.029819 10697 tablet_replica.cc:333] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.030479 10697 raft_consensus.cc:2243] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.031450 10697 raft_consensus.cc:2272] T ea8f0895419f44028178397e52ffe4ed P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.033838 10697 tablet_replica.cc:333] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.034538 10697 raft_consensus.cc:2243] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.035037 10697 raft_consensus.cc:2272] T a344ca7b35de49269ba122ad135ff08d P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.037299 10697 tablet_replica.cc:333] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.037930 10697 raft_consensus.cc:2243] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.038412 10697 raft_consensus.cc:2272] T ec016e46aa0b42909cc2783d5a41af25 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.040825 10697 tablet_replica.cc:333] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.041427 10697 raft_consensus.cc:2243] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.042348 10697 raft_consensus.cc:2272] T a652f7acae11499b8631edbb9126b6d4 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.044626 10697 tablet_replica.cc:333] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.045233 10697 raft_consensus.cc:2243] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.045754 10697 raft_consensus.cc:2272] T a881b97f3de4486698fd614567764d79 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.047874 10697 tablet_replica.cc:333] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.048482 10697 raft_consensus.cc:2243] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.048969 10697 raft_consensus.cc:2272] T 8f525b72ac964395b5d6eeb9d9056795 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.051175 10697 tablet_replica.cc:333] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.051770 10697 raft_consensus.cc:2243] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.052757 10697 raft_consensus.cc:2272] T af5924755bd54b58b1ffc3f0d229730b P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.055011 10697 tablet_replica.cc:333] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.055593 10697 raft_consensus.cc:2243] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.056497 10697 raft_consensus.cc:2272] T a908ea554d7e491cb92f45b6bea563fe P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.058893 10697 tablet_replica.cc:333] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.059424 10697 raft_consensus.cc:2243] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.059835 10697 raft_consensus.cc:2272] T 8399862a368c4cc485d207717c3e484f P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.061896 10697 tablet_replica.cc:333] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.062458 10697 raft_consensus.cc:2243] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.063002 21043 raft_consensus.cc:493] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fead653f118481bbe2fd33fc1357863)
I20260709 12:13:46.063591 10697 raft_consensus.cc:2272] T 66354051e3784a78b453ce8d710d547d P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.063617 21043 raft_consensus.cc:515] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df754e24c604440998ec5ed4153e9925" member_type: VOTER last_known_addr { host: "127.10.114.68" port: 40141 } } peers { permanent_uuid: "572e5980055c424db2e88348b978bd27" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 46269 } } peers { permanent_uuid: "3fead653f118481bbe2fd33fc1357863" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 45319 } }
I20260709 12:13:46.066268 21043 leader_election.cc:290] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269), 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319)
I20260709 12:13:46.066766 10697 tablet_replica.cc:333] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.067808 10697 raft_consensus.cc:2243] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.068409 10697 raft_consensus.cc:2272] T 0ca90458485a4134b58207db6d06437c P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:46.071071 19715 leader_election.cc:336] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 572e5980055c424db2e88348b978bd27 (127.10.114.65:46269): Network error: Client connection negotiation failed: client connection to 127.10.114.65:46269: connect: Connection refused (error 111)
I20260709 12:13:46.071751 10697 tablet_replica.cc:333] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.072736 10697 raft_consensus.cc:2243] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:46.072979 19713 leader_election.cc:336] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3fead653f118481bbe2fd33fc1357863 (127.10.114.66:45319): Network error: Client connection negotiation failed: client connection to 127.10.114.66:45319: connect: Connection refused (error 111)
I20260709 12:13:46.073359 10697 raft_consensus.cc:2272] T 5cb173ec27e04352b94a70d12816f13f P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.073458 19713 leader_election.cc:304] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df754e24c604440998ec5ed4153e9925; no voters: 3fead653f118481bbe2fd33fc1357863, 572e5980055c424db2e88348b978bd27
I20260709 12:13:46.074316 21041 raft_consensus.cc:2749] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.076670 10697 tablet_replica.cc:333] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.077699 10697 raft_consensus.cc:2243] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.078418 10697 raft_consensus.cc:2272] T 41f29b5fa12a4b79b10b5115c86d8915 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.081815 10697 tablet_replica.cc:333] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.082700 10697 raft_consensus.cc:2243] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.083317 10697 raft_consensus.cc:2272] T 41b302db5638420a9a5c34f1a2016ae7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.086396 10697 tablet_replica.cc:333] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.087208 10697 raft_consensus.cc:2243] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.087750 10697 raft_consensus.cc:2272] T 00dcab19c6084c678008d8f7f05a6247 P df754e24c604440998ec5ed4153e9925 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.090078 10697 tablet_replica.cc:333] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.090749 10697 raft_consensus.cc:2243] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.091233 10697 raft_consensus.cc:2272] T 73f7b8d5106e4679be8e8f50d28f2adc P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.093441 10697 tablet_replica.cc:333] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.094079 10697 raft_consensus.cc:2243] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.094974 10697 raft_consensus.cc:2272] T 8ff9f6251ac44db9b2768886ba30f320 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.097082 10697 tablet_replica.cc:333] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.097726 10697 raft_consensus.cc:2243] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.098233 10697 raft_consensus.cc:2272] T e853e43f31754497af8a31670524bf48 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.100231 10697 tablet_replica.cc:333] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.100804 10697 raft_consensus.cc:2243] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.101231 10697 raft_consensus.cc:2272] T a29a6ca896c346c288f2435cd3621579 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.103497 10697 tablet_replica.cc:333] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.104077 10697 raft_consensus.cc:2243] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.104635 10697 raft_consensus.cc:2272] T b07ebcb794f547e59406e697d62764da P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.107633 10697 tablet_replica.cc:333] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.108254 10697 raft_consensus.cc:2243] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.108815 10697 raft_consensus.cc:2272] T 07a0f8f7464e49748ac20bb80dde66b7 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.111071 10697 tablet_replica.cc:333] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.111712 10697 raft_consensus.cc:2243] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.112210 10697 raft_consensus.cc:2272] T bacfce93aefc4889a06015b277ff1b20 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.114455 10697 tablet_replica.cc:333] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.115064 10697 raft_consensus.cc:2243] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.115525 10697 raft_consensus.cc:2272] T f4b761cf2b4a4e1b94d77f416ca88f91 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.117667 10697 tablet_replica.cc:333] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.118286 10697 raft_consensus.cc:2243] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.119175 10697 raft_consensus.cc:2272] T 56dd21d8f0714b5e9855a7b741f56cf8 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.121281 10697 tablet_replica.cc:333] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.121925 10697 raft_consensus.cc:2243] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.122412 10697 raft_consensus.cc:2272] T 925588a0372f4594bbbffa180cc7ab38 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.124727 10697 tablet_replica.cc:333] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.125313 10697 raft_consensus.cc:2243] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.125846 10697 raft_consensus.cc:2272] T f4dcbe812aef4998990804a1ed2af372 P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.128005 10697 tablet_replica.cc:333] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.128566 10697 raft_consensus.cc:2243] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.129050 10697 raft_consensus.cc:2272] T 5d765db7288b4a1f86414e48476ffbab P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.131326 10697 tablet_replica.cc:333] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.131896 10697 raft_consensus.cc:2243] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.132403 10697 raft_consensus.cc:2272] T 9c322c0a8eff47689b5f8ce4ec0ff377 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.134567 10697 tablet_replica.cc:333] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.135145 10697 raft_consensus.cc:2243] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.136077 10697 raft_consensus.cc:2272] T 9d159542ccac45e9b41498d3b8d8855e P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.138302 10697 tablet_replica.cc:333] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.138857 10697 raft_consensus.cc:2243] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.139722 10697 raft_consensus.cc:2272] T d6697ba38fa643d2829f82139140437a P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.141841 10697 tablet_replica.cc:333] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.142377 10697 raft_consensus.cc:2243] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.143193 10697 raft_consensus.cc:2272] T fa021c2a57f94b72b6f4e27aadcb0d94 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.145172 10697 tablet_replica.cc:333] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.145721 10697 raft_consensus.cc:2243] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.146150 10697 raft_consensus.cc:2272] T da5953336e18402bac805e4d1e79cbfc P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.148154 10697 tablet_replica.cc:333] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.148705 10697 raft_consensus.cc:2243] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.149616 10697 raft_consensus.cc:2272] T 2ac728d3e6f7413194553b8493db9ad8 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.152477 10697 tablet_replica.cc:333] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.153108 10697 raft_consensus.cc:2243] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.153999 10697 raft_consensus.cc:2272] T 13720c08f1984c45a3a13db51fb4b552 P df754e24c604440998ec5ed4153e9925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.156225 10697 tablet_replica.cc:333] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.156777 10697 raft_consensus.cc:2243] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.157240 10697 raft_consensus.cc:2272] T dae9718b125b4fa8bffa5181c27d1e55 P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.159299 10697 tablet_replica.cc:333] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.159804 10697 raft_consensus.cc:2243] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.160257 10697 raft_consensus.cc:2272] T ea6702a791d14f5986fb8d9f62527a1b P df754e24c604440998ec5ed4153e9925 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.162308 10697 tablet_replica.cc:333] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.162798 10697 raft_consensus.cc:2243] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.163652 10697 raft_consensus.cc:2272] T d88a723a68914de697e0cfeecbe67feb P df754e24c604440998ec5ed4153e9925 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.165745 10697 tablet_replica.cc:333] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925: stopping tablet replica
I20260709 12:13:46.166230 10697 raft_consensus.cc:2243] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.167182 10697 raft_consensus.cc:2272] T 8aeb9c640288454589feb69100b7fc08 P df754e24c604440998ec5ed4153e9925 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.243800 10697 tablet_server.cc:196] TabletServer@127.10.114.68:0 shutdown complete.
I20260709 12:13:46.321645 10697 master.cc:562] Master@127.10.114.126:40525 shutting down...
I20260709 12:13:46.350526 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:46.351291 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.351657 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9e8bcb5182084eb8bb15313c92b4db2c: stopping tablet replica
I20260709 12:13:46.376039 10697 master.cc:584] Master@127.10.114.126:40525 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (41407 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:13:46.479537 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:41367
I20260709 12:13:46.480845 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.488184 21053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.488245 21054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.489720 21056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.491235 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:46.492528 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.492769 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.492944 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599226492918 us; error 0 us; skew 500 ppm
I20260709 12:13:46.493983 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.496893 10697 webserver.cc:533] Webserver started at http://127.10.114.126:40591/ using document root <none> and password file <none>
I20260709 12:13:46.497489 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.497830 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.498178 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.499673 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "a199a172d80c4ceca47db288e76df603"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.504994 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:46.509021 21061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.509933 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:46.510267 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "a199a172d80c4ceca47db288e76df603"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.510562 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.541297 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.542876 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.589008 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:41367
I20260709 12:13:46.589116 21112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:41367 every 8 connection(s)
I20260709 12:13:46.594002 21113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.607566 21113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603: Bootstrap starting.
I20260709 12:13:46.613615 21113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.618634 21113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603: No bootstrap required, opened a new log
I20260709 12:13:46.621258 21113 raft_consensus.cc:359] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER }
I20260709 12:13:46.621769 21113 raft_consensus.cc:385] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.621980 21113 raft_consensus.cc:740] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a199a172d80c4ceca47db288e76df603, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.622673 21113 consensus_queue.cc:260] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER }
I20260709 12:13:46.623257 21113 raft_consensus.cc:399] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:46.623474 21113 raft_consensus.cc:493] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:46.623697 21113 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.629072 21113 raft_consensus.cc:515] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER }
I20260709 12:13:46.629627 21113 leader_election.cc:304] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a199a172d80c4ceca47db288e76df603; no voters: 
I20260709 12:13:46.630882 21113 leader_election.cc:290] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:46.631388 21116 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.632946 21116 raft_consensus.cc:697] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 1 LEADER]: Becoming Leader. State: Replica: a199a172d80c4ceca47db288e76df603, State: Running, Role: LEADER
I20260709 12:13:46.633805 21116 consensus_queue.cc:237] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER }
I20260709 12:13:46.634279 21113 sys_catalog.cc:565] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:46.639695 21117 sys_catalog.cc:455] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a199a172d80c4ceca47db288e76df603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER } }
I20260709 12:13:46.639874 21118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a199a172d80c4ceca47db288e76df603. Latest consensus state: current_term: 1 leader_uuid: "a199a172d80c4ceca47db288e76df603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a199a172d80c4ceca47db288e76df603" member_type: VOTER } }
I20260709 12:13:46.640829 21117 sys_catalog.cc:458] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:46.640880 21118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:46.644294 21123 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:46.651110 21123 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:46.662056 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:46.666296 21123 catalog_manager.cc:1383] Generated new cluster ID: bf24b208c059448aa16d8013aa78d014
I20260709 12:13:46.666649 21123 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:46.697440 21123 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:46.699007 21123 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:46.716413 21123 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603: Generated new TSK 0
I20260709 12:13:46.717145 21123 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:46.730144 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.738302 21134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.739192 21135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.743554 10697 server_base.cc:1061] running on GCE node
W20260709 12:13:46.743664 21137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.746470 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.746762 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.746971 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599226746951 us; error 0 us; skew 500 ppm
I20260709 12:13:46.747663 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.750519 10697 webserver.cc:533] Webserver started at http://127.10.114.65:36185/ using document root <none> and password file <none>
I20260709 12:13:46.751072 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.751288 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.751590 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.752811 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "d36101652e8148879b06030d779a3d68"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.758314 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:46.762099 21142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.763021 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:46.763420 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "d36101652e8148879b06030d779a3d68"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.763844 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.778553 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.780251 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.782213 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.785034 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.785319 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.785625 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.785851 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.836488 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:43075
I20260709 12:13:46.836588 21204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:43075 every 8 connection(s)
I20260709 12:13:46.843047 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.851642 21209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.852499 21210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.856112 10697 server_base.cc:1061] running on GCE node
W20260709 12:13:46.857312 21213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.858865 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:13:46.859004 21205 heartbeater.cc:344] Connected to a master server at 127.10.114.126:41367
W20260709 12:13:46.859134 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.859587 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599226859564 us; error 0 us; skew 500 ppm
I20260709 12:13:46.859649 21205 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:46.860291 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.860842 21205 heartbeater.cc:507] Master 127.10.114.126:41367 requested a full tablet report, sending...
I20260709 12:13:46.863536 10697 webserver.cc:533] Webserver started at http://127.10.114.66:40569/ using document root <none> and password file <none>
I20260709 12:13:46.863672 21078 ts_manager.cc:194] Registered new tserver with Master: d36101652e8148879b06030d779a3d68 (127.10.114.65:43075)
I20260709 12:13:46.864348 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.864650 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.865000 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.866618 21078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51654
I20260709 12:13:46.866671 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "d27fda7d920b484eba05d94514d6c6df"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.872511 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:46.876682 21217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.877882 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:46.878252 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "d27fda7d920b484eba05d94514d6c6df"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.878611 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.901497 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.903076 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.904793 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.907575 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.907840 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.908105 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.908293 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.956966 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:37687
I20260709 12:13:46.957125 21279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:37687 every 8 connection(s)
I20260709 12:13:46.962581 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.971028 21283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.973055 21284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.975170 10697 server_base.cc:1061] running on GCE node
W20260709 12:13:46.975646 21286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.977003 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.977319 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.977533 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599226977510 us; error 0 us; skew 500 ppm
I20260709 12:13:46.977840 21280 heartbeater.cc:344] Connected to a master server at 127.10.114.126:41367
I20260709 12:13:46.978341 21280 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:46.978377 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.979447 21280 heartbeater.cc:507] Master 127.10.114.126:41367 requested a full tablet report, sending...
I20260709 12:13:46.981938 10697 webserver.cc:533] Webserver started at http://127.10.114.67:37781/ using document root <none> and password file <none>
I20260709 12:13:46.982415 21078 ts_manager.cc:194] Registered new tserver with Master: d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:46.982609 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.982964 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.983263 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.984266 21078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51662
I20260709 12:13:46.984642 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "899b84871ae84a1485cded8b8827b7d0"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.990345 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 12:13:46.994114 21291 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.995011 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:13:46.995342 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "899b84871ae84a1485cded8b8827b7d0"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:46.995676 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:47.008347 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:47.010627 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:47.012149 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:47.014847 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:47.015051 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:47.015241 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:47.015367 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:47.063390 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:33971
I20260709 12:13:47.063511 21353 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:33971 every 8 connection(s)
I20260709 12:13:47.080909 21354 heartbeater.cc:344] Connected to a master server at 127.10.114.126:41367
I20260709 12:13:47.081507 21354 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:47.082479 21354 heartbeater.cc:507] Master 127.10.114.126:41367 requested a full tablet report, sending...
I20260709 12:13:47.084935 21078 ts_manager.cc:194] Registered new tserver with Master: 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.085738 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018625284s
I20260709 12:13:47.087039 21078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51678
I20260709 12:13:47.118156 21078 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51684:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:47.121383 21078 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:47.216841 21245 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6150a9d73d40bca6763db1f2dcb240 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:47.217378 21244 tablet_service.cc:1511] Processing CreateTablet for tablet 924f517493ec449bac56d28369f24157 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:47.218724 21245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6150a9d73d40bca6763db1f2dcb240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.220829 21243 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0dbbf64b85485a967270e710ae5e7b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:47.222692 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0dbbf64b85485a967270e710ae5e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.227408 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f517493ec449bac56d28369f24157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.239588 21242 tablet_service.cc:1511] Processing CreateTablet for tablet eca3ae83ad0d41b59c0296197dc19e58 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:47.239800 21238 tablet_service.cc:1511] Processing CreateTablet for tablet d3655ae29ee54f9a87deda31393b72db (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:47.242290 21241 tablet_service.cc:1511] Processing CreateTablet for tablet bf42d33b4f6f46a58f20b7b19365383d (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:47.242853 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 450483839932413dbb8dc0cf982b8d46 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:47.244714 21240 tablet_service.cc:1511] Processing CreateTablet for tablet 2bba470733404d4fad26f271fa2ee589 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:47.247318 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2c1194f78040feb838fd5bf85a3d3b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:47.248631 21236 tablet_service.cc:1511] Processing CreateTablet for tablet fabef1ca03674313859a388bf094c10e (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:47.249486 21319 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6150a9d73d40bca6763db1f2dcb240 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:47.251350 21319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6150a9d73d40bca6763db1f2dcb240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.251019 21317 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0dbbf64b85485a967270e710ae5e7b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:47.252696 21317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0dbbf64b85485a967270e710ae5e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.253525 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3655ae29ee54f9a87deda31393b72db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.253968 21318 tablet_service.cc:1511] Processing CreateTablet for tablet 924f517493ec449bac56d28369f24157 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:47.255548 21318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f517493ec449bac56d28369f24157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.259855 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42d33b4f6f46a58f20b7b19365383d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.262185 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450483839932413dbb8dc0cf982b8d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.266294 21240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bba470733404d4fad26f271fa2ee589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.267256 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2c1194f78040feb838fd5bf85a3d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.267447 21313 tablet_service.cc:1511] Processing CreateTablet for tablet 450483839932413dbb8dc0cf982b8d46 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:47.268647 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabef1ca03674313859a388bf094c10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.269023 21314 tablet_service.cc:1511] Processing CreateTablet for tablet 2bba470733404d4fad26f271fa2ee589 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:47.266827 21315 tablet_service.cc:1511] Processing CreateTablet for tablet bf42d33b4f6f46a58f20b7b19365383d (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:47.270660 21316 tablet_service.cc:1511] Processing CreateTablet for tablet eca3ae83ad0d41b59c0296197dc19e58 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:47.276717 21310 tablet_service.cc:1511] Processing CreateTablet for tablet fabef1ca03674313859a388bf094c10e (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:47.269739 21242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca3ae83ad0d41b59c0296197dc19e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.269093 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450483839932413dbb8dc0cf982b8d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.287922 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6150a9d73d40bca6763db1f2dcb240 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:47.291702 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bba470733404d4fad26f271fa2ee589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.292263 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6150a9d73d40bca6763db1f2dcb240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.271940 21312 tablet_service.cc:1511] Processing CreateTablet for tablet d3655ae29ee54f9a87deda31393b72db (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:47.290000 21169 tablet_service.cc:1511] Processing CreateTablet for tablet 924f517493ec449bac56d28369f24157 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:47.274019 21311 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2c1194f78040feb838fd5bf85a3d3b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:47.294903 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924f517493ec449bac56d28369f24157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.293804 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabef1ca03674313859a388bf094c10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.295773 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2c1194f78040feb838fd5bf85a3d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.266345 21368 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.296530 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3655ae29ee54f9a87deda31393b72db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.305984 21316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca3ae83ad0d41b59c0296197dc19e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.309917 21315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42d33b4f6f46a58f20b7b19365383d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.315788 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0dbbf64b85485a967270e710ae5e7b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:47.317631 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0dbbf64b85485a967270e710ae5e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.317878 21368 tablet_bootstrap.cc:654] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.331733 21167 tablet_service.cc:1511] Processing CreateTablet for tablet eca3ae83ad0d41b59c0296197dc19e58 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:47.333478 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca3ae83ad0d41b59c0296197dc19e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.346943 21166 tablet_service.cc:1511] Processing CreateTablet for tablet bf42d33b4f6f46a58f20b7b19365383d (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:47.348702 21166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42d33b4f6f46a58f20b7b19365383d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.356356 21165 tablet_service.cc:1511] Processing CreateTablet for tablet 2bba470733404d4fad26f271fa2ee589 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:47.361125 21370 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:47.370589 21165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bba470733404d4fad26f271fa2ee589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.378031 21163 tablet_service.cc:1511] Processing CreateTablet for tablet d3655ae29ee54f9a87deda31393b72db (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:47.379801 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3655ae29ee54f9a87deda31393b72db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.386966 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 450483839932413dbb8dc0cf982b8d46 (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:47.388679 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450483839932413dbb8dc0cf982b8d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.399298 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2c1194f78040feb838fd5bf85a3d3b (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:47.401108 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2c1194f78040feb838fd5bf85a3d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.402812 21161 tablet_service.cc:1511] Processing CreateTablet for tablet fabef1ca03674313859a388bf094c10e (DEFAULT_TABLE table=test-workload [id=e271663f30cf4086829ba9bc2cdff57e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:47.404374 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabef1ca03674313859a388bf094c10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.369451 21370 tablet_bootstrap.cc:654] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.450821 21368 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.451440 21368 ts_tablet_manager.cc:1403] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.187s	user 0.036s	sys 0.058s
I20260709 12:13:47.454665 21368 raft_consensus.cc:359] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.455502 21368 raft_consensus.cc:385] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.455816 21368 raft_consensus.cc:740] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.456929 21368 consensus_queue.cc:260] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.462272 21372 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.463505 21370 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:47.464128 21370 ts_tablet_manager.cc:1403] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.012s
I20260709 12:13:47.467483 21370 raft_consensus.cc:359] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.468255 21370 raft_consensus.cc:385] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.468549 21370 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.471009 21370 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.484965 21372 tablet_bootstrap.cc:654] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.508468 21280 heartbeater.cc:499] Master 127.10.114.126:41367 was elected leader, sending a full tablet report...
I20260709 12:13:47.516290 21368 ts_tablet_manager.cc:1434] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.017s
I20260709 12:13:47.519503 21354 heartbeater.cc:499] Master 127.10.114.126:41367 was elected leader, sending a full tablet report...
I20260709 12:13:47.521100 21368 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.523358 21372 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:47.524016 21372 ts_tablet_manager.cc:1403] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.018s
I20260709 12:13:47.527601 21372 raft_consensus.cc:359] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.528497 21372 raft_consensus.cc:385] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.528818 21372 raft_consensus.cc:740] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.529874 21368 tablet_bootstrap.cc:654] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.529721 21372 consensus_queue.cc:260] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.516290 21370 ts_tablet_manager.cc:1434] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.052s	user 0.012s	sys 0.005s
I20260709 12:13:47.534341 21372 ts_tablet_manager.cc:1434] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:13:47.534698 21370 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:47.534814 21205 heartbeater.cc:499] Master 127.10.114.126:41367 was elected leader, sending a full tablet report...
I20260709 12:13:47.535542 21372 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.543493 21372 tablet_bootstrap.cc:654] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.543493 21370 tablet_bootstrap.cc:654] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.546380 21368 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.547098 21368 ts_tablet_manager.cc:1403] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.007s
I20260709 12:13:47.552119 21368 raft_consensus.cc:359] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.553488 21368 raft_consensus.cc:385] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.554044 21368 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.555581 21368 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.559727 21368 ts_tablet_manager.cc:1434] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:13:47.561403 21368 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
W20260709 12:13:47.568234 21355 tablet.cc:2406] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:47.574524 21368 tablet_bootstrap.cc:654] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.589956 21368 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.590850 21368 ts_tablet_manager.cc:1403] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.002s
I20260709 12:13:47.595629 21368 raft_consensus.cc:359] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.596798 21368 raft_consensus.cc:385] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.597203 21368 raft_consensus.cc:740] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.598603 21368 consensus_queue.cc:260] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.605741 21368 ts_tablet_manager.cc:1434] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:13:47.607425 21368 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.617092 21368 tablet_bootstrap.cc:654] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.632480 21368 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.633359 21368 ts_tablet_manager.cc:1403] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 12:13:47.638584 21368 raft_consensus.cc:359] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.639827 21368 raft_consensus.cc:385] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.640304 21368 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.641625 21368 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.642928 21372 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:47.643617 21372 ts_tablet_manager.cc:1403] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.108s	user 0.041s	sys 0.064s
I20260709 12:13:47.643896 21370 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:47.644224 21368 ts_tablet_manager.cc:1434] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:47.644529 21370 ts_tablet_manager.cc:1403] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.110s	user 0.041s	sys 0.060s
I20260709 12:13:47.645423 21368 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.646934 21372 raft_consensus.cc:359] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.647753 21372 raft_consensus.cc:385] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.648042 21372 raft_consensus.cc:740] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
W20260709 12:13:47.648303 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:47.648988 21372 consensus_queue.cc:260] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.649866 21373 raft_consensus.cc:493] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.650378 21373 raft_consensus.cc:515] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.651664 21372 ts_tablet_manager.cc:1434] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:47.651625 21370 raft_consensus.cc:359] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.652630 21370 raft_consensus.cc:385] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.652954 21372 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.652910 21370 raft_consensus.cc:740] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.653601 21368 tablet_bootstrap.cc:654] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.654047 21370 consensus_queue.cc:260] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.661286 21372 tablet_bootstrap.cc:654] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.668596 21373 leader_election.cc:290] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971), d36101652e8148879b06030d779a3d68 (127.10.114.65:43075)
I20260709 12:13:47.672032 21370 ts_tablet_manager.cc:1434] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.005s
I20260709 12:13:47.686254 21370 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:47.697238 21370 tablet_bootstrap.cc:654] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.711254 21370 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:47.712196 21370 ts_tablet_manager.cc:1403] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 12:13:47.715467 21370 raft_consensus.cc:359] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.716318 21370 raft_consensus.cc:385] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.716586 21372 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:47.716647 21370 raft_consensus.cc:740] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.718533 21368 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.717274 21372 ts_tablet_manager.cc:1403] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.033s
I20260709 12:13:47.719506 21368 ts_tablet_manager.cc:1403] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.074s	user 0.036s	sys 0.030s
I20260709 12:13:47.720800 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6150a9d73d40bca6763db1f2dcb240" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:47.718747 21370 consensus_queue.cc:260] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.721721 21329 raft_consensus.cc:2468] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:47.723227 21368 raft_consensus.cc:359] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.723799 21370 ts_tablet_manager.cc:1434] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:47.723501 21221 leader_election.cc:304] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:47.724102 21368 raft_consensus.cc:385] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.724442 21368 raft_consensus.cc:740] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.724772 21373 raft_consensus.cc:2804] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.725023 21370 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:47.725219 21373 raft_consensus.cc:493] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.725718 21373 raft_consensus.cc:3060] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.725266 21368 consensus_queue.cc:260] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.730808 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6150a9d73d40bca6763db1f2dcb240" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:47.731725 21180 raft_consensus.cc:2468] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:47.735354 21370 tablet_bootstrap.cc:654] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.738735 21372 raft_consensus.cc:359] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.739596 21372 raft_consensus.cc:385] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.739959 21372 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.740168 21373 raft_consensus.cc:515] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.741034 21372 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.743819 21372 ts_tablet_manager.cc:1434] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:13:47.744837 21372 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.745975 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6150a9d73d40bca6763db1f2dcb240" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:47.746652 21329 raft_consensus.cc:3060] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.748423 21375 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.748975 21375 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.751842 21375 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:47.761283 21372 tablet_bootstrap.cc:654] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.771970 21373 leader_election.cc:290] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Requested vote from peers 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971), d36101652e8148879b06030d779a3d68 (127.10.114.65:43075)
I20260709 12:13:47.773471 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6150a9d73d40bca6763db1f2dcb240" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:47.776558 21180 raft_consensus.cc:3060] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.786283 21180 raft_consensus.cc:2468] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:47.787787 21221 leader_election.cc:304] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:47.775172 21329 raft_consensus.cc:2468] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:47.775962 21372 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:47.789371 21372 ts_tablet_manager.cc:1403] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 12:13:47.794118 21372 raft_consensus.cc:359] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.795010 21372 raft_consensus.cc:385] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.795395 21372 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.796347 21372 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.800176 21372 ts_tablet_manager.cc:1434] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:47.802343 21372 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.803599 21376 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.804176 21376 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.812898 21376 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.797957 21373 raft_consensus.cc:2804] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.822852 21373 raft_consensus.cc:697] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:47.826556 21373 consensus_queue.cc:237] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:47.841439 21372 tablet_bootstrap.cc:654] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.849664 21368 ts_tablet_manager.cc:1434] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.130s	user 0.062s	sys 0.059s
I20260709 12:13:47.850147 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
W20260709 12:13:47.852092 21295 leader_election.cc:343] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.855756 21370 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:47.856518 21370 ts_tablet_manager.cc:1403] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.132s	user 0.045s	sys 0.065s
I20260709 12:13:47.861174 21370 raft_consensus.cc:359] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.861459 21255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:47.862046 21370 raft_consensus.cc:385] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.862416 21370 raft_consensus.cc:740] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.863516 21370 consensus_queue.cc:260] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.868520 21074 catalog_manager.cc:5697] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 0 to 1, leader changed from <none> to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 1 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.870133 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:47.870978 21254 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36101652e8148879b06030d779a3d68 in term 0.
I20260709 12:13:47.862351 21255 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:47.873322 21295 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: d36101652e8148879b06030d779a3d68
I20260709 12:13:47.874223 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:47.874727 21375 raft_consensus.cc:2804] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.875205 21375 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.862370 21368 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.875635 21375 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.876224 21146 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:47.877233 21376 raft_consensus.cc:2804] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.877635 21376 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.877996 21376 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:47.886109 21146 leader_election.cc:343] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.889997 21376 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.894060 21368 tablet_bootstrap.cc:654] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.894227 21255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:47.896627 21255 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.897198 21370 ts_tablet_manager.cc:1434] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 12:13:47.902443 21370 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:47.911798 21255 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36101652e8148879b06030d779a3d68 in term 1.
I20260709 12:13:47.913220 21398 raft_consensus.cc:493] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.913672 21146 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:47.914191 21398 raft_consensus.cc:515] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.888641 21375 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.918411 21400 raft_consensus.cc:493] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.921751 21376 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Requested vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.921964 21400 raft_consensus.cc:515] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.923991 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:47.925298 21375 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
W20260709 12:13:47.926074 21295 leader_election.cc:343] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.929826 21368 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:47.930449 21368 ts_tablet_manager.cc:1403] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.010s
I20260709 12:13:47.930517 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:47.931686 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450483839932413dbb8dc0cf982b8d46" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
W20260709 12:13:47.932276 21146 leader_election.cc:343] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.932607 21254 raft_consensus.cc:2468] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:47.934192 21400 leader_election.cc:290] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.934033 21368 raft_consensus.cc:359] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.934875 21368 raft_consensus.cc:385] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.935202 21368 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.935380 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450483839932413dbb8dc0cf982b8d46" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:47.936769 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:47.937104 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
W20260709 12:13:47.938113 21146 leader_election.cc:343] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:47.938488 21295 leader_election.cc:343] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:47.938881 21146 leader_election.cc:343] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.939244 21295 leader_election.cc:304] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: d36101652e8148879b06030d779a3d68
I20260709 12:13:47.939378 21146 leader_election.cc:304] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d36101652e8148879b06030d779a3d68; no voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:47.939785 21368 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.940639 21400 raft_consensus.cc:2749] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.941936 21375 raft_consensus.cc:2804] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.942325 21375 raft_consensus.cc:493] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.942390 21368 ts_tablet_manager.cc:1434] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:13:47.942736 21375 raft_consensus.cc:3060] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.943537 21368 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:47.951469 21368 tablet_bootstrap.cc:654] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.951764 21375 raft_consensus.cc:515] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.926548 21370 tablet_bootstrap.cc:654] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.920887 21372 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:47.927510 21255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:47.954031 21255 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.927901 21398 leader_election.cc:290] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:47.954118 21372 ts_tablet_manager.cc:1403] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.011s
I20260709 12:13:47.922425 21376 raft_consensus.cc:2804] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.957283 21376 raft_consensus.cc:697] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 LEADER]: Becoming Leader. State: Replica: d36101652e8148879b06030d779a3d68, State: Running, Role: LEADER
I20260709 12:13:47.959714 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450483839932413dbb8dc0cf982b8d46" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:47.958730 21376 consensus_queue.cc:237] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.960779 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450483839932413dbb8dc0cf982b8d46" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:47.964262 21254 raft_consensus.cc:3060] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.965698 21372 raft_consensus.cc:359] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
W20260709 12:13:47.967249 21295 leader_election.cc:343] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.967679 21372 raft_consensus.cc:385] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.968487 21372 raft_consensus.cc:740] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.969820 21372 consensus_queue.cc:260] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.971493 21255 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:47.972426 21373 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.973084 21295 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: d36101652e8148879b06030d779a3d68
I20260709 12:13:47.974630 21398 raft_consensus.cc:2804] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.972963 21373 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.975303 21398 raft_consensus.cc:697] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:47.965934 21400 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.977116 21398 consensus_queue.cc:237] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.978026 21400 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:47.978432 21373 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.978947 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:47.979645 21180 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:47.980522 21400 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:47.981081 21221 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:47.981778 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:47.982355 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:47.982926 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:47.983340 21253 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36101652e8148879b06030d779a3d68 in term 0.
W20260709 12:13:47.983584 21146 leader_election.cc:343] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.984481 21373 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:47.984655 21221 leader_election.cc:343] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.974954 21372 ts_tablet_manager.cc:1434] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:13:47.985175 21146 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:47.987515 21373 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.961313 21375 leader_election.cc:290] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:47.988708 21373 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.988718 21400 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.989367 21400 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.989817 21400 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.992348 21372 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:47.998108 21254 raft_consensus.cc:2468] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:47.999716 21295 leader_election.cc:304] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: d36101652e8148879b06030d779a3d68
I20260709 12:13:48.000670 21375 raft_consensus.cc:2804] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.001611 21375 raft_consensus.cc:697] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:48.001780 21372 tablet_bootstrap.cc:654] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.006927 21370 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.007258 21368 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:48.009835 21398 raft_consensus.cc:493] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.014640 21368 ts_tablet_manager.cc:1403] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.006s
I20260709 12:13:48.014520 21398 raft_consensus.cc:515] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.002885 21375 consensus_queue.cc:237] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.011241 21400 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.010646 21076 catalog_manager.cc:5697] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 reported cstate change: term changed from 0 to 1, leader changed from <none> to d36101652e8148879b06030d779a3d68 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "d36101652e8148879b06030d779a3d68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.017020 21370 ts_tablet_manager.cc:1403] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.009s
I20260709 12:13:48.017318 21398 leader_election.cc:290] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.008379 21074 catalog_manager.cc:5697] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.020788 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.018903 21400 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Requested vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.023221 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.021389 21368 raft_consensus.cc:359] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.023924 21180 raft_consensus.cc:2468] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:48.024034 21368 raft_consensus.cc:385] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.023967 21255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.024644 21368 raft_consensus.cc:740] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.022933 21373 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.025803 21295 leader_election.cc:304] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.027711 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.028751 21180 raft_consensus.cc:2393] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d27fda7d920b484eba05d94514d6c6df in current term 1: Already voted for candidate d36101652e8148879b06030d779a3d68 in this term.
I20260709 12:13:48.028884 21398 raft_consensus.cc:2804] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.029331 21398 raft_consensus.cc:493] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:48.027153 21146 leader_election.cc:343] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.025748 21368 consensus_queue.cc:260] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.029726 21398 raft_consensus.cc:3060] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.030490 21400 raft_consensus.cc:493] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.031020 21400 raft_consensus.cc:515] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.031843 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.034317 21400 leader_election.cc:290] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.036248 21255 raft_consensus.cc:2468] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:48.043394 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:48.039265 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:48.041939 21370 raft_consensus.cc:359] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.045485 21254 raft_consensus.cc:2393] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d36101652e8148879b06030d779a3d68 in current term 1: Already voted for candidate d27fda7d920b484eba05d94514d6c6df in this term.
I20260709 12:13:48.045748 21370 raft_consensus.cc:385] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.046140 21370 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.026912 21373 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.036609 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.048442 21253 raft_consensus.cc:2468] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36101652e8148879b06030d779a3d68 in term 0.
W20260709 12:13:48.052237 21221 leader_election.cc:343] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.052840 21221 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df; no voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68
I20260709 12:13:48.053416 21146 leader_election.cc:304] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.054366 21373 raft_consensus.cc:2749] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.054504 21400 raft_consensus.cc:2804] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.055084 21400 raft_consensus.cc:493] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.058200 21368 ts_tablet_manager.cc:1434] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.004s
I20260709 12:13:48.047046 21370 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.048416 21372 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:48.059823 21368 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:48.060871 21372 ts_tablet_manager.cc:1403] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.009s
I20260709 12:13:48.067075 21398 raft_consensus.cc:515] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.068903 21328 raft_consensus.cc:2393] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d36101652e8148879b06030d779a3d68 in current term 1: Already voted for candidate 899b84871ae84a1485cded8b8827b7d0 in this term.
I20260709 12:13:48.069305 21146 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d36101652e8148879b06030d779a3d68; no voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:48.070333 21398 leader_election.cc:290] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.055714 21400 raft_consensus.cc:3060] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.070346 21376 raft_consensus.cc:2749] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.061969 21370 ts_tablet_manager.cc:1434] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.003s
I20260709 12:13:48.073523 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.074054 21370 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:48.075179 21368 tablet_bootstrap.cc:654] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.075598 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:48.076320 21254 raft_consensus.cc:3060] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.082104 21370 tablet_bootstrap.cc:654] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.079102 21372 raft_consensus.cc:359] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.087502 21372 raft_consensus.cc:385] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.091985 21372 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.095340 21370 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.096015 21370 ts_tablet_manager.cc:1403] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 12:13:48.099800 21370 raft_consensus.cc:359] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.100587 21370 raft_consensus.cc:385] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.100909 21370 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.102279 21370 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.102664 21254 raft_consensus.cc:2468] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:48.100901 21372 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.104799 21370 ts_tablet_manager.cc:1434] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.007s
I20260709 12:13:48.104657 21295 leader_election.cc:304] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:48.106086 21370 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:48.106480 21398 raft_consensus.cc:2804] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.107282 21398 raft_consensus.cc:697] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:48.108505 21398 consensus_queue.cc:237] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.114372 21370 tablet_bootstrap.cc:654] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.115108 21076 catalog_manager.cc:5697] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.116532 21372 ts_tablet_manager.cc:1434] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 12:13:48.120378 21368 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:48.120970 21368 ts_tablet_manager.cc:1403] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.020s
I20260709 12:13:48.124308 21368 raft_consensus.cc:359] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.125100 21368 raft_consensus.cc:385] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.125387 21368 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.126348 21368 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.128221 21368 ts_tablet_manager.cc:1434] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:48.129189 21368 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:48.136608 21368 tablet_bootstrap.cc:654] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.117571 21400 raft_consensus.cc:515] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.137840 21180 raft_consensus.cc:2393] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 899b84871ae84a1485cded8b8827b7d0 in current term 1: Already voted for candidate d36101652e8148879b06030d779a3d68 in this term.
I20260709 12:13:48.142021 21372 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:48.150521 21400 leader_election.cc:290] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Requested vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.151692 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.157076 21372 tablet_bootstrap.cc:654] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.159241 21076 catalog_manager.cc:5697] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.161399 21370 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.161376 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3655ae29ee54f9a87deda31393b72db" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:48.162274 21370 ts_tablet_manager.cc:1403] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.026s
I20260709 12:13:48.162492 21254 raft_consensus.cc:2393] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d36101652e8148879b06030d779a3d68 in current term 1: Already voted for candidate 899b84871ae84a1485cded8b8827b7d0 in this term.
I20260709 12:13:48.164000 21146 leader_election.cc:304] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d36101652e8148879b06030d779a3d68; no voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:48.165432 21400 raft_consensus.cc:2749] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.165870 21370 raft_consensus.cc:359] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.166689 21370 raft_consensus.cc:385] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.166986 21370 raft_consensus.cc:740] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.167770 21370 consensus_queue.cc:260] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.169775 21370 ts_tablet_manager.cc:1434] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:13:48.170934 21370 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:48.174337 21372 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:48.175262 21372 ts_tablet_manager.cc:1403] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.012s
I20260709 12:13:48.178285 21370 tablet_bootstrap.cc:654] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.179380 21400 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.180452 21372 raft_consensus.cc:359] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.181772 21372 raft_consensus.cc:385] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.180007 21400 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.182260 21372 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.183782 21372 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.188431 21400 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.189213 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:48.189558 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d36101652e8148879b06030d779a3d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.190505 21254 raft_consensus.cc:2393] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d36101652e8148879b06030d779a3d68 in current term 1: Already voted for candidate 899b84871ae84a1485cded8b8827b7d0 in this term.
I20260709 12:13:48.191648 21146 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d36101652e8148879b06030d779a3d68; no voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:48.192900 21400 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.193622 21398 raft_consensus.cc:493] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.194167 21398 raft_consensus.cc:515] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.201344 21370 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.201649 21372 ts_tablet_manager.cc:1434] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:13:48.202042 21370 ts_tablet_manager.cc:1403] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.004s
I20260709 12:13:48.203022 21372 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:48.202857 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.203637 21180 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:48.205451 21295 leader_election.cc:304] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.206429 21375 raft_consensus.cc:2804] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.206782 21375 raft_consensus.cc:493] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.207119 21375 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.209720 21368 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:48.210337 21368 ts_tablet_manager.cc:1403] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.047s
I20260709 12:13:48.205265 21370 raft_consensus.cc:359] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.214282 21370 raft_consensus.cc:385] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.214617 21370 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.213807 21368 raft_consensus.cc:359] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.215909 21368 raft_consensus.cc:385] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.216229 21368 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.216779 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.217119 21368 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.219285 21254 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 0.
I20260709 12:13:48.220263 21368 ts_tablet_manager.cc:1434] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:48.217602 21370 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.213245 21400 raft_consensus.cc:2749] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.218695 21398 leader_election.cc:290] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.226671 21368 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: Bootstrap starting.
I20260709 12:13:48.222396 21370 ts_tablet_manager.cc:1434] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:13:48.222115 21375 raft_consensus.cc:515] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.231122 21370 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:48.232756 21375 leader_election.cc:290] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.234086 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.234949 21180 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.224946 21403 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.237325 21403 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.238596 21370 tablet_bootstrap.cc:654] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.239990 21368 tablet_bootstrap.cc:654] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.240082 21403 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.241106 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.242179 21179 raft_consensus.cc:2393] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899b84871ae84a1485cded8b8827b7d0 in current term 1: Already voted for candidate d36101652e8148879b06030d779a3d68 in this term.
I20260709 12:13:48.245851 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.247085 21253 raft_consensus.cc:2393] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899b84871ae84a1485cded8b8827b7d0 in current term 1: Already voted for candidate d27fda7d920b484eba05d94514d6c6df in this term.
I20260709 12:13:48.249141 21295 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0; no voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68
I20260709 12:13:48.251019 21403 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.234210 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:48.258080 21254 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.270982 21180 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:48.279254 21372 tablet_bootstrap.cc:654] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.282995 21370 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.283582 21295 leader_election.cc:304] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.283849 21368 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: No bootstrap required, opened a new log
I20260709 12:13:48.283658 21370 ts_tablet_manager.cc:1403] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.024s
I20260709 12:13:48.284612 21368 ts_tablet_manager.cc:1403] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.019s
I20260709 12:13:48.284755 21375 raft_consensus.cc:2804] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.285358 21375 raft_consensus.cc:697] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:48.286348 21375 consensus_queue.cc:237] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.287966 21368 raft_consensus.cc:359] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.287771 21370 raft_consensus.cc:359] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.288851 21368 raft_consensus.cc:385] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.289001 21370 raft_consensus.cc:385] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.289247 21368 raft_consensus.cc:740] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.289572 21370 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.290252 21368 consensus_queue.cc:260] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.290858 21370 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.292682 21368 ts_tablet_manager.cc:1434] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:48.294203 21370 ts_tablet_manager.cc:1434] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:48.295755 21370 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: Bootstrap starting.
I20260709 12:13:48.288021 21254 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:48.302237 21403 raft_consensus.cc:2749] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.303342 21372 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:48.303927 21372 ts_tablet_manager.cc:1403] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.009s
I20260709 12:13:48.307137 21370 tablet_bootstrap.cc:654] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.307202 21372 raft_consensus.cc:359] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.308204 21372 raft_consensus.cc:385] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.308543 21372 raft_consensus.cc:740] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.308365 21373 consensus_queue.cc:1048] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.309417 21372 consensus_queue.cc:260] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.309970 21076 catalog_manager.cc:5697] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.317983 21372 ts_tablet_manager.cc:1434] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:13:48.319599 21372 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:48.327668 21370 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: No bootstrap required, opened a new log
I20260709 12:13:48.328478 21370 ts_tablet_manager.cc:1403] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.010s
I20260709 12:13:48.332053 21370 raft_consensus.cc:359] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.332839 21370 raft_consensus.cc:385] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.333159 21370 raft_consensus.cc:740] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.334179 21370 consensus_queue.cc:260] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.336258 21373 consensus_queue.cc:1048] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.336654 21370 ts_tablet_manager.cc:1434] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:48.337472 21372 tablet_bootstrap.cc:654] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.375202 21373 raft_consensus.cc:493] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.375785 21373 raft_consensus.cc:515] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.377110 21372 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:48.378060 21372 ts_tablet_manager.cc:1403] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.023s
I20260709 12:13:48.378109 21373 leader_election.cc:290] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.379447 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:48.379940 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.380519 21328 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:48.381932 21221 leader_election.cc:304] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:48.382737 21373 raft_consensus.cc:2804] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:48.382869 21221 leader_election.cc:343] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.383488 21373 raft_consensus.cc:493] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.383941 21373 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.382431 21372 raft_consensus.cc:359] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.385403 21372 raft_consensus.cc:385] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.385704 21431 raft_consensus.cc:493] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.385747 21372 raft_consensus.cc:740] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.386487 21431 raft_consensus.cc:515] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.386966 21372 consensus_queue.cc:260] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.389303 21372 ts_tablet_manager.cc:1434] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:48.389765 21431 leader_election.cc:290] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.390559 21372 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:48.393499 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:48.394366 21329 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:48.394764 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.395468 21180 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:48.396816 21221 leader_election.cc:304] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.397710 21372 tablet_bootstrap.cc:654] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.399052 21431 raft_consensus.cc:2804] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.399515 21431 raft_consensus.cc:493] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.399911 21431 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.404778 21372 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: No bootstrap required, opened a new log
I20260709 12:13:48.405393 21372 ts_tablet_manager.cc:1403] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:13:48.407944 21431 raft_consensus.cc:515] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.408581 21372 raft_consensus.cc:359] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.409374 21372 raft_consensus.cc:385] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.409683 21372 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.410421 21372 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.411304 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.411947 21180 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.412230 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.412783 21372 ts_tablet_manager.cc:1434] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:48.412870 21329 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.421936 21329 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.422816 21431 leader_election.cc:290] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.423877 21221 leader_election.cc:304] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:48.424157 21180 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.424860 21431 raft_consensus.cc:2804] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.425379 21431 raft_consensus.cc:697] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:48.426350 21431 consensus_queue.cc:237] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.426728 21373 raft_consensus.cc:515] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.427626 21403 consensus_queue.cc:1048] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.429339 21373 leader_election.cc:290] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.430163 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.431557 21179 raft_consensus.cc:3060] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.426808 21375 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:13:48.437282 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.438119 21329 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.438371 21074 catalog_manager.cc:5697] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 0 to 1, leader changed from <none> to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 1 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.446879 21329 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.448349 21221 leader_election.cc:304] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:48.449234 21373 raft_consensus.cc:2804] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.449772 21373 raft_consensus.cc:697] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:48.450688 21373 consensus_queue.cc:237] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.454756 21375 consensus_queue.cc:1048] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.430891 21180 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.471762 21180 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.485754 21373 raft_consensus.cc:493] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.486357 21373 raft_consensus.cc:515] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.486913 21419 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.489717 21373 leader_election.cc:290] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.489246 21074 catalog_manager.cc:5697] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 0 to 1, leader changed from <none> to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 1 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.490911 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.491448 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:48.491686 21178 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:48.492199 21329 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 0.
I20260709 12:13:48.493649 21221 leader_election.cc:304] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:48.495636 21373 raft_consensus.cc:2804] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.496145 21373 raft_consensus.cc:493] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.496588 21373 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.505944 21373 raft_consensus.cc:515] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.509663 21373 leader_election.cc:290] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:48.510335 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:48.511071 21329 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.509053 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:48.513981 21180 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.514714 21419 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.515343 21419 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.517961 21419 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:48.519712 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:48.521214 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:48.522145 21253 raft_consensus.cc:2393] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899b84871ae84a1485cded8b8827b7d0 in current term 1: Already voted for candidate d36101652e8148879b06030d779a3d68 in this term.
I20260709 12:13:48.523134 21180 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.524761 21376 consensus_queue.cc:1048] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.525136 21295 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0; no voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68
I20260709 12:13:48.526073 21328 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.523860 21329 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:48.526633 21221 leader_election.cc:304] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:48.527580 21373 raft_consensus.cc:2804] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.527971 21373 raft_consensus.cc:697] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:48.528761 21373 consensus_queue.cc:237] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:48.536429 21419 raft_consensus.cc:2749] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.537205 21076 catalog_manager.cc:5697] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 0 to 1, leader changed from <none> to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 1 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.539312 21400 consensus_queue.cc:1048] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.636044 21419 consensus_queue.cc:1048] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.648026 21403 consensus_queue.cc:1048] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:48.652858 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:48.806768 21403 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.816573 21375 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.880797 21431 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.893136 21431 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.978155 21431 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.992091 21373 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.018008 21373 consensus_queue.cc:1048] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.030139 21433 consensus_queue.cc:1048] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:49.656364 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:49.666417 21432 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.667131 21432 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:49.669107 21432 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:49.670213 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68" is_pre_election: true
I20260709 12:13:49.670375 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
I20260709 12:13:49.670995 21178 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:49.671110 21328 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 1.
I20260709 12:13:49.672472 21221 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:49.673367 21432 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:49.673816 21432 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.674199 21432 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.680953 21432 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:49.683069 21432 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:49.684212 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:49.684427 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:49.684875 21178 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.685135 21328 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.691635 21328 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:49.691679 21178 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:49.693077 21221 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:49.693871 21432 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:49.694461 21432 raft_consensus.cc:697] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:49.695528 21432 consensus_queue.cc:237] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:49.704825 21078 catalog_manager.cc:5697] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 0 to 2, leader changed from <none> to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 2 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.094178 10697 ts_manager.cc:295] Set tserver state for d36101652e8148879b06030d779a3d68 to MAINTENANCE_MODE
I20260709 12:13:50.095134 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
I20260709 12:13:50.125420 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:50.126374 10697 tablet_replica.cc:333] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.127254 10697 raft_consensus.cc:2243] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.127769 10697 raft_consensus.cc:2272] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.130110 10697 tablet_replica.cc:333] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.130674 10697 raft_consensus.cc:2243] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.131067 10697 raft_consensus.cc:2272] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.133112 10697 tablet_replica.cc:333] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.133720 10697 raft_consensus.cc:2243] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.134107 10697 raft_consensus.cc:2272] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.136116 10697 tablet_replica.cc:333] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.136685 10697 raft_consensus.cc:2243] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.137060 10697 raft_consensus.cc:2272] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.139034 10697 tablet_replica.cc:333] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.139539 10697 raft_consensus.cc:2243] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.139874 10697 raft_consensus.cc:2272] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.141707 10697 tablet_replica.cc:333] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.142222 10697 raft_consensus.cc:2243] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.142577 10697 raft_consensus.cc:2272] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.144532 10697 tablet_replica.cc:333] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.145217 10697 raft_consensus.cc:2243] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.145797 10697 raft_consensus.cc:2272] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.146633 21221 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 190 similar messages]
I20260709 12:13:50.148288 10697 tablet_replica.cc:333] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.149150 10697 raft_consensus.cc:2243] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.149643 10697 raft_consensus.cc:2272] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.150013 21221 consensus_peers.cc:597] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.151795 10697 tablet_replica.cc:333] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.152365 10697 raft_consensus.cc:2243] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.153173 10697 raft_consensus.cc:2272] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.155153 10697 tablet_replica.cc:333] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: stopping tablet replica
I20260709 12:13:50.155581 10697 raft_consensus.cc:2243] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.155962 10697 raft_consensus.cc:2272] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.188535 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
I20260709 12:13:50.246536 21328 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:50.248353 21432 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:50.380693 21221 consensus_peers.cc:597] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.420686 21295 consensus_peers.cc:597] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.426865 21221 consensus_peers.cc:597] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.434962 21295 consensus_peers.cc:597] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.451521 21350 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdf40 after lost signal to thread 10700
W20260709 12:13:50.453178 21350 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef740 after lost signal to thread 21112
W20260709 12:13:50.455367 21350 debug-util.cc:398] Leaking SignalData structure 0x7b08002d92a0 after lost signal to thread 21279
W20260709 12:13:50.456465 21350 debug-util.cc:398] Leaking SignalData structure 0x7b08000b52e0 after lost signal to thread 21353
W20260709 12:13:50.493865 21221 consensus_peers.cc:597] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.500510 21295 consensus_peers.cc:597] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.593488 21221 consensus_peers.cc:597] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.625188 21295 consensus_peers.cc:597] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.657652 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:51.249840 21468 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d36101652e8148879b06030d779a3d68)
I20260709 12:13:51.250638 21468 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:51.252946 21468 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:51.254423 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899b84871ae84a1485cded8b8827b7d0" is_pre_election: true
W20260709 12:13:51.257077 21221 leader_election.cc:336] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111)
I20260709 12:13:51.257709 21221 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df; no voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68
I20260709 12:13:51.258599 21468 raft_consensus.cc:2749] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.606815 21375 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d36101652e8148879b06030d779a3d68)
I20260709 12:13:51.607437 21375 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:51.609508 21375 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:51.611281 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df" is_pre_election: true
I20260709 12:13:51.612116 21254 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 1.
I20260709 12:13:51.613647 21295 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:51.614527 21375 raft_consensus.cc:2804] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:51.614919 21375 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d36101652e8148879b06030d779a3d68)
W20260709 12:13:51.615082 21295 leader_election.cc:336] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111)
I20260709 12:13:51.615396 21375 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.622021 21375 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:51.624035 21375 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:51.625751 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:51.626354 21254 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.632139 21254 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:51.635082 21295 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:51.636044 21375 raft_consensus.cc:2804] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:51.636672 21375 raft_consensus.cc:697] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:51.637624 21375 consensus_queue.cc:237] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
W20260709 12:13:51.641252 21295 leader_election.cc:336] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111)
I20260709 12:13:51.646955 21076 catalog_manager.cc:5697] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 1 to 2, leader changed from d36101652e8148879b06030d779a3d68 (127.10.114.65) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:51.658753 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:52.044502 21295 consensus_peers.cc:597] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:52.082070 21254 raft_consensus.cc:1275] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:52.083855 21375 consensus_queue.cc:1048] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:52.594246 21221 consensus_peers.cc:597] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.659924 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:52.687649 21221 consensus_peers.cc:597] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.718442 21295 consensus_peers.cc:597] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.798563 21221 consensus_peers.cc:597] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.888336 21221 consensus_peers.cc:597] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.906948 21295 consensus_peers.cc:597] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.144517 21221 consensus_peers.cc:597] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.152694 21295 consensus_peers.cc:597] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.276386 21295 consensus_peers.cc:597] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.661139 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:54.662456 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:54.669360 21295 consensus_peers.cc:597] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:55.006664 21221 consensus_peers.cc:597] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:55.139755 21221 consensus_peers.cc:597] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.219717 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:55.228487 21483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:55.228942 21482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:55.230253 21485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:55.232978 10697 server_base.cc:1061] running on GCE node
I20260709 12:13:55.235165 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:55.235427 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:55.235643 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599235235617 us; error 0 us; skew 500 ppm
I20260709 12:13:55.236347 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:55.240310 10697 webserver.cc:533] Webserver started at http://127.10.114.65:36185/ using document root <none> and password file <none>
I20260709 12:13:55.241129 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:55.241438 10697 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:55.248507 10697 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:55.254230 21490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:55.255093 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:13:55.255440 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "d36101652e8148879b06030d779a3d68"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-08l4"
I20260709 12:13:55.255934 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:13:55.270920 21295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111) [suppressed 98 similar messages]
I20260709 12:13:55.291446 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 12:13:55.292145 21295 consensus_peers.cc:597] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.293327 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:55.295257 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:55.299665 21497 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:13:55.310040 21221 consensus_peers.cc:597] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:55.321250 21221 consensus_peers.cc:597] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.358352 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:13:55.358901 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:13:55.359323 10697 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:13:55.367430 21497 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.387421 21497 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.388530 21497 tablet_bootstrap.cc:492] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.389276 21497 ts_tablet_manager.cc:1403] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.015s
I20260709 12:13:55.392827 21497 raft_consensus.cc:359] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.394030 21497 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.394907 21497 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.398325 21497 ts_tablet_manager.cc:1434] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:13:55.399266 21497 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.418241 21497 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.419334 21497 tablet_bootstrap.cc:492] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.420087 21497 ts_tablet_manager.cc:1403] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:13:55.423275 21497 raft_consensus.cc:359] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.424109 21497 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.424995 21497 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.427274 21497 ts_tablet_manager.cc:1434] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:13:55.428174 21497 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
W20260709 12:13:55.428637 21221 consensus_peers.cc:597] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.435938 10697 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:13:55.436450 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.077s	user 0.059s	sys 0.016s
I20260709 12:13:55.448278 21497 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.449820 21497 tablet_bootstrap.cc:492] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.451004 21497 ts_tablet_manager.cc:1403] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:13:55.455145 21497 raft_consensus.cc:359] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.456244 21497 raft_consensus.cc:740] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.457466 21497 consensus_queue.cc:260] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.460707 21497 ts_tablet_manager.cc:1434] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:55.461797 21497 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.484612 21497 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.485523 21497 tablet_bootstrap.cc:492] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.486231 21497 ts_tablet_manager.cc:1403] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 12:13:55.488746 21497 raft_consensus.cc:359] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.489516 21497 raft_consensus.cc:740] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.490324 21497 consensus_queue.cc:260] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.492669 21497 ts_tablet_manager.cc:1434] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:13:55.493636 21497 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.509675 21497 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.510547 21497 tablet_bootstrap.cc:492] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.511035 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:43075
I20260709 12:13:55.511143 21497 ts_tablet_manager.cc:1403] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:13:55.511186 21559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:43075 every 8 connection(s)
I20260709 12:13:55.514532 21497 raft_consensus.cc:359] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.515098 21497 raft_consensus.cc:740] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.515866 21497 consensus_queue.cc:260] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.517746 21497 ts_tablet_manager.cc:1434] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:13:55.518822 21497 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.519424 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:55.541147 21497 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.542479 21497 tablet_bootstrap.cc:492] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.543226 21560 heartbeater.cc:344] Connected to a master server at 127.10.114.126:41367
I20260709 12:13:55.543296 21497 ts_tablet_manager.cc:1403] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:13:55.544034 21560 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:55.545177 21560 heartbeater.cc:507] Master 127.10.114.126:41367 requested a full tablet report, sending...
I20260709 12:13:55.546592 21497 raft_consensus.cc:359] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.547189 21497 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.547992 21497 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.550704 21497 ts_tablet_manager.cc:1434] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:55.551759 21497 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.553138 21076 ts_manager.cc:194] Re-registered known tserver with Master: d36101652e8148879b06030d779a3d68 (127.10.114.65:43075)
I20260709 12:13:55.557199 21253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:55.558326 21253 raft_consensus.cc:606] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:55.567968 21076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32954
I20260709 12:13:55.575726 21560 heartbeater.cc:499] Master 127.10.114.126:41367 was elected leader, sending a full tablet report...
I20260709 12:13:55.575449 21497 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.577162 21497 tablet_bootstrap.cc:492] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.577953 21497 ts_tablet_manager.cc:1403] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 12:13:55.581708 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:55.581632 21497 raft_consensus.cc:359] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:55.582854 21329 raft_consensus.cc:606] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:55.583249 21497 raft_consensus.cc:740] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.584280 21497 consensus_queue.cc:260] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } } peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } }
I20260709 12:13:55.586519 21253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:55.587349 21253 raft_consensus.cc:606] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:55.587565 21497 ts_tablet_manager.cc:1434] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:55.588908 21497 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.589362 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:55.590370 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:55.591431 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:55.608117 21497 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.609179 21497 tablet_bootstrap.cc:492] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.609900 21497 ts_tablet_manager.cc:1403] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:13:55.612481 21497 raft_consensus.cc:359] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.613251 21497 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.614064 21497 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.615849 21497 ts_tablet_manager.cc:1434] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:55.616914 21497 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.629210 21497 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.630064 21497 tablet_bootstrap.cc:492] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.630694 21497 ts_tablet_manager.cc:1403] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:13:55.632795 21497 raft_consensus.cc:359] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.633328 21497 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.634110 21497 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.636212 21497 ts_tablet_manager.cc:1434] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:55.637269 21497 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Bootstrap starting.
I20260709 12:13:55.653184 21497 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.654084 21497 tablet_bootstrap.cc:492] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Bootstrap complete.
I20260709 12:13:55.654808 21497 ts_tablet_manager.cc:1403] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:13:55.656970 21497 raft_consensus.cc:359] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.657505 21497 raft_consensus.cc:740] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36101652e8148879b06030d779a3d68, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.658252 21497 consensus_queue.cc:260] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.660367 21497 ts_tablet_manager.cc:1434] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 12:13:55.663710 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:55.860983 21468 raft_consensus.cc:993] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:55.862362 21573 raft_consensus.cc:1081] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:55.864297 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:55.865000 21329 raft_consensus.cc:493] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:55.865427 21329 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.867954 21574 raft_consensus.cc:993] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:55.868690 21573 raft_consensus.cc:1081] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:55.871155 21328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:55.871754 21328 raft_consensus.cc:493] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:55.872160 21328 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.875335 21329 raft_consensus.cc:515] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.877666 21329 leader_election.cc:290] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:55.878674 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:55.878965 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:55.879626 21533 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.879690 21253 raft_consensus.cc:3055] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:55.880379 21253 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:55.881284 21328 raft_consensus.cc:515] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.881644 21253 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.883642 21253 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.885417 21328 leader_election.cc:290] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:55.887676 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:55.888378 21532 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.888319 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:55.889175 21254 raft_consensus.cc:3055] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:55.889504 21254 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:55.890633 21254 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.893850 21254 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.896283 21253 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:55.897984 21295 leader_election.cc:304] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: 
I20260709 12:13:55.899056 21470 raft_consensus.cc:2804] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:55.899542 21532 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:55.901350 21533 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:55.901515 21295 leader_election.cc:304] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:55.902676 21254 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:55.903258 21470 raft_consensus.cc:697] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:55.903944 21575 raft_consensus.cc:2804] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:55.904655 21575 raft_consensus.cc:697] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:55.904628 21470 consensus_queue.cc:237] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.905983 21575 consensus_queue.cc:237] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.914880 21532 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.913998 21076 catalog_manager.cc:5697] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 1 to 2, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.937292 21078 catalog_manager.cc:5697] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 1 to 2, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.983398 21470 raft_consensus.cc:993] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:55.983933 21575 raft_consensus.cc:1081] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:55.985630 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:55.986132 21254 raft_consensus.cc:493] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:55.986392 21254 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.992733 21254 raft_consensus.cc:515] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.994535 21254 leader_election.cc:290] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:55.995445 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:55.995666 21328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:55.996330 21532 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.996443 21328 raft_consensus.cc:3055] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:55.996893 21328 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:55.997815 21328 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:55.999043 21328 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.004094 21532 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:56.005112 21328 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:56.005868 21221 leader_election.cc:304] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:56.006901 21574 raft_consensus.cc:2804] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.007423 21574 raft_consensus.cc:697] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:56.008562 21574 consensus_queue.cc:237] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.016245 21078 catalog_manager.cc:5697] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 1 to 2, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 2 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.299710 21532 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.301275 21575 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:56.314575 21254 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.316769 21576 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.372730 21532 raft_consensus.cc:1275] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.374231 21576 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.386343 21254 raft_consensus.cc:1275] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.387852 21576 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.449066 21329 raft_consensus.cc:1275] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.450493 21574 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.461277 21532 raft_consensus.cc:1275] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.463110 21574 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.604247 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.612507 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:56.613191 21329 raft_consensus.cc:606] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:56.616189 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:56.616746 21254 raft_consensus.cc:606] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:56.619448 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:56.620010 21329 raft_consensus.cc:606] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:56.621173 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:56.621780 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:56.622493 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:56.664914 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:56.810822 21575 raft_consensus.cc:993] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:56.811616 21470 raft_consensus.cc:1081] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:56.813437 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:56.814076 21254 raft_consensus.cc:493] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:56.814450 21254 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.819955 21254 raft_consensus.cc:515] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.821746 21254 leader_election.cc:290] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:56.822602 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:56.823434 21532 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.823495 21575 raft_consensus.cc:993] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:56.822865 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bba470733404d4fad26f271fa2ee589" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:56.824150 21470 raft_consensus.cc:1081] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:56.824483 21329 raft_consensus.cc:3055] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.824903 21329 raft_consensus.cc:740] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:56.825870 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:56.825918 21329 consensus_queue.cc:260] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.826619 21254 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:56.826989 21254 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.827508 21329 raft_consensus.cc:3060] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.831868 21532 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:56.833245 21221 leader_election.cc:304] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:56.834017 21574 raft_consensus.cc:2804] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:56.834556 21574 raft_consensus.cc:697] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:56.835167 21254 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.835506 21574 consensus_queue.cc:237] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.837028 21329 raft_consensus.cc:2468] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:56.837441 21254 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:56.838626 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:56.839293 21532 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.842166 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:56.842828 21329 raft_consensus.cc:3055] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:56.843189 21329 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:56.843523 21076 catalog_manager.cc:5697] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 2 to 3, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 3 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.844228 21329 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.845929 21329 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.847272 21532 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:56.848582 21221 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:56.849594 21574 raft_consensus.cc:2804] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.850147 21574 raft_consensus.cc:697] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:56.851091 21574 consensus_queue.cc:237] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:56.857084 21329 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 2.
I20260709 12:13:56.862481 21076 catalog_manager.cc:5697] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 1 to 2, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 2 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.126971 21573 raft_consensus.cc:993] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.127629 21599 raft_consensus.cc:1081] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.129226 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:57.129832 21329 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:57.130139 21329 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.136379 21329 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.138291 21329 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:57.139371 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:57.139294 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:57.140244 21254 raft_consensus.cc:3055] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.140327 21533 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.140548 21254 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:57.141713 21254 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.142846 21254 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.147109 21533 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.148164 21254 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.148375 21295 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:57.149241 21470 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.149734 21470 raft_consensus.cc:697] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:57.150656 21470 consensus_queue.cc:237] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.159942 21076 catalog_manager.cc:5697] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 2 to 3, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.267442 21329 raft_consensus.cc:1275] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:57.268821 21599 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:57.282567 21533 raft_consensus.cc:1275] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:57.284288 21573 consensus_queue.cc:1048] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:57.289749 21329 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.291352 21573 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:57.310575 21533 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.312036 21599 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:57.629747 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:57.638208 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:57.638971 21329 raft_consensus.cc:606] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:57.642057 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:57.642728 21254 raft_consensus.cc:606] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:57.645284 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:57.645841 21254 raft_consensus.cc:606] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:57.646842 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:57.647405 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:57.648121 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:57.666144 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:57.705309 21254 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:57.706806 21470 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:57.714540 21608 raft_consensus.cc:993] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:57.715508 21470 raft_consensus.cc:1081] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:57.718026 21253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:57.718647 21253 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:57.719081 21253 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.720891 21533 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:57.722879 21608 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:57.728067 21253 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.730455 21253 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 4 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:57.731318 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:57.734328 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:57.735057 21329 raft_consensus.cc:3055] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.735409 21329 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:57.736097 21329 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.737170 21329 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.747732 21599 raft_consensus.cc:993] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.747763 21329 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 4.
I20260709 12:13:57.748613 21573 raft_consensus.cc:1081] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.749224 21221 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d27fda7d920b484eba05d94514d6c6df; no voters: d36101652e8148879b06030d779a3d68
I20260709 12:13:57.750146 21573 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:57.750700 21573 raft_consensus.cc:697] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:57.751480 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:57.751461 21573 consensus_queue.cc:237] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.752091 21329 raft_consensus.cc:493] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:57.752475 21329 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.759223 21329 raft_consensus.cc:515] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.759147 21076 catalog_manager.cc:5697] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 3 to 4, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 4 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.761761 21329 leader_election.cc:290] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:57.762647 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:57.762936 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2c1194f78040feb838fd5bf85a3d3b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:57.763396 21533 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.763515 21253 raft_consensus.cc:3055] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.763944 21253 raft_consensus.cc:740] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:57.764837 21253 consensus_queue.cc:260] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.766240 21253 raft_consensus.cc:3060] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.772368 21533 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.773921 21295 leader_election.cc:304] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:57.774921 21608 raft_consensus.cc:2804] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.774786 21253 raft_consensus.cc:2468] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.775520 21608 raft_consensus.cc:697] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:57.776485 21608 consensus_queue.cc:237] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.785920 21076 catalog_manager.cc:5697] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 2 to 3, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.937697 21599 raft_consensus.cc:993] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.938251 21573 raft_consensus.cc:1081] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:57.939893 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:57.940425 21329 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:57.940738 21329 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.946203 21329 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.947676 21329 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:57.948694 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:57.949069 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:57.949455 21533 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.949741 21253 raft_consensus.cc:3055] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.950095 21253 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:57.950901 21253 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.951947 21253 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.956004 21533 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.957278 21295 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:57.957681 21253 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 3.
I20260709 12:13:57.958248 21608 raft_consensus.cc:2804] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.958971 21608 raft_consensus.cc:697] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:57.959810 21608 consensus_queue.cc:237] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:57.966674 21076 catalog_manager.cc:5697] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 2 to 3, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.136372 21329 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:58.137919 21573 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.146307 21533 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.156090 21533 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:58.157701 21615 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.327442 21533 raft_consensus.cc:1275] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.328827 21608 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.339012 21253 raft_consensus.cc:1275] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.341468 21609 consensus_queue.cc:1048] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.365998 21253 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.367282 21618 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.378777 21533 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.380162 21618 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.657922 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.666085 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:58.666949 21254 raft_consensus.cc:606] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
W20260709 12:13:58.667228 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:58.676362 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:58.677250 21329 raft_consensus.cc:606] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:58.680555 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:58.681092 21329 raft_consensus.cc:606] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:58.682345 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:58.683175 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.684068 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.764052 21615 raft_consensus.cc:993] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:58.764689 21573 raft_consensus.cc:1081] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:58.766126 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:58.766597 21329 raft_consensus.cc:493] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:58.766877 21329 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.772691 21329 raft_consensus.cc:515] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.774251 21329 leader_election.cc:290] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 5 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:58.775247 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:58.775166 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0dbbf64b85485a967270e710ae5e7b" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:58.776142 21254 raft_consensus.cc:3055] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:58.776422 21254 raft_consensus.cc:740] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:58.776280 21533 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.777258 21254 consensus_queue.cc:260] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.778352 21254 raft_consensus.cc:3060] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.782755 21533 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 5.
I20260709 12:13:58.783538 21254 raft_consensus.cc:2468] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 5.
I20260709 12:13:58.784086 21295 leader_election.cc:304] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:58.784937 21618 raft_consensus.cc:2804] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.785388 21618 raft_consensus.cc:697] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 5 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:58.786180 21618 consensus_queue.cc:237] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.793220 21076 catalog_manager.cc:5697] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 4 to 5, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 5 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.829917 21618 raft_consensus.cc:993] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:58.830443 21617 raft_consensus.cc:1081] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:58.831827 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:58.832451 21254 raft_consensus.cc:493] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:58.832855 21254 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.838475 21254 raft_consensus.cc:515] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.840238 21254 leader_election.cc:290] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:58.840981 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:58.841241 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:58.841732 21533 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.841878 21329 raft_consensus.cc:3055] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:58.842259 21329 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:58.842926 21329 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.843911 21329 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.847764 21533 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:58.848976 21221 leader_election.cc:304] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:58.849148 21329 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:58.849839 21573 raft_consensus.cc:2804] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:58.850284 21573 raft_consensus.cc:697] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:58.851033 21573 consensus_queue.cc:237] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.859066 21076 catalog_manager.cc:5697] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 2 to 3, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 3 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.915357 21617 raft_consensus.cc:993] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:58.915800 21608 raft_consensus.cc:1081] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:58.917304 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "924f517493ec449bac56d28369f24157"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:58.917809 21254 raft_consensus.cc:493] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:58.918187 21254 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.923796 21254 raft_consensus.cc:515] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.925330 21254 leader_election.cc:290] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 4 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:58.926393 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:58.926589 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924f517493ec449bac56d28369f24157" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:58.927032 21533 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.927207 21329 raft_consensus.cc:3055] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.927590 21329 raft_consensus.cc:740] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:58.928381 21329 consensus_queue.cc:260] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.929370 21329 raft_consensus.cc:3060] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.932953 21533 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 4.
I20260709 12:13:58.934119 21221 leader_election.cc:304] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:58.934531 21329 raft_consensus.cc:2468] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 4.
I20260709 12:13:58.934981 21573 raft_consensus.cc:2804] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.935480 21573 raft_consensus.cc:697] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:58.936232 21573 consensus_queue.cc:237] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:58.943238 21078 catalog_manager.cc:5697] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 3 to 4, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 4 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.219918 21254 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 5 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:59.221101 21608 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:59.231858 21533 raft_consensus.cc:1275] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 5 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:59.234064 21617 consensus_queue.cc:1048] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:59.239387 21329 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:59.240661 21573 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:59.248796 21533 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:59.250319 21615 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:59.464775 21532 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:59.466681 21633 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:59.475818 21329 raft_consensus.cc:1275] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:59.479722 21633 consensus_queue.cc:1048] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:59.668474 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:59.695865 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:59.704455 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:59.705152 21254 raft_consensus.cc:606] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:59.708076 21329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
mode: GRACEFUL
new_leader_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:13:59.708699 21329 raft_consensus.cc:606] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Received request to transfer leadership to TS d27fda7d920b484eba05d94514d6c6df
I20260709 12:13:59.711331 21617 raft_consensus.cc:993] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: : Instructing follower d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:59.711675 21254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
mode: GRACEFUL
new_leader_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:13:59.711829 21618 raft_consensus.cc:1081] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Signalling peer d27fda7d920b484eba05d94514d6c6df to start an election
I20260709 12:13:59.712350 21254 raft_consensus.cc:606] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Received request to transfer leadership to TS 899b84871ae84a1485cded8b8827b7d0
I20260709 12:13:59.713575 21254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58"
dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:13:59.713594 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:59.714067 21254 raft_consensus.cc:493] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.714434 21254 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.714428 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:59.716099 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:59.721206 21254 raft_consensus.cc:515] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.722900 21254 leader_election.cc:290] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67:33971)
I20260709 12:13:59.723927 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:59.724215 21329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca3ae83ad0d41b59c0296197dc19e58" candidate_uuid: "d27fda7d920b484eba05d94514d6c6df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
I20260709 12:13:59.724627 21532 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.724890 21329 raft_consensus.cc:3055] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:59.725211 21329 raft_consensus.cc:740] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:59.726116 21329 consensus_queue.cc:260] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.727469 21329 raft_consensus.cc:3060] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.732605 21532 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:59.734040 21221 leader_election.cc:304] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d27fda7d920b484eba05d94514d6c6df, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:59.734895 21633 raft_consensus.cc:2804] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:59.735313 21329 raft_consensus.cc:2468] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27fda7d920b484eba05d94514d6c6df in term 3.
I20260709 12:13:59.735373 21633 raft_consensus.cc:697] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Becoming Leader. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:59.736655 21633 consensus_queue.cc:237] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.744871 21573 raft_consensus.cc:993] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:59.745419 21633 raft_consensus.cc:1081] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:59.744863 21076 catalog_manager.cc:5697] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df reported cstate change: term changed from 2 to 3, leader changed from 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67) to d27fda7d920b484eba05d94514d6c6df (127.10.114.66). New cstate: current_term: 3 leader_uuid: "d27fda7d920b484eba05d94514d6c6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.747092 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fabef1ca03674313859a388bf094c10e"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:59.747563 21329 raft_consensus.cc:493] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.747861 21329 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.755268 21329 raft_consensus.cc:515] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.761997 21329 leader_election.cc:290] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 4 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:59.762862 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:59.763262 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabef1ca03674313859a388bf094c10e" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:59.763602 21532 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.763868 21254 raft_consensus.cc:3055] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:59.764200 21254 raft_consensus.cc:740] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:59.764997 21254 consensus_queue.cc:260] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.766289 21254 raft_consensus.cc:3060] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.771502 21532 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 4.
I20260709 12:13:59.772815 21295 leader_election.cc:304] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:59.773583 21618 raft_consensus.cc:2804] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.773664 21254 raft_consensus.cc:2468] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 4.
I20260709 12:13:59.774165 21618 raft_consensus.cc:697] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 4 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:59.775040 21618 consensus_queue.cc:237] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.777952 21573 raft_consensus.cc:993] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: : Instructing follower 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:59.778558 21633 raft_consensus.cc:1081] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Signalling peer 899b84871ae84a1485cded8b8827b7d0 to start an election
I20260709 12:13:59.779989 21329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d"
dest_uuid: "899b84871ae84a1485cded8b8827b7d0"
 from {username='slave'} at 127.0.0.1:40116
I20260709 12:13:59.780506 21329 raft_consensus.cc:493] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.780879 21329 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.782387 21076 catalog_manager.cc:5697] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 3 to 4, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 4 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.787559 21329 raft_consensus.cc:515] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.789710 21329 leader_election.cc:290] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Requested vote from peers d36101652e8148879b06030d779a3d68 (127.10.114.65:43075), d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687)
I20260709 12:13:59.790300 21532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d36101652e8148879b06030d779a3d68"
I20260709 12:13:59.790714 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42d33b4f6f46a58f20b7b19365383d" candidate_uuid: "899b84871ae84a1485cded8b8827b7d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d27fda7d920b484eba05d94514d6c6df"
I20260709 12:13:59.791106 21532 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.791304 21254 raft_consensus.cc:3055] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:59.791699 21254 raft_consensus.cc:740] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d27fda7d920b484eba05d94514d6c6df, State: Running, Role: LEADER
I20260709 12:13:59.792547 21254 consensus_queue.cc:260] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.793825 21254 raft_consensus.cc:3060] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.797775 21532 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:59.798924 21254 raft_consensus.cc:2468] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899b84871ae84a1485cded8b8827b7d0 in term 2.
I20260709 12:13:59.799000 21295 leader_election.cc:304] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899b84871ae84a1485cded8b8827b7d0, d36101652e8148879b06030d779a3d68; no voters: 
I20260709 12:13:59.799957 21618 raft_consensus.cc:2804] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.800472 21618 raft_consensus.cc:697] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Becoming Leader. State: Replica: 899b84871ae84a1485cded8b8827b7d0, State: Running, Role: LEADER
I20260709 12:13:59.801441 21618 consensus_queue.cc:237] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } }
I20260709 12:13:59.809067 21076 catalog_manager.cc:5697] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 reported cstate change: term changed from 1 to 2, leader changed from d27fda7d920b484eba05d94514d6c6df (127.10.114.66) to 899b84871ae84a1485cded8b8827b7d0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "899b84871ae84a1485cded8b8827b7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:00.182971 21532 raft_consensus.cc:1275] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:00.184409 21633 consensus_queue.cc:1048] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:00.196310 21329 raft_consensus.cc:1275] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Refusing update from remote peer d27fda7d920b484eba05d94514d6c6df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:00.207441 21615 consensus_queue.cc:1048] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "899b84871ae84a1485cded8b8827b7d0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 33971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:00.232957 21254 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:00.234311 21618 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:00.242250 21532 raft_consensus.cc:1275] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:00.244349 21617 consensus_queue.cc:1048] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:00.337793 21532 raft_consensus.cc:1275] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:00.339154 21617 consensus_queue.cc:1048] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36101652e8148879b06030d779a3d68" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 43075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:00.349325 21254 raft_consensus.cc:1275] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Refusing update from remote peer 899b84871ae84a1485cded8b8827b7d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:00.350993 21618 consensus_queue.cc:1048] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27fda7d920b484eba05d94514d6c6df" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:00.669831 21126 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:00.724094 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:00.756780 10697 tablet_server.cc:179] TabletServer@127.10.114.65:43075 shutting down...
W20260709 12:14:00.776430 21295 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:14:00.782318 21295 consensus_peers.cc:597] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.786768 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:00.787698 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.788435 10697 raft_consensus.cc:2243] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.788901 10697 raft_consensus.cc:2272] T 5d6150a9d73d40bca6763db1f2dcb240 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:00.791363 21221 consensus_peers.cc:597] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.791903 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.792881 10697 raft_consensus.cc:2243] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.793470 10697 raft_consensus.cc:2272] T 6f2c1194f78040feb838fd5bf85a3d3b P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.795819 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.796396 10697 raft_consensus.cc:2243] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.796778 10697 raft_consensus.cc:2272] T d3655ae29ee54f9a87deda31393b72db P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.798944 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.799504 10697 raft_consensus.cc:2243] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.799901 10697 raft_consensus.cc:2272] T bf42d33b4f6f46a58f20b7b19365383d P d36101652e8148879b06030d779a3d68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.803264 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.803920 10697 raft_consensus.cc:2243] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.804376 10697 raft_consensus.cc:2272] T 2bba470733404d4fad26f271fa2ee589 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.807097 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.807875 10697 raft_consensus.cc:2243] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.808441 10697 raft_consensus.cc:2272] T eca3ae83ad0d41b59c0296197dc19e58 P d36101652e8148879b06030d779a3d68 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:00.809005 21295 consensus_peers.cc:597] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.811774 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.812506 10697 raft_consensus.cc:2243] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.812898 10697 raft_consensus.cc:2272] T 450483839932413dbb8dc0cf982b8d46 P d36101652e8148879b06030d779a3d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.815116 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.815680 10697 raft_consensus.cc:2243] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.816133 10697 raft_consensus.cc:2272] T fabef1ca03674313859a388bf094c10e P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.818957 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.819660 10697 raft_consensus.cc:2243] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.820138 10697 raft_consensus.cc:2272] T 6a0dbbf64b85485a967270e710ae5e7b P d36101652e8148879b06030d779a3d68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.822273 10697 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:00.822782 10697 raft_consensus.cc:2243] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.823253 10697 raft_consensus.cc:2272] T 924f517493ec449bac56d28369f24157 P d36101652e8148879b06030d779a3d68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.855142 10697 tablet_server.cc:196] TabletServer@127.10.114.65:43075 shutdown complete.
I20260709 12:14:00.878556 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
W20260709 12:14:00.898802 21295 consensus_peers.cc:597] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687): Couldn't send request to peer d27fda7d920b484eba05d94514d6c6df. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.907402 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:00.908458 10697 tablet_replica.cc:333] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.909665 10697 raft_consensus.cc:2243] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.910275 10697 raft_consensus.cc:2272] T 6f2c1194f78040feb838fd5bf85a3d3b P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.913760 10697 tablet_replica.cc:333] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
W20260709 12:14:00.914666 21295 consensus_peers.cc:597] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 -> Peer d27fda7d920b484eba05d94514d6c6df (127.10.114.66:37687): Couldn't send request to peer d27fda7d920b484eba05d94514d6c6df. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.914839 10697 raft_consensus.cc:2243] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.915526 10697 raft_consensus.cc:2272] T bf42d33b4f6f46a58f20b7b19365383d P d27fda7d920b484eba05d94514d6c6df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.919138 10697 tablet_replica.cc:333] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.919759 10697 raft_consensus.cc:2243] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.920213 10697 raft_consensus.cc:2272] T d3655ae29ee54f9a87deda31393b72db P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.923350 10697 tablet_replica.cc:333] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.923954 10697 raft_consensus.cc:2243] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.924383 10697 raft_consensus.cc:2272] T fabef1ca03674313859a388bf094c10e P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.927275 10697 tablet_replica.cc:333] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.927892 10697 raft_consensus.cc:2243] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:00.928707 10697 raft_consensus.cc:2272] T 2bba470733404d4fad26f271fa2ee589 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.931066 10697 tablet_replica.cc:333] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.931730 10697 raft_consensus.cc:2243] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:00.932587 10697 raft_consensus.cc:2272] T eca3ae83ad0d41b59c0296197dc19e58 P d27fda7d920b484eba05d94514d6c6df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.935264 10697 tablet_replica.cc:333] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.935922 10697 raft_consensus.cc:2243] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.936439 10697 raft_consensus.cc:2272] T 450483839932413dbb8dc0cf982b8d46 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.938840 10697 tablet_replica.cc:333] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.939371 10697 raft_consensus.cc:2243] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:00.939759 10697 raft_consensus.cc:2272] T 6a0dbbf64b85485a967270e710ae5e7b P d27fda7d920b484eba05d94514d6c6df [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.941905 10697 tablet_replica.cc:333] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.942390 10697 raft_consensus.cc:2243] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:00.943228 10697 raft_consensus.cc:2272] T 924f517493ec449bac56d28369f24157 P d27fda7d920b484eba05d94514d6c6df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.945420 10697 tablet_replica.cc:333] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df: stopping tablet replica
I20260709 12:14:00.945955 10697 raft_consensus.cc:2243] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:00.946833 10697 raft_consensus.cc:2272] T 5d6150a9d73d40bca6763db1f2dcb240 P d27fda7d920b484eba05d94514d6c6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:00.983433 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:14:01.011823 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
I20260709 12:14:01.048246 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:01.049121 10697 tablet_replica.cc:333] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.050098 10697 raft_consensus.cc:2243] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.051091 10697 raft_consensus.cc:2272] T fabef1ca03674313859a388bf094c10e P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.054733 10697 tablet_replica.cc:333] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.055377 10697 raft_consensus.cc:2243] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.056414 10697 raft_consensus.cc:2272] T 6f2c1194f78040feb838fd5bf85a3d3b P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.059629 10697 tablet_replica.cc:333] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.060380 10697 raft_consensus.cc:2243] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.061347 10697 raft_consensus.cc:2272] T bf42d33b4f6f46a58f20b7b19365383d P 899b84871ae84a1485cded8b8827b7d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.062155 21295 consensus_peers.cc:597] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 -> Peer d36101652e8148879b06030d779a3d68 (127.10.114.65:43075): Couldn't send request to peer d36101652e8148879b06030d779a3d68. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:43075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.065028 10697 tablet_replica.cc:333] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.065896 10697 raft_consensus.cc:2243] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.066910 10697 raft_consensus.cc:2272] T d3655ae29ee54f9a87deda31393b72db P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.069455 10697 tablet_replica.cc:333] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.070137 10697 raft_consensus.cc:2243] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.070605 10697 raft_consensus.cc:2272] T eca3ae83ad0d41b59c0296197dc19e58 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.073519 10697 tablet_replica.cc:333] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.074244 10697 raft_consensus.cc:2243] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.074726 10697 raft_consensus.cc:2272] T 2bba470733404d4fad26f271fa2ee589 P 899b84871ae84a1485cded8b8827b7d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.077030 10697 tablet_replica.cc:333] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.077687 10697 raft_consensus.cc:2243] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.078649 10697 raft_consensus.cc:2272] T 450483839932413dbb8dc0cf982b8d46 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.081019 10697 tablet_replica.cc:333] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.081652 10697 raft_consensus.cc:2243] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.082101 10697 raft_consensus.cc:2272] T 5d6150a9d73d40bca6763db1f2dcb240 P 899b84871ae84a1485cded8b8827b7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.084479 10697 tablet_replica.cc:333] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.085038 10697 raft_consensus.cc:2243] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.085950 10697 raft_consensus.cc:2272] T 6a0dbbf64b85485a967270e710ae5e7b P 899b84871ae84a1485cded8b8827b7d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.088218 10697 tablet_replica.cc:333] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0: stopping tablet replica
I20260709 12:14:01.088799 10697 raft_consensus.cc:2243] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.089252 10697 raft_consensus.cc:2272] T 924f517493ec449bac56d28369f24157 P 899b84871ae84a1485cded8b8827b7d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.146886 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:14:01.176563 10697 master.cc:562] Master@127.10.114.126:41367 shutting down...
I20260709 12:14:01.202901 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.203590 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.204001 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P a199a172d80c4ceca47db288e76df603: stopping tablet replica
I20260709 12:14:01.228663 10697 master.cc:584] Master@127.10.114.126:41367 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14800 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:14:01.279958 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:40723
I20260709 12:14:01.281284 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:01.287549 21655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.288507 21658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.288617 21656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:01.289672 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:01.290740 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:01.290923 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:01.291114 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599241291079 us; error 0 us; skew 500 ppm
I20260709 12:14:01.291679 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:01.294354 10697 webserver.cc:533] Webserver started at http://127.10.114.126:35613/ using document root <none> and password file <none>
I20260709 12:14:01.294888 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:01.295076 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:01.295392 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:01.296677 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "2ee7cd50ad79433a8360262995a759f6"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.301694 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:14:01.305379 21663 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.306269 10697 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:01.306573 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "2ee7cd50ad79433a8360262995a759f6"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.306900 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:01.327678 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:01.329073 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:01.372169 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:40723
I20260709 12:14:01.372255 21714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:40723 every 8 connection(s)
I20260709 12:14:01.376719 21715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:01.389837 21715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6: Bootstrap starting.
I20260709 12:14:01.395714 21715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.400977 21715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6: No bootstrap required, opened a new log
I20260709 12:14:01.403698 21715 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER }
I20260709 12:14:01.404181 21715 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.404415 21715 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ee7cd50ad79433a8360262995a759f6, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.405148 21715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER }
I20260709 12:14:01.405682 21715 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:01.405902 21715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:01.406204 21715 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.412389 21715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER }
I20260709 12:14:01.413031 21715 leader_election.cc:304] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ee7cd50ad79433a8360262995a759f6; no voters: 
I20260709 12:14:01.414409 21715 leader_election.cc:290] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:01.414839 21718 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.416451 21718 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2ee7cd50ad79433a8360262995a759f6, State: Running, Role: LEADER
I20260709 12:14:01.417098 21718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER }
I20260709 12:14:01.417707 21715 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:01.421983 21720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ee7cd50ad79433a8360262995a759f6. Latest consensus state: current_term: 1 leader_uuid: "2ee7cd50ad79433a8360262995a759f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER } }
I20260709 12:14:01.422813 21720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:01.424152 21719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ee7cd50ad79433a8360262995a759f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ee7cd50ad79433a8360262995a759f6" member_type: VOTER } }
I20260709 12:14:01.424924 21719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:01.426818 21724 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:01.435508 21724 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:01.436668 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:01.445705 21724 catalog_manager.cc:1383] Generated new cluster ID: d251e289ed2f469c8e4cb9c0e17aa3ef
I20260709 12:14:01.446087 21724 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:01.460691 21724 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:01.462267 21724 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:01.478763 21724 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6: Generated new TSK 0
I20260709 12:14:01.479478 21724 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:01.503993 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:01.511638 21736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.512607 21737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.514094 21739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:01.514652 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:01.515820 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:01.516018 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:01.516155 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599241516143 us; error 0 us; skew 500 ppm
I20260709 12:14:01.516708 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:01.519294 10697 webserver.cc:533] Webserver started at http://127.10.114.65:44245/ using document root <none> and password file <none>
I20260709 12:14:01.519781 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:01.519948 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:01.520180 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:01.521449 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "7986337a81e64cae874b6f69ed8f1378"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.526993 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:01.531260 21744 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.532145 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:01.532461 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "7986337a81e64cae874b6f69ed8f1378"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.532761 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:01.565259 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:01.566692 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:01.568385 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:01.571121 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:01.571314 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.571658 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:01.571826 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.621975 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:38547
I20260709 12:14:01.622080 21806 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:38547 every 8 connection(s)
I20260709 12:14:01.627980 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:01.636865 21811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.639283 21812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:01.640373 10697 server_base.cc:1061] running on GCE node
W20260709 12:14:01.640795 21814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:01.642081 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:01.642355 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:01.642596 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599241642574 us; error 0 us; skew 500 ppm
I20260709 12:14:01.643415 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:01.644183 21807 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40723
I20260709 12:14:01.644685 21807 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:01.645820 21807 heartbeater.cc:507] Master 127.10.114.126:40723 requested a full tablet report, sending...
I20260709 12:14:01.646742 10697 webserver.cc:533] Webserver started at http://127.10.114.66:46497/ using document root <none> and password file <none>
I20260709 12:14:01.647606 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:01.647866 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:01.648212 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:01.648842 21680 ts_manager.cc:194] Registered new tserver with Master: 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547)
I20260709 12:14:01.650027 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "e9283767a5f14728accf57b1406368d6"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.651808 21680 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51606
I20260709 12:14:01.657011 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:01.661056 21819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.662041 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:14:01.662415 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "e9283767a5f14728accf57b1406368d6"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.662801 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:01.685845 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:01.687381 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:01.689162 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:01.691859 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:01.692111 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.692395 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:01.692584 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.743480 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:46701
I20260709 12:14:01.743623 21881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:46701 every 8 connection(s)
I20260709 12:14:01.749079 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:01.757452 21885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.759254 21886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:01.762799 21888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:01.763713 21882 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40723
I20260709 12:14:01.764143 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:01.764302 21882 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:01.765254 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:01.765338 21882 heartbeater.cc:507] Master 127.10.114.126:40723 requested a full tablet report, sending...
W20260709 12:14:01.765578 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:01.765937 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599241765910 us; error 0 us; skew 500 ppm
I20260709 12:14:01.766786 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:01.767917 21680 ts_manager.cc:194] Registered new tserver with Master: e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701)
I20260709 12:14:01.769817 10697 webserver.cc:533] Webserver started at http://127.10.114.67:37697/ using document root <none> and password file <none>
I20260709 12:14:01.769928 21680 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51610
I20260709 12:14:01.770500 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:01.770756 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:01.771097 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:01.772557 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "bb19d4d5d5414edd959b506b80319cad"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.777648 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:14:01.781733 21893 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.782912 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:01.783427 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "bb19d4d5d5414edd959b506b80319cad"
format_stamp: "Formatted at 2026-07-09 12:14:01 on dist-test-slave-08l4"
I20260709 12:14:01.783759 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:01.810297 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:01.811908 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:01.813427 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:01.816115 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:01.816354 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.816645 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:01.816815 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:01.865079 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:39971
I20260709 12:14:01.865152 21955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:39971 every 8 connection(s)
I20260709 12:14:01.881639 21956 heartbeater.cc:344] Connected to a master server at 127.10.114.126:40723
I20260709 12:14:01.882134 21956 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:01.883209 21956 heartbeater.cc:507] Master 127.10.114.126:40723 requested a full tablet report, sending...
I20260709 12:14:01.885753 21680 ts_manager.cc:194] Registered new tserver with Master: bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:01.886253 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017364537s
I20260709 12:14:01.887810 21680 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51620
I20260709 12:14:01.917183 21680 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51636:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:01.919757 21680 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:01.973932 21847 tablet_service.cc:1511] Processing CreateTablet for tablet 736565c9bdb04eefb241aa9d919dc008 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:01.975898 21847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736565c9bdb04eefb241aa9d919dc008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:01.980144 21846 tablet_service.cc:1511] Processing CreateTablet for tablet 985ab1956c2343b28b5503903ed12289 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:01.981756 21846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ab1956c2343b28b5503903ed12289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:01.986809 21921 tablet_service.cc:1511] Processing CreateTablet for tablet 736565c9bdb04eefb241aa9d919dc008 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:01.988442 21921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736565c9bdb04eefb241aa9d919dc008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:01.991123 21920 tablet_service.cc:1511] Processing CreateTablet for tablet 985ab1956c2343b28b5503903ed12289 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:01.992735 21920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ab1956c2343b28b5503903ed12289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.000408 21772 tablet_service.cc:1511] Processing CreateTablet for tablet 736565c9bdb04eefb241aa9d919dc008 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:02.002046 21772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736565c9bdb04eefb241aa9d919dc008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.007241 21971 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: Bootstrap starting.
I20260709 12:14:02.006801 21771 tablet_service.cc:1511] Processing CreateTablet for tablet 985ab1956c2343b28b5503903ed12289 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3636ac822567485eb09abc62045ff977]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:02.008536 21771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ab1956c2343b28b5503903ed12289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.015863 21971 tablet_bootstrap.cc:654] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.036695 21973 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Bootstrap starting.
I20260709 12:14:02.039256 21971 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: No bootstrap required, opened a new log
I20260709 12:14:02.040019 21971 ts_tablet_manager.cc:1403] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.007s
I20260709 12:14:02.043593 21971 raft_consensus.cc:359] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.044589 21971 raft_consensus.cc:385] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.044997 21971 raft_consensus.cc:740] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.046123 21971 consensus_queue.cc:260] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.048103 21974 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: Bootstrap starting.
I20260709 12:14:02.048600 21973 tablet_bootstrap.cc:654] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.049787 21882 heartbeater.cc:499] Master 127.10.114.126:40723 was elected leader, sending a full tablet report...
I20260709 12:14:02.050367 21971 ts_tablet_manager.cc:1434] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:14:02.051542 21971 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: Bootstrap starting.
I20260709 12:14:02.056864 21974 tablet_bootstrap.cc:654] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.059602 21971 tablet_bootstrap.cc:654] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.064177 21973 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: No bootstrap required, opened a new log
I20260709 12:14:02.064915 21973 ts_tablet_manager.cc:1403] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.010s
I20260709 12:14:02.067253 21971 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: No bootstrap required, opened a new log
I20260709 12:14:02.067986 21971 ts_tablet_manager.cc:1403] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 12:14:02.068843 21973 raft_consensus.cc:359] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.069705 21974 tablet_bootstrap.cc:492] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: No bootstrap required, opened a new log
I20260709 12:14:02.069831 21973 raft_consensus.cc:385] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.070250 21973 raft_consensus.cc:740] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.070350 21974 ts_tablet_manager.cc:1403] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:14:02.070887 21971 raft_consensus.cc:359] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.071590 21971 raft_consensus.cc:385] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.071852 21971 raft_consensus.cc:740] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.071236 21973 consensus_queue.cc:260] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.072619 21971 consensus_queue.cc:260] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.074276 21974 raft_consensus.cc:359] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.075080 21971 ts_tablet_manager.cc:1434] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:14:02.075415 21974 raft_consensus.cc:385] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.075943 21974 raft_consensus.cc:740] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.077291 21974 consensus_queue.cc:260] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.078936 21975 raft_consensus.cc:493] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.079752 21975 raft_consensus.cc:515] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.081521 21956 heartbeater.cc:499] Master 127.10.114.126:40723 was elected leader, sending a full tablet report...
I20260709 12:14:02.088986 21974 ts_tablet_manager.cc:1434] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:14:02.090129 21807 heartbeater.cc:499] Master 127.10.114.126:40723 was elected leader, sending a full tablet report...
I20260709 12:14:02.094069 21974 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: Bootstrap starting.
I20260709 12:14:02.103981 21974 tablet_bootstrap.cc:654] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.109709 21973 ts_tablet_manager.cc:1434] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.007s
I20260709 12:14:02.114352 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378" is_pre_election: true
I20260709 12:14:02.116873 21973 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: Bootstrap starting.
W20260709 12:14:02.117245 21823 leader_election.cc:343] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:02.117856 21974 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: No bootstrap required, opened a new log
I20260709 12:14:02.121511 21974 ts_tablet_manager.cc:1403] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 12:14:02.118465 21975 leader_election.cc:290] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971), 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547)
I20260709 12:14:02.125797 21974 raft_consensus.cc:359] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.126500 21974 raft_consensus.cc:385] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.126837 21974 raft_consensus.cc:740] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.127640 21974 consensus_queue.cc:260] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.129777 21973 tablet_bootstrap.cc:654] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.129948 21974 ts_tablet_manager.cc:1434] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:02.137336 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad" is_pre_election: true
W20260709 12:14:02.139142 21820 leader_election.cc:343] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:02.139603 21973 tablet_bootstrap.cc:492] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: No bootstrap required, opened a new log
I20260709 12:14:02.139699 21820 leader_election.cc:304] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9283767a5f14728accf57b1406368d6; no voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad
I20260709 12:14:02.140205 21973 ts_tablet_manager.cc:1403] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:14:02.140812 21975 raft_consensus.cc:2749] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:02.143208 21973 raft_consensus.cc:359] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.144146 21973 raft_consensus.cc:385] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.144379 21973 raft_consensus.cc:740] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.144961 21973 consensus_queue.cc:260] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.147010 21973 ts_tablet_manager.cc:1434] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:02.168315 21975 raft_consensus.cc:493] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.169135 21975 raft_consensus.cc:515] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.171146 21975 leader_election.cc:290] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.172181 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378" is_pre_election: true
I20260709 12:14:02.172259 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad" is_pre_election: true
I20260709 12:14:02.172945 21782 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 0.
I20260709 12:14:02.172989 21931 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 0.
I20260709 12:14:02.174074 21823 leader_election.cc:304] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.174839 21975 raft_consensus.cc:2804] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:02.175113 21975 raft_consensus.cc:493] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.175331 21975 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.181591 21975 raft_consensus.cc:515] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.183357 21975 leader_election.cc:290] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.184294 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:02.184399 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:02.185055 21782 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.185163 21931 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.191924 21931 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 1.
I20260709 12:14:02.191968 21782 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 1.
I20260709 12:14:02.193267 21823 leader_election.cc:304] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.194319 21975 raft_consensus.cc:2804] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:02.194788 21975 raft_consensus.cc:697] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Becoming Leader. State: Replica: e9283767a5f14728accf57b1406368d6, State: Running, Role: LEADER
I20260709 12:14:02.195719 21975 consensus_queue.cc:237] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.203179 21680 catalog_manager.cc:5697] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9283767a5f14728accf57b1406368d6 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e9283767a5f14728accf57b1406368d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.328099 21979 raft_consensus.cc:493] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.328924 21979 raft_consensus.cc:515] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.331477 21979 leader_election.cc:290] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547)
I20260709 12:14:02.342031 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378" is_pre_election: true
I20260709 12:14:02.342078 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9283767a5f14728accf57b1406368d6" is_pre_election: true
I20260709 12:14:02.342878 21782 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 0.
I20260709 12:14:02.342945 21857 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 0.
I20260709 12:14:02.343984 21897 leader_election.cc:304] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad; no voters: 
I20260709 12:14:02.344925 21979 raft_consensus.cc:2804] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:02.345268 21979 raft_consensus.cc:493] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.345654 21979 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.352975 21979 raft_consensus.cc:515] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.355810 21979 leader_election.cc:290] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 1 election: Requested vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547)
I20260709 12:14:02.357077 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9283767a5f14728accf57b1406368d6"
I20260709 12:14:02.358137 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:02.358230 21857 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.359030 21782 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.366189 21782 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 1.
I20260709 12:14:02.367660 21897 leader_election.cc:304] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad; no voters: 
I20260709 12:14:02.368402 21857 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 1.
I20260709 12:14:02.368805 21979 raft_consensus.cc:2804] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:02.371390 21979 raft_consensus.cc:697] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 LEADER]: Becoming Leader. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Running, Role: LEADER
I20260709 12:14:02.372876 21979 consensus_queue.cc:237] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.383806 21680 catalog_manager.cc:5697] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad reported cstate change: term changed from 0 to 1, leader changed from <none> to bb19d4d5d5414edd959b506b80319cad (127.10.114.67). New cstate: current_term: 1 leader_uuid: "bb19d4d5d5414edd959b506b80319cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.491009 21680 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51650:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:02.493233 21680 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:02.520083 21771 tablet_service.cc:1511] Processing CreateTablet for tablet bd333778ebe7468789b5789f09a97faf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:02.521654 21771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd333778ebe7468789b5789f09a97faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.521965 21847 tablet_service.cc:1511] Processing CreateTablet for tablet bd333778ebe7468789b5789f09a97faf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:02.522838 21920 tablet_service.cc:1511] Processing CreateTablet for tablet bd333778ebe7468789b5789f09a97faf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:02.523455 21847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd333778ebe7468789b5789f09a97faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.524183 21920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd333778ebe7468789b5789f09a97faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.526160 21846 tablet_service.cc:1511] Processing CreateTablet for tablet 4469b1e63f914d8fbe4b76f5d776c300 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:02.527456 21846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4469b1e63f914d8fbe4b76f5d776c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.537382 21772 tablet_service.cc:1511] Processing CreateTablet for tablet 4469b1e63f914d8fbe4b76f5d776c300 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:02.539072 21772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4469b1e63f914d8fbe4b76f5d776c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.539853 21921 tablet_service.cc:1511] Processing CreateTablet for tablet 4469b1e63f914d8fbe4b76f5d776c300 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7f851855c5f64795b9c4b59442f6c88c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:02.541280 21921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4469b1e63f914d8fbe4b76f5d776c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:02.543143 21971 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Bootstrap starting.
I20260709 12:14:02.550148 21971 tablet_bootstrap.cc:654] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.555961 21973 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: Bootstrap starting.
I20260709 12:14:02.556803 21971 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: No bootstrap required, opened a new log
I20260709 12:14:02.557386 21971 ts_tablet_manager.cc:1403] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 12:14:02.560739 21971 raft_consensus.cc:359] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.561480 21971 raft_consensus.cc:385] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.561820 21971 raft_consensus.cc:740] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.564069 21971 consensus_queue.cc:260] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.567034 21971 ts_tablet_manager.cc:1434] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:02.567134 21974 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: Bootstrap starting.
I20260709 12:14:02.568511 21973 tablet_bootstrap.cc:654] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.575057 21974 tablet_bootstrap.cc:654] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.577777 21971 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: Bootstrap starting.
I20260709 12:14:02.584021 21974 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: No bootstrap required, opened a new log
I20260709 12:14:02.584606 21973 tablet_bootstrap.cc:492] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: No bootstrap required, opened a new log
I20260709 12:14:02.584774 21974 ts_tablet_manager.cc:1403] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:14:02.585253 21973 ts_tablet_manager.cc:1403] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:14:02.589128 21971 tablet_bootstrap.cc:654] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.588971 21973 raft_consensus.cc:359] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.588841 21974 raft_consensus.cc:359] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.589941 21973 raft_consensus.cc:385] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.590416 21973 raft_consensus.cc:740] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.591255 21973 consensus_queue.cc:260] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.589995 21974 raft_consensus.cc:385] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.591990 21974 raft_consensus.cc:740] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.592988 21974 consensus_queue.cc:260] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.593475 21973 ts_tablet_manager.cc:1434] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:02.599483 21974 ts_tablet_manager.cc:1434] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:14:02.600088 21973 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: Bootstrap starting.
I20260709 12:14:02.600689 21974 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: Bootstrap starting.
I20260709 12:14:02.601847 21971 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: No bootstrap required, opened a new log
I20260709 12:14:02.602514 21971 ts_tablet_manager.cc:1403] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:14:02.606259 21971 raft_consensus.cc:359] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.607213 21971 raft_consensus.cc:385] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.607579 21971 raft_consensus.cc:740] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.608539 21971 consensus_queue.cc:260] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.610630 21980 consensus_queue.cc:1048] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:02.609151 21973 tablet_bootstrap.cc:654] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.613757 21971 ts_tablet_manager.cc:1434] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:02.614598 21974 tablet_bootstrap.cc:654] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:02.641525 21974 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: No bootstrap required, opened a new log
I20260709 12:14:02.642148 21974 ts_tablet_manager.cc:1403] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.015s
I20260709 12:14:02.643301 21973 tablet_bootstrap.cc:492] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: No bootstrap required, opened a new log
I20260709 12:14:02.644107 21973 ts_tablet_manager.cc:1403] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.031s
I20260709 12:14:02.645669 21974 raft_consensus.cc:359] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.646057 21975 raft_consensus.cc:493] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.646582 21974 raft_consensus.cc:385] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.646952 21974 raft_consensus.cc:740] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.646765 21975 raft_consensus.cc:515] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.647840 21974 consensus_queue.cc:260] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.647854 21973 raft_consensus.cc:359] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.648962 21973 raft_consensus.cc:385] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:02.649384 21973 raft_consensus.cc:740] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.650791 21974 ts_tablet_manager.cc:1434] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:14:02.651043 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad" is_pre_election: true
I20260709 12:14:02.650344 21973 consensus_queue.cc:260] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.652348 21975 leader_election.cc:290] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.652705 21931 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 0.
I20260709 12:14:02.653214 21781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378" is_pre_election: true
I20260709 12:14:02.653980 21781 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 0.
I20260709 12:14:02.655357 21823 leader_election.cc:304] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.656301 21973 ts_tablet_manager.cc:1434] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:14:02.657492 21981 raft_consensus.cc:493] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.658097 21981 raft_consensus.cc:515] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.660554 21981 leader_election.cc:290] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.666173 21975 raft_consensus.cc:2804] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:02.667325 21975 raft_consensus.cc:493] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.667750 21975 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.683559 21975 raft_consensus.cc:515] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.688730 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:02.689642 21931 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.692207 21980 raft_consensus.cc:493] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.692868 21980 raft_consensus.cc:515] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.696491 21980 leader_election.cc:290] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.697517 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9283767a5f14728accf57b1406368d6" is_pre_election: true
I20260709 12:14:02.698004 21930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad" is_pre_election: true
I20260709 12:14:02.698484 21857 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 0.
I20260709 12:14:02.698958 21930 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 0.
I20260709 12:14:02.699764 21931 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 1.
I20260709 12:14:02.699966 21745 leader_election.cc:304] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.697667 21975 leader_election.cc:290] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.701002 21981 raft_consensus.cc:2804] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:02.701436 21981 raft_consensus.cc:493] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.701850 21981 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.703759 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad" is_pre_election: true
I20260709 12:14:02.704027 21781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378" is_pre_election: true
I20260709 12:14:02.704667 21931 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 0.
I20260709 12:14:02.705575 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:02.706266 21782 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.708833 21820 leader_election.cc:304] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb19d4d5d5414edd959b506b80319cad, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.710047 21820 leader_election.cc:304] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb19d4d5d5414edd959b506b80319cad, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.710619 21981 raft_consensus.cc:515] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.711153 21975 raft_consensus.cc:2804] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:02.711617 21975 raft_consensus.cc:493] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.711871 21781 raft_consensus.cc:2393] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9283767a5f14728accf57b1406368d6 in current term 1: Already voted for candidate 7986337a81e64cae874b6f69ed8f1378 in this term.
I20260709 12:14:02.711961 21975 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.713892 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9283767a5f14728accf57b1406368d6"
I20260709 12:14:02.714934 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:02.715341 22004 raft_consensus.cc:2804] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:02.715553 21931 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:02.716899 21782 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 1.
I20260709 12:14:02.719343 21981 leader_election.cc:290] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 1 election: Requested vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.724054 21931 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 1.
I20260709 12:14:02.725057 22004 raft_consensus.cc:697] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Becoming Leader. State: Replica: e9283767a5f14728accf57b1406368d6, State: Running, Role: LEADER
I20260709 12:14:02.725953 21745 leader_election.cc:304] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad; no voters: 
I20260709 12:14:02.726248 22004 consensus_queue.cc:237] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.727392 21981 raft_consensus.cc:2804] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:02.728698 22007 consensus_queue.cc:1048] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:02.727380 21975 raft_consensus.cc:515] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.733363 21975 leader_election.cc:290] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.733951 21857 raft_consensus.cc:2393] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7986337a81e64cae874b6f69ed8f1378 in current term 1: Already voted for candidate e9283767a5f14728accf57b1406368d6 in this term.
I20260709 12:14:02.737193 21981 raft_consensus.cc:697] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 LEADER]: Becoming Leader. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Running, Role: LEADER
I20260709 12:14:02.738955 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:02.738754 21981 consensus_queue.cc:237] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:02.737131 21931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:02.745296 21931 raft_consensus.cc:2393] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e9283767a5f14728accf57b1406368d6 in current term 1: Already voted for candidate 7986337a81e64cae874b6f69ed8f1378 in this term.
I20260709 12:14:02.747198 21820 leader_election.cc:304] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9283767a5f14728accf57b1406368d6; no voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad
I20260709 12:14:02.748608 22004 raft_consensus.cc:2749] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:02.754563 21680 catalog_manager.cc:5697] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9283767a5f14728accf57b1406368d6 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e9283767a5f14728accf57b1406368d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.757892 21678 catalog_manager.cc:5697] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "7986337a81e64cae874b6f69ed8f1378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.790442 21930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008"
dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
mode: GRACEFUL
new_leader_uuid: "7986337a81e64cae874b6f69ed8f1378"
 from {username='slave'} at 127.0.0.1:42746
I20260709 12:14:02.791105 21930 raft_consensus.cc:606] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 LEADER]: Received request to transfer leadership to TS 7986337a81e64cae874b6f69ed8f1378
I20260709 12:14:02.798278 21979 consensus_queue.cc:1048] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:02.807822 21857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985ab1956c2343b28b5503903ed12289"
dest_uuid: "e9283767a5f14728accf57b1406368d6"
mode: GRACEFUL
new_leader_uuid: "bb19d4d5d5414edd959b506b80319cad"
 from {username='slave'} at 127.0.0.1:38876
I20260709 12:14:02.808784 21857 raft_consensus.cc:606] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Received request to transfer leadership to TS bb19d4d5d5414edd959b506b80319cad
I20260709 12:14:02.811848 21979 consensus_queue.cc:1048] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:02.821942 21857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300"
dest_uuid: "e9283767a5f14728accf57b1406368d6"
mode: GRACEFUL
new_leader_uuid: "7986337a81e64cae874b6f69ed8f1378"
 from {username='slave'} at 127.0.0.1:38876
I20260709 12:14:02.822680 21857 raft_consensus.cc:606] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Received request to transfer leadership to TS 7986337a81e64cae874b6f69ed8f1378
I20260709 12:14:02.826045 22017 raft_consensus.cc:993] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: : Instructing follower 7986337a81e64cae874b6f69ed8f1378 to start an election
I20260709 12:14:02.826635 21979 raft_consensus.cc:1081] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 LEADER]: Signalling peer 7986337a81e64cae874b6f69ed8f1378 to start an election
I20260709 12:14:02.828372 21782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008"
dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:14:02.828984 21782 raft_consensus.cc:493] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:02.829504 21782 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.837136 21782 raft_consensus.cc:515] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.839479 21782 leader_election.cc:290] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 2 election: Requested vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:02.840595 21930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:02.841042 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736565c9bdb04eefb241aa9d919dc008" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9283767a5f14728accf57b1406368d6"
I20260709 12:14:02.841413 21930 raft_consensus.cc:3055] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:02.841724 21857 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.841825 21930 raft_consensus.cc:740] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Running, Role: LEADER
I20260709 12:14:02.842872 21930 consensus_queue.cc:260] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.844404 21930 raft_consensus.cc:3060] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.850992 21857 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 2.
I20260709 12:14:02.852365 21745 leader_election.cc:304] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:02.853304 21981 raft_consensus.cc:2804] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:02.853853 21981 raft_consensus.cc:697] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 2 LEADER]: Becoming Leader. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Running, Role: LEADER
I20260709 12:14:02.854768 21930 raft_consensus.cc:2468] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 2.
I20260709 12:14:02.854771 21981 consensus_queue.cc:237] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } }
I20260709 12:14:02.862445 21678 catalog_manager.cc:5697] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 reported cstate change: term changed from 1 to 2, leader changed from bb19d4d5d5414edd959b506b80319cad (127.10.114.67) to 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "7986337a81e64cae874b6f69ed8f1378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.160175 22004 consensus_queue.cc:1048] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:03.172581 22004 consensus_queue.cc:1048] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:03.181048 22009 raft_consensus.cc:993] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: : Instructing follower 7986337a81e64cae874b6f69ed8f1378 to start an election
I20260709 12:14:03.181625 22004 raft_consensus.cc:1081] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Signalling peer 7986337a81e64cae874b6f69ed8f1378 to start an election
I20260709 12:14:03.183440 21782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300"
dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
 from {username='slave'} at 127.0.0.1:58234
I20260709 12:14:03.183996 21782 raft_consensus.cc:493] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.184321 21782 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.190465 21782 raft_consensus.cc:515] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.192634 21782 leader_election.cc:290] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 2 election: Requested vote from peers e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:03.193570 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9283767a5f14728accf57b1406368d6"
I20260709 12:14:03.193892 21930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4469b1e63f914d8fbe4b76f5d776c300" candidate_uuid: "7986337a81e64cae874b6f69ed8f1378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:03.194332 21857 raft_consensus.cc:3055] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.194459 21930 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.194733 21857 raft_consensus.cc:740] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Running, Role: LEADER
I20260709 12:14:03.195667 21857 consensus_queue.cc:260] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.197026 21857 raft_consensus.cc:3060] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.203051 21930 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 2.
I20260709 12:14:03.204687 21745 leader_election.cc:304] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad; no voters: 
I20260709 12:14:03.205281 21857 raft_consensus.cc:2468] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986337a81e64cae874b6f69ed8f1378 in term 2.
I20260709 12:14:03.205842 21981 raft_consensus.cc:2804] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.206686 21981 raft_consensus.cc:697] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 2 LEADER]: Becoming Leader. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Running, Role: LEADER
I20260709 12:14:03.207600 21981 consensus_queue.cc:237] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.215420 21678 catalog_manager.cc:5697] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 reported cstate change: term changed from 1 to 2, leader changed from e9283767a5f14728accf57b1406368d6 (127.10.114.66) to 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "7986337a81e64cae874b6f69ed8f1378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.268855 21981 consensus_queue.cc:1048] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:03.283882 21981 consensus_queue.cc:1048] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:03.318125 22009 raft_consensus.cc:993] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: : Instructing follower bb19d4d5d5414edd959b506b80319cad to start an election
I20260709 12:14:03.318811 22004 raft_consensus.cc:1081] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Signalling peer bb19d4d5d5414edd959b506b80319cad to start an election
I20260709 12:14:03.320485 21930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985ab1956c2343b28b5503903ed12289"
dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:14:03.321069 21930 raft_consensus.cc:493] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.321465 21930 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.327750 21930 raft_consensus.cc:515] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.329703 21930 leader_election.cc:290] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 2 election: Requested vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), e9283767a5f14728accf57b1406368d6 (127.10.114.66:46701)
I20260709 12:14:03.330678 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:03.330888 21857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ab1956c2343b28b5503903ed12289" candidate_uuid: "bb19d4d5d5414edd959b506b80319cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9283767a5f14728accf57b1406368d6"
I20260709 12:14:03.331494 21857 raft_consensus.cc:3055] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.331516 21782 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.331846 21857 raft_consensus.cc:740] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9283767a5f14728accf57b1406368d6, State: Running, Role: LEADER
I20260709 12:14:03.332655 21857 consensus_queue.cc:260] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.333820 21857 raft_consensus.cc:3060] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.338054 21782 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 2.
I20260709 12:14:03.339568 21897 leader_election.cc:304] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986337a81e64cae874b6f69ed8f1378, bb19d4d5d5414edd959b506b80319cad; no voters: 
I20260709 12:14:03.340492 21979 raft_consensus.cc:2804] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.340555 21857 raft_consensus.cc:2468] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb19d4d5d5414edd959b506b80319cad in term 2.
I20260709 12:14:03.341739 21979 raft_consensus.cc:697] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 LEADER]: Becoming Leader. State: Replica: bb19d4d5d5414edd959b506b80319cad, State: Running, Role: LEADER
I20260709 12:14:03.342630 21979 consensus_queue.cc:237] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.349606 21678 catalog_manager.cc:5697] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad reported cstate change: term changed from 1 to 2, leader changed from e9283767a5f14728accf57b1406368d6 (127.10.114.66) to bb19d4d5d5414edd959b506b80319cad (127.10.114.67). New cstate: current_term: 2 leader_uuid: "bb19d4d5d5414edd959b506b80319cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.356473 21930 raft_consensus.cc:1275] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Refusing update from remote peer 7986337a81e64cae874b6f69ed8f1378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.358263 21981 consensus_queue.cc:1048] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.367602 21857 raft_consensus.cc:1275] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Refusing update from remote peer 7986337a81e64cae874b6f69ed8f1378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.369601 21981 consensus_queue.cc:1048] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.580895 10697 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:14:03.582721 10697 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:14:03.583176 10697 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:14:03.596802 21782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf"
dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
mode: GRACEFUL
new_leader_uuid: "e9283767a5f14728accf57b1406368d6"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:14:03.597657 21782 raft_consensus.cc:606] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 LEADER]: Received request to transfer leadership to TS e9283767a5f14728accf57b1406368d6
I20260709 12:14:03.599210 10697 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:14:03.662146 21930 raft_consensus.cc:1275] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Refusing update from remote peer 7986337a81e64cae874b6f69ed8f1378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.663661 21981 consensus_queue.cc:1048] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.670014 21857 raft_consensus.cc:1275] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Refusing update from remote peer 7986337a81e64cae874b6f69ed8f1378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.672163 22022 consensus_queue.cc:1048] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.690662 21981 raft_consensus.cc:993] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: : Instructing follower e9283767a5f14728accf57b1406368d6 to start an election
I20260709 12:14:03.691256 22010 raft_consensus.cc:1081] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 LEADER]: Signalling peer e9283767a5f14728accf57b1406368d6 to start an election
I20260709 12:14:03.693265 21857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf"
dest_uuid: "e9283767a5f14728accf57b1406368d6"
 from {username='slave'} at 127.0.0.1:38872
I20260709 12:14:03.694021 21857 raft_consensus.cc:493] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.694484 21857 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.702571 21857 raft_consensus.cc:515] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.705534 21857 leader_election.cc:290] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 2 election: Requested vote from peers 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547), bb19d4d5d5414edd959b506b80319cad (127.10.114.67:39971)
I20260709 12:14:03.705794 21782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7986337a81e64cae874b6f69ed8f1378"
I20260709 12:14:03.706317 21930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd333778ebe7468789b5789f09a97faf" candidate_uuid: "e9283767a5f14728accf57b1406368d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb19d4d5d5414edd959b506b80319cad"
I20260709 12:14:03.706543 21782 raft_consensus.cc:3055] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.706990 21782 raft_consensus.cc:740] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7986337a81e64cae874b6f69ed8f1378, State: Running, Role: LEADER
I20260709 12:14:03.707038 21930 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.708035 21782 consensus_queue.cc:260] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.709721 21782 raft_consensus.cc:3060] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.715323 21930 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 2.
I20260709 12:14:03.716450 21782 raft_consensus.cc:2468] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9283767a5f14728accf57b1406368d6 in term 2.
I20260709 12:14:03.716958 21820 leader_election.cc:304] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb19d4d5d5414edd959b506b80319cad, e9283767a5f14728accf57b1406368d6; no voters: 
I20260709 12:14:03.717926 22004 raft_consensus.cc:2804] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.718432 22004 raft_consensus.cc:697] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 LEADER]: Becoming Leader. State: Replica: e9283767a5f14728accf57b1406368d6, State: Running, Role: LEADER
I20260709 12:14:03.719516 22004 consensus_queue.cc:237] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } }
I20260709 12:14:03.726960 21680 catalog_manager.cc:5697] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 reported cstate change: term changed from 1 to 2, leader changed from 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65) to e9283767a5f14728accf57b1406368d6 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e9283767a5f14728accf57b1406368d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986337a81e64cae874b6f69ed8f1378" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9283767a5f14728accf57b1406368d6" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb19d4d5d5414edd959b506b80319cad" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.759091 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
I20260709 12:14:03.782886 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:03.783595 10697 tablet_replica.cc:333] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378: stopping tablet replica
I20260709 12:14:03.784224 10697 raft_consensus.cc:2243] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.784690 10697 raft_consensus.cc:2272] T bd333778ebe7468789b5789f09a97faf P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.787295 10697 tablet_replica.cc:333] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378: stopping tablet replica
I20260709 12:14:03.787899 10697 raft_consensus.cc:2243] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.788772 10697 raft_consensus.cc:2272] T 736565c9bdb04eefb241aa9d919dc008 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.791352 10697 tablet_replica.cc:333] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378: stopping tablet replica
I20260709 12:14:03.791925 10697 raft_consensus.cc:2243] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.792826 10697 raft_consensus.cc:2272] T 4469b1e63f914d8fbe4b76f5d776c300 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.795456 10697 tablet_replica.cc:333] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378: stopping tablet replica
I20260709 12:14:03.795991 10697 raft_consensus.cc:2243] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.796427 10697 raft_consensus.cc:2272] T 985ab1956c2343b28b5503903ed12289 P 7986337a81e64cae874b6f69ed8f1378 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.821846 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
I20260709 12:14:03.836149 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
I20260709 12:14:03.856477 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:03.857242 10697 tablet_replica.cc:333] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6: stopping tablet replica
I20260709 12:14:03.857928 10697 raft_consensus.cc:2243] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.858475 10697 raft_consensus.cc:2272] T 4469b1e63f914d8fbe4b76f5d776c300 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.860991 10697 tablet_replica.cc:333] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6: stopping tablet replica
I20260709 12:14:03.861639 10697 raft_consensus.cc:2243] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.862056 10697 raft_consensus.cc:2272] T 985ab1956c2343b28b5503903ed12289 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.864090 10697 tablet_replica.cc:333] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: stopping tablet replica
I20260709 12:14:03.864706 10697 raft_consensus.cc:2243] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.865357 10697 pending_rounds.cc:70] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Trying to abort 1 pending ops.
I20260709 12:14:03.865619 10697 pending_rounds.cc:77] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622502283825152 op_type: NO_OP noop_request { }
I20260709 12:14:03.865953 10697 raft_consensus.cc:2889] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:03.866236 10697 raft_consensus.cc:2272] T bd333778ebe7468789b5789f09a97faf P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.869247 10697 tablet_replica.cc:333] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6: stopping tablet replica
I20260709 12:14:03.869839 10697 raft_consensus.cc:2243] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.870296 10697 raft_consensus.cc:2272] T 736565c9bdb04eefb241aa9d919dc008 P e9283767a5f14728accf57b1406368d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.885139 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:14:03.899751 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
I20260709 12:14:03.921618 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:03.922422 10697 tablet_replica.cc:333] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad: stopping tablet replica
I20260709 12:14:03.923271 10697 raft_consensus.cc:2243] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.923861 10697 raft_consensus.cc:2272] T bd333778ebe7468789b5789f09a97faf P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.927561 10697 tablet_replica.cc:333] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad: stopping tablet replica
I20260709 12:14:03.928499 10697 raft_consensus.cc:2243] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.929133 10697 raft_consensus.cc:2272] T 736565c9bdb04eefb241aa9d919dc008 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:03.931105 21897 consensus_peers.cc:597] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad -> Peer 7986337a81e64cae874b6f69ed8f1378 (127.10.114.65:38547): Couldn't send request to peer 7986337a81e64cae874b6f69ed8f1378. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.932165 10697 tablet_replica.cc:333] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad: stopping tablet replica
I20260709 12:14:03.932804 10697 raft_consensus.cc:2243] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.933471 10697 raft_consensus.cc:2272] T 4469b1e63f914d8fbe4b76f5d776c300 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.936187 10697 tablet_replica.cc:333] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: stopping tablet replica
I20260709 12:14:03.936688 10697 raft_consensus.cc:2243] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.937422 10697 pending_rounds.cc:70] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Trying to abort 1 pending ops.
I20260709 12:14:03.937676 10697 pending_rounds.cc:77] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622500739141632 op_type: NO_OP noop_request { }
I20260709 12:14:03.937944 10697 raft_consensus.cc:2889] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:03.938194 10697 raft_consensus.cc:2272] T 985ab1956c2343b28b5503903ed12289 P bb19d4d5d5414edd959b506b80319cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.962513 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:14:03.977016 10697 master.cc:562] Master@127.10.114.126:40723 shutting down...
I20260709 12:14:03.994160 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.994825 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.995168 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2ee7cd50ad79433a8360262995a759f6: stopping tablet replica
I20260709 12:14:04.008975 10697 master.cc:584] Master@127.10.114.126:40723 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2761 ms)
[----------] 6 tests from LeaderRebalancerTest (349820 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:14:04.041906 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:35205
I20260709 12:14:04.043097 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:04.048558 22029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.048687 22030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.051018 22032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.051640 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:04.052520 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:04.052700 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:04.052875 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599244052860 us; error 0 us; skew 500 ppm
I20260709 12:14:04.053387 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:04.056022 10697 webserver.cc:533] Webserver started at http://127.10.114.126:44177/ using document root <none> and password file <none>
I20260709 12:14:04.056598 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:04.056802 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:04.057046 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:04.058677 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.063409 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:04.067267 22037 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.068176 10697 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:14:04.068575 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.068926 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:04.079849 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:04.081071 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:04.123065 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:35205
I20260709 12:14:04.123215 22088 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:35205 every 8 connection(s)
I20260709 12:14:04.127736 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.142037 22089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: Bootstrap starting.
I20260709 12:14:04.147955 22089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:04.152961 22089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: No bootstrap required, opened a new log
I20260709 12:14:04.155771 22089 raft_consensus.cc:359] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER }
I20260709 12:14:04.156306 22089 raft_consensus.cc:385] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:04.156579 22089 raft_consensus.cc:740] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996d4b1c7c8c4df0af9fe32ede04d4c3, State: Initialized, Role: FOLLOWER
I20260709 12:14:04.157312 22089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER }
I20260709 12:14:04.157917 22089 raft_consensus.cc:399] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:04.158176 22089 raft_consensus.cc:493] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:04.158560 22089 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:04.164708 22089 raft_consensus.cc:515] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER }
I20260709 12:14:04.165414 22089 leader_election.cc:304] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 996d4b1c7c8c4df0af9fe32ede04d4c3; no voters: 
I20260709 12:14:04.166884 22089 leader_election.cc:290] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:04.167296 22092 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:04.168792 22092 raft_consensus.cc:697] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 1 LEADER]: Becoming Leader. State: Replica: 996d4b1c7c8c4df0af9fe32ede04d4c3, State: Running, Role: LEADER
I20260709 12:14:04.169525 22092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER }
I20260709 12:14:04.170764 22089 sys_catalog.cc:565] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:04.173069 22093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER } }
I20260709 12:14:04.173094 22094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 996d4b1c7c8c4df0af9fe32ede04d4c3. Latest consensus state: current_term: 1 leader_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996d4b1c7c8c4df0af9fe32ede04d4c3" member_type: VOTER } }
I20260709 12:14:04.174067 22094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:04.174074 22093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:04.178637 22096 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:04.183653 22096 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:04.189371 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:04.194172 22096 catalog_manager.cc:1383] Generated new cluster ID: 13d9c024fc9d48dd83ccd4be8355562c
I20260709 12:14:04.194504 22096 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:04.213349 22096 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:04.214879 22096 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:04.229032 22096 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: Generated new TSK 0
I20260709 12:14:04.229789 22096 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:04.256723 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:04.263676 22110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.264699 22111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.266079 22113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.267282 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:04.268280 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:04.268481 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:04.268612 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599244268600 us; error 0 us; skew 500 ppm
I20260709 12:14:04.269135 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:04.271922 10697 webserver.cc:533] Webserver started at http://127.10.114.65:39383/ using document root <none> and password file <none>
I20260709 12:14:04.272641 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:04.272827 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:04.273065 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:04.274305 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "aff3570d1f334780b5657a30a21bc640"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.279311 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:04.283263 22118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.284173 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:04.284519 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "aff3570d1f334780b5657a30a21bc640"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.284824 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:04.304780 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:04.306298 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:04.308053 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:04.310719 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:04.310983 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.311247 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:04.311436 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.358373 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:34213
I20260709 12:14:04.358508 22180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:34213 every 8 connection(s)
I20260709 12:14:04.363834 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:04.373281 22185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.375340 22186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.379455 22181 heartbeater.cc:344] Connected to a master server at 127.10.114.126:35205
I20260709 12:14:04.380187 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:04.380254 22181 heartbeater.cc:461] Registering TS with master...
W20260709 12:14:04.380966 22188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.381745 22181 heartbeater.cc:507] Master 127.10.114.126:35205 requested a full tablet report, sending...
I20260709 12:14:04.382731 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:04.383064 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:04.383291 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599244383273 us; error 0 us; skew 500 ppm
I20260709 12:14:04.384121 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:04.384591 22054 ts_manager.cc:194] Registered new tserver with Master: aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213)
I20260709 12:14:04.387521 10697 webserver.cc:533] Webserver started at http://127.10.114.66:33629/ using document root <none> and password file <none>
I20260709 12:14:04.387632 22054 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44682
I20260709 12:14:04.388515 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:04.388823 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:04.389183 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:04.390882 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "e5ce09705334405f86b6cdc8edcbc285"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.395853 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:04.399516 22193 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.400681 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:04.400949 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "e5ce09705334405f86b6cdc8edcbc285"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.401292 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:04.417083 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:04.418426 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:04.419984 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:04.422621 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:04.422838 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.423161 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:04.423321 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.468231 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:46269
I20260709 12:14:04.468358 22255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:46269 every 8 connection(s)
I20260709 12:14:04.473784 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:04.482110 22259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:04.484309 22260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.488420 10697 server_base.cc:1061] running on GCE node
W20260709 12:14:04.488490 22262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:04.489218 22256 heartbeater.cc:344] Connected to a master server at 127.10.114.126:35205
I20260709 12:14:04.490023 22256 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:04.490610 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:04.490962 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:04.491107 22256 heartbeater.cc:507] Master 127.10.114.126:35205 requested a full tablet report, sending...
I20260709 12:14:04.491209 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599244491185 us; error 0 us; skew 500 ppm
I20260709 12:14:04.492223 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:04.493913 22054 ts_manager.cc:194] Registered new tserver with Master: e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:04.495368 10697 webserver.cc:533] Webserver started at http://127.10.114.67:42939/ using document root <none> and password file <none>
I20260709 12:14:04.495492 22054 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44688
I20260709 12:14:04.496026 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:04.496296 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:04.496644 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:04.498054 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "2b9dde5c4f214924a3e28f74351d72eb"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.503428 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:04.507196 22267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.508195 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:04.508636 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "2b9dde5c4f214924a3e28f74351d72eb"
format_stamp: "Formatted at 2026-07-09 12:14:04 on dist-test-slave-08l4"
I20260709 12:14:04.508947 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:04.527191 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:04.528523 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:04.530200 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:04.532959 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:04.533174 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:04.533496 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:04.533671 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:04.581779 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:40553
I20260709 12:14:04.581897 22329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:40553 every 8 connection(s)
I20260709 12:14:04.597651 22330 heartbeater.cc:344] Connected to a master server at 127.10.114.126:35205
I20260709 12:14:04.598312 22330 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:04.599210 22330 heartbeater.cc:507] Master 127.10.114.126:35205 requested a full tablet report, sending...
I20260709 12:14:04.601670 22054 ts_manager.cc:194] Registered new tserver with Master: 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:04.602618 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017192345s
I20260709 12:14:04.603468 22054 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44700
I20260709 12:14:04.632037 22054 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:04.634948 22054 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:04.707648 22295 tablet_service.cc:1511] Processing CreateTablet for tablet daa244f418d04148b0435b1f17b71534 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.709304 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa244f418d04148b0435b1f17b71534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.712589 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 76b1897177794a36b78693d594d976ad (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.714843 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b1897177794a36b78693d594d976ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.723551 22293 tablet_service.cc:1511] Processing CreateTablet for tablet a3854f00958e4ced815c758230862f17 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.725298 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3854f00958e4ced815c758230862f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.731011 22292 tablet_service.cc:1511] Processing CreateTablet for tablet f86c7d7a9a8c4c959a2dbbc669d195bc (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.732720 22292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86c7d7a9a8c4c959a2dbbc669d195bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.734889 22146 tablet_service.cc:1511] Processing CreateTablet for tablet daa244f418d04148b0435b1f17b71534 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.738932 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa244f418d04148b0435b1f17b71534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.740296 22145 tablet_service.cc:1511] Processing CreateTablet for tablet 76b1897177794a36b78693d594d976ad (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.740911 22143 tablet_service.cc:1511] Processing CreateTablet for tablet f86c7d7a9a8c4c959a2dbbc669d195bc (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.742163 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b1897177794a36b78693d594d976ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.742959 22143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86c7d7a9a8c4c959a2dbbc669d195bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.744369 22144 tablet_service.cc:1511] Processing CreateTablet for tablet a3854f00958e4ced815c758230862f17 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.746232 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3854f00958e4ced815c758230862f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.771835 22142 tablet_service.cc:1511] Processing CreateTablet for tablet ac18649239a34d48b6ebd3fa05651847 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.776822 22291 tablet_service.cc:1511] Processing CreateTablet for tablet ac18649239a34d48b6ebd3fa05651847 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.778661 22291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac18649239a34d48b6ebd3fa05651847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.780107 22141 tablet_service.cc:1511] Processing CreateTablet for tablet e4303a3a87f349cdb3a21e89acacb43d (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.782919 22141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4303a3a87f349cdb3a21e89acacb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.787282 22142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac18649239a34d48b6ebd3fa05651847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.801205 22294 tablet_service.cc:1511] Processing CreateTablet for tablet e4303a3a87f349cdb3a21e89acacb43d (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.803067 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4303a3a87f349cdb3a21e89acacb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.809346 22345 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:04.810775 22346 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:04.818200 22346 tablet_bootstrap.cc:654] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:04.819123 22144 tablet_service.cc:1511] Processing CreateTablet for tablet b8667f7d6fc24ab5953a0cb0b728f28c (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.820009 22292 tablet_service.cc:1511] Processing CreateTablet for tablet b8667f7d6fc24ab5953a0cb0b728f28c (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.820952 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8667f7d6fc24ab5953a0cb0b728f28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.821720 22292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8667f7d6fc24ab5953a0cb0b728f28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.823654 22221 tablet_service.cc:1511] Processing CreateTablet for tablet daa244f418d04148b0435b1f17b71534 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.825112 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa244f418d04148b0435b1f17b71534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.825935 22216 tablet_service.cc:1511] Processing CreateTablet for tablet e4303a3a87f349cdb3a21e89acacb43d (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.826721 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 76b1897177794a36b78693d594d976ad (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.827473 22216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4303a3a87f349cdb3a21e89acacb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.829066 22219 tablet_service.cc:1511] Processing CreateTablet for tablet a3854f00958e4ced815c758230862f17 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.830608 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3854f00958e4ced815c758230862f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.830858 22215 tablet_service.cc:1511] Processing CreateTablet for tablet b8667f7d6fc24ab5953a0cb0b728f28c (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.832651 22215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8667f7d6fc24ab5953a0cb0b728f28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.833416 22218 tablet_service.cc:1511] Processing CreateTablet for tablet f86c7d7a9a8c4c959a2dbbc669d195bc (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.835554 22218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86c7d7a9a8c4c959a2dbbc669d195bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.835117 22217 tablet_service.cc:1511] Processing CreateTablet for tablet ac18649239a34d48b6ebd3fa05651847 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.837026 22217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac18649239a34d48b6ebd3fa05651847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.839507 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b1897177794a36b78693d594d976ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.848830 22345 tablet_bootstrap.cc:654] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:04.853349 22143 tablet_service.cc:1511] Processing CreateTablet for tablet 131f1a7a55c04d9fbc603cf478a569e9 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:04.854925 22143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131f1a7a55c04d9fbc603cf478a569e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.861575 22214 tablet_service.cc:1511] Processing CreateTablet for tablet 131f1a7a55c04d9fbc603cf478a569e9 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:04.863247 22214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131f1a7a55c04d9fbc603cf478a569e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.870136 22291 tablet_service.cc:1511] Processing CreateTablet for tablet 131f1a7a55c04d9fbc603cf478a569e9 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:04.871698 22291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131f1a7a55c04d9fbc603cf478a569e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.885658 22213 tablet_service.cc:1511] Processing CreateTablet for tablet 43b23f9361e84944b27370b728f811c6 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:04.887202 22213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b23f9361e84944b27370b728f811c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.887662 22141 tablet_service.cc:1511] Processing CreateTablet for tablet 43b23f9361e84944b27370b728f811c6 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:04.889127 22141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b23f9361e84944b27370b728f811c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.900504 22345 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:04.901225 22345 ts_tablet_manager.cc:1403] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.007s
I20260709 12:14:04.914450 22295 tablet_service.cc:1511] Processing CreateTablet for tablet 43b23f9361e84944b27370b728f811c6 (DEFAULT_TABLE table=test-workload [id=78a2852beae547d6911977bf463473d3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:04.915998 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b23f9361e84944b27370b728f811c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.921433 22345 raft_consensus.cc:359] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:04.922561 22345 raft_consensus.cc:385] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:04.922860 22345 raft_consensus.cc:740] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:04.923754 22345 consensus_queue.cc:260] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:04.927649 22330 heartbeater.cc:499] Master 127.10.114.126:35205 was elected leader, sending a full tablet report...
I20260709 12:14:04.933707 22345 ts_tablet_manager.cc:1434] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 12:14:04.935906 22345 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:04.988956 22345 tablet_bootstrap.cc:654] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:04.989413 22346 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:04.990350 22346 ts_tablet_manager.cc:1403] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.012s
I20260709 12:14:04.995715 22346 raft_consensus.cc:359] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:04.996879 22346 raft_consensus.cc:385] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:04.997257 22346 raft_consensus.cc:740] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:04.999985 22346 consensus_queue.cc:260] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.054339 22345 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.055850 22345 ts_tablet_manager.cc:1403] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.014s
I20260709 12:14:05.056137 22181 heartbeater.cc:499] Master 127.10.114.126:35205 was elected leader, sending a full tablet report...
I20260709 12:14:05.057178 22346 ts_tablet_manager.cc:1434] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.008s
I20260709 12:14:05.059845 22346 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.063585 22345 raft_consensus.cc:359] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.064805 22345 raft_consensus.cc:385] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.065115 22345 raft_consensus.cc:740] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.071623 22346 tablet_bootstrap.cc:654] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.073032 22350 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.082827 22346 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.083660 22346 ts_tablet_manager.cc:1403] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 12:14:05.083701 22345 consensus_queue.cc:260] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.084841 22350 tablet_bootstrap.cc:654] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.088285 22346 raft_consensus.cc:359] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.089357 22346 raft_consensus.cc:385] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.089856 22346 raft_consensus.cc:740] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.091306 22346 consensus_queue.cc:260] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.095042 22345 ts_tablet_manager.cc:1434] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.004s
I20260709 12:14:05.095184 22346 ts_tablet_manager.cc:1434] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.005s
I20260709 12:14:05.096814 22345 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.097064 22346 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.109611 22346 tablet_bootstrap.cc:654] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.115025 22345 tablet_bootstrap.cc:654] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.118996 22350 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.118983 22346 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.119735 22350 ts_tablet_manager.cc:1403] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.021s
I20260709 12:14:05.119728 22346 ts_tablet_manager.cc:1403] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 12:14:05.122967 22345 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.123524 22345 ts_tablet_manager.cc:1403] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:14:05.124156 22350 raft_consensus.cc:359] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.125066 22350 raft_consensus.cc:385] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.125365 22350 raft_consensus.cc:740] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.126240 22346 raft_consensus.cc:359] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.126335 22350 consensus_queue.cc:260] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.126643 22345 raft_consensus.cc:359] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.127198 22346 raft_consensus.cc:385] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.127403 22345 raft_consensus.cc:385] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.127592 22346 raft_consensus.cc:740] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.127807 22345 raft_consensus.cc:740] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.128885 22346 consensus_queue.cc:260] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.129423 22256 heartbeater.cc:499] Master 127.10.114.126:35205 was elected leader, sending a full tablet report...
I20260709 12:14:05.129695 22350 ts_tablet_manager.cc:1434] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.005s
I20260709 12:14:05.133216 22353 raft_consensus.cc:493] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.140190 22353 raft_consensus.cc:515] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.141119 22346 ts_tablet_manager.cc:1434] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:14:05.142894 22346 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.129313 22345 consensus_queue.cc:260] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.148754 22345 ts_tablet_manager.cc:1434] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 12:14:05.152171 22346 tablet_bootstrap.cc:654] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.152408 22345 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.152913 22353 leader_election.cc:290] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.158823 22350 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.169708 22345 tablet_bootstrap.cc:654] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.180612 22350 tablet_bootstrap.cc:654] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:05.184051 22102 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:05.195521 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:05.196691 22305 raft_consensus.cc:2468] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:05.198820 22345 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.199496 22345 ts_tablet_manager.cc:1403] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.000s
I20260709 12:14:05.198906 22121 leader_election.cc:304] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.200572 22353 raft_consensus.cc:2804] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.201005 22353 raft_consensus.cc:493] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.201376 22353 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.202522 22346 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.203204 22346 ts_tablet_manager.cc:1403] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.021s
I20260709 12:14:05.207135 22346 raft_consensus.cc:359] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.208038 22346 raft_consensus.cc:385] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.208393 22346 raft_consensus.cc:740] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.209185 22346 consensus_queue.cc:260] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.215811 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.216418 22353 raft_consensus.cc:515] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
W20260709 12:14:05.217444 22120 leader_election.cc:343] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.219583 22345 raft_consensus.cc:359] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.220463 22345 raft_consensus.cc:385] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.220813 22345 raft_consensus.cc:740] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.221894 22345 consensus_queue.cc:260] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.222334 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.222889 22353 leader_election.cc:290] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.224295 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:05.224982 22305 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:05.225207 22120 leader_election.cc:343] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.222296 22350 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.228068 22345 ts_tablet_manager.cc:1434] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 12:14:05.229060 22350 ts_tablet_manager.cc:1403] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.009s
I20260709 12:14:05.229808 22345 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.233484 22350 raft_consensus.cc:359] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.234347 22350 raft_consensus.cc:385] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.234649 22350 raft_consensus.cc:740] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.235643 22350 consensus_queue.cc:260] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.237725 22305 raft_consensus.cc:2468] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:05.238124 22350 ts_tablet_manager.cc:1434] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:05.239058 22345 tablet_bootstrap.cc:654] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.239463 22350 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.239897 22346 ts_tablet_manager.cc:1434] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.014s
I20260709 12:14:05.241268 22346 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.250746 22121 leader_election.cc:304] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:05.251789 22353 raft_consensus.cc:2804] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.250792 22351 raft_consensus.cc:493] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.252068 22350 tablet_bootstrap.cc:654] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.252274 22346 tablet_bootstrap.cc:654] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.252439 22353 raft_consensus.cc:697] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:05.252918 22351 raft_consensus.cc:515] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.254161 22353 consensus_queue.cc:237] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.265430 22346 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.266217 22346 ts_tablet_manager.cc:1403] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 12:14:05.266533 22350 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.267215 22350 ts_tablet_manager.cc:1403] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:14:05.269759 22351 leader_election.cc:290] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:05.270054 22346 raft_consensus.cc:359] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.270951 22346 raft_consensus.cc:385] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.271288 22346 raft_consensus.cc:740] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.271149 22350 raft_consensus.cc:359] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.272285 22350 raft_consensus.cc:385] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.272794 22350 raft_consensus.cc:740] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.272260 22346 consensus_queue.cc:260] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.273869 22350 consensus_queue.cc:260] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.275609 22346 ts_tablet_manager.cc:1434] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:14:05.276976 22346 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.279300 22345 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.284737 22351 raft_consensus.cc:493] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.284930 22346 tablet_bootstrap.cc:654] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.285624 22345 ts_tablet_manager.cc:1403] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.003s
I20260709 12:14:05.282784 22350 ts_tablet_manager.cc:1434] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 12:14:05.283078 22052 catalog_manager.cc:5697] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.289520 22351 raft_consensus.cc:515] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.294687 22350 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.293164 22351 leader_election.cc:290] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:05.289863 22345 raft_consensus.cc:359] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.302515 22345 raft_consensus.cc:385] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.305043 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.307018 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.309360 22155 raft_consensus.cc:2468] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
W20260709 12:14:05.311343 22268 leader_election.cc:343] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.312282 22268 leader_election.cc:304] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.313261 22345 raft_consensus.cc:740] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.314384 22345 consensus_queue.cc:260] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.314788 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.316704 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.318513 22351 raft_consensus.cc:2804] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.319118 22351 raft_consensus.cc:493] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.319576 22351 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:05.320856 22269 leader_election.cc:343] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.322867 22269 leader_election.cc:304] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb; no voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:05.319542 22350 tablet_bootstrap.cc:654] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:05.334120 22269 leader_election.cc:343] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.337212 22351 raft_consensus.cc:515] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.338615 22346 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.339241 22346 ts_tablet_manager.cc:1403] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.032s
I20260709 12:14:05.340792 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:05.341521 22155 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.342936 22346 raft_consensus.cc:359] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.343837 22346 raft_consensus.cc:385] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.344156 22346 raft_consensus.cc:740] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.348644 22358 raft_consensus.cc:493] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.349442 22358 raft_consensus.cc:515] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.352993 22155 raft_consensus.cc:2468] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:05.354012 22346 consensus_queue.cc:260] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.355090 22268 leader_election.cc:304] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.359462 22346 ts_tablet_manager.cc:1434] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:14:05.360333 22379 raft_consensus.cc:2749] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.361052 22346 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.361202 22379 raft_consensus.cc:2804] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.361821 22379 raft_consensus.cc:697] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:05.364322 22351 leader_election.cc:290] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:05.364943 22350 tablet_bootstrap.cc:492] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.369334 22350 ts_tablet_manager.cc:1403] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.013s
I20260709 12:14:05.369657 22379 consensus_queue.cc:237] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.370782 22346 tablet_bootstrap.cc:654] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.372864 22350 raft_consensus.cc:359] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.373776 22350 raft_consensus.cc:385] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.374208 22350 raft_consensus.cc:740] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.376513 22350 consensus_queue.cc:260] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.366055 22358 leader_election.cc:290] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.388514 22350 ts_tablet_manager.cc:1434] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:14:05.391763 22350 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
W20260709 12:14:05.392966 22269 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.10.114.126:35205, user_credentials={real_user=slave}} blocked reactor thread for 45295.4us
I20260709 12:14:05.395354 22346 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.395186 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.395910 22230 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.399819 22350 tablet_bootstrap.cc:654] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.409106 22350 tablet_bootstrap.cc:492] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.409858 22350 ts_tablet_manager.cc:1403] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:14:05.412295 22376 raft_consensus.cc:493] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.410844 22052 catalog_manager.cc:5697] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 1 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.413021 22376 raft_consensus.cc:515] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.413784 22350 raft_consensus.cc:359] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.414686 22350 raft_consensus.cc:385] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.415040 22350 raft_consensus.cc:740] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.416775 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.417676 22155 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
I20260709 12:14:05.419255 22268 leader_election.cc:304] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.420228 22379 raft_consensus.cc:2804] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.420599 22379 raft_consensus.cc:493] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.420899 22379 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.416036 22350 consensus_queue.cc:260] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.422277 22351 raft_consensus.cc:493] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.423069 22351 raft_consensus.cc:515] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.424602 22350 ts_tablet_manager.cc:1434] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:14:05.395946 22346 ts_tablet_manager.cc:1403] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.018s
I20260709 12:14:05.431878 22351 leader_election.cc:290] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213)
I20260709 12:14:05.433391 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.434233 22155 raft_consensus.cc:2468] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
I20260709 12:14:05.435832 22268 leader_election.cc:304] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.436734 22376 leader_election.cc:290] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:05.437444 22351 raft_consensus.cc:2804] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.437948 22350 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.438308 22351 raft_consensus.cc:493] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.438920 22351 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.440999 22379 raft_consensus.cc:515] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.443665 22345 ts_tablet_manager.cc:1434] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.158s	user 0.046s	sys 0.063s
I20260709 12:14:05.444566 22230 raft_consensus.cc:2468] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:05.445235 22345 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.447485 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.448415 22231 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
I20260709 12:14:05.448575 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.447569 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:05.449501 22155 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.450256 22379 leader_election.cc:290] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:05.451081 22350 tablet_bootstrap.cc:654] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.442790 22346 raft_consensus.cc:359] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.453876 22346 raft_consensus.cc:385] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.456143 22346 raft_consensus.cc:740] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.455003 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.457271 22230 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.457473 22346 consensus_queue.cc:260] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
W20260709 12:14:05.455466 22269 leader_election.cc:343] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.454299 22345 tablet_bootstrap.cc:654] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.469257 22346 ts_tablet_manager.cc:1434] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.004s
I20260709 12:14:05.471269 22346 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.478417 22155 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:05.481408 22268 leader_election.cc:304] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:05.482621 22379 raft_consensus.cc:2804] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.483219 22379 raft_consensus.cc:697] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:05.484264 22379 consensus_queue.cc:237] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.485491 22346 tablet_bootstrap.cc:654] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.485954 22350 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.486619 22353 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.486653 22350 ts_tablet_manager.cc:1403] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.026s
I20260709 12:14:05.487301 22353 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.491271 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.492167 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:05.492285 22231 raft_consensus.cc:2468] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
W20260709 12:14:05.494351 22121 leader_election.cc:343] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.495272 22120 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:05.496716 22364 raft_consensus.cc:2804] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.497231 22364 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.496467 22350 raft_consensus.cc:359] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.497678 22364 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.498006 22350 raft_consensus.cc:385] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.498471 22350 raft_consensus.cc:740] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.499811 22350 consensus_queue.cc:260] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.501747 22353 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.507053 22345 tablet_bootstrap.cc:492] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.507755 22345 ts_tablet_manager.cc:1403] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.007s
I20260709 12:14:05.509907 22350 ts_tablet_manager.cc:1434] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.008s
I20260709 12:14:05.511741 22350 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.511562 22345 raft_consensus.cc:359] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.513738 22345 raft_consensus.cc:385] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.512850 22054 catalog_manager.cc:5697] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 1 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.522433 22350 tablet_bootstrap.cc:654] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.515002 22346 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.523536 22346 ts_tablet_manager.cc:1403] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.022s
I20260709 12:14:05.527282 22346 raft_consensus.cc:359] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.531242 22346 raft_consensus.cc:385] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.531740 22346 raft_consensus.cc:740] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.532819 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8667f7d6fc24ab5953a0cb0b728f28c" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:05.532985 22346 consensus_queue.cc:260] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.509936 22364 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.536834 22346 ts_tablet_manager.cc:1434] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:14:05.537107 22364 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.515791 22230 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:05.538414 22346 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:05.538964 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.539166 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:05.539678 22231 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:05.541379 22121 leader_election.cc:343] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.543341 22382 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.543951 22382 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.521196 22345 raft_consensus.cc:740] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.545251 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8667f7d6fc24ab5953a0cb0b728f28c" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.520987 22351 raft_consensus.cc:515] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.546036 22155 raft_consensus.cc:2468] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:05.546269 22345 consensus_queue.cc:260] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.547777 22194 leader_election.cc:304] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:05.547773 22305 raft_consensus.cc:2468] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:05.548542 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.549075 22345 ts_tablet_manager.cc:1434] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:14:05.549816 22382 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
W20260709 12:14:05.550017 22269 leader_election.cc:343] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.550236 22358 raft_consensus.cc:2804] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.550647 22358 raft_consensus.cc:493] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.550980 22358 raft_consensus.cc:3060] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.552277 22351 leader_election.cc:290] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213)
I20260709 12:14:05.552975 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:05.553754 22156 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.554991 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:05.555475 22345 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
W20260709 12:14:05.558674 22196 leader_election.cc:343] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.548173 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:05.560570 22155 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:05.562034 22194 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:05.563598 22382 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.564111 22382 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.564466 22382 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.563246 22358 raft_consensus.cc:515] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.567623 22345 tablet_bootstrap.cc:654] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.570691 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8667f7d6fc24ab5953a0cb0b728f28c" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:05.569037 22358 leader_election.cc:290] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.570068 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8667f7d6fc24ab5953a0cb0b728f28c" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:05.571385 22305 raft_consensus.cc:3060] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.571620 22155 raft_consensus.cc:3060] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.570564 22350 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.574360 22350 ts_tablet_manager.cc:1403] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.004s
I20260709 12:14:05.578363 22350 raft_consensus.cc:359] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.579207 22350 raft_consensus.cc:385] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.579535 22350 raft_consensus.cc:740] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.581039 22305 raft_consensus.cc:2468] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:05.581522 22382 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.582876 22196 leader_election.cc:304] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:05.584065 22156 raft_consensus.cc:2468] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:05.584299 22382 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.584969 22382 raft_consensus.cc:2804] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.585734 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:05.586292 22346 tablet_bootstrap.cc:654] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.586571 22154 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.587054 22231 raft_consensus.cc:2468] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:05.588654 22120 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:05.590255 22364 raft_consensus.cc:2804] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.590373 22268 leader_election.cc:304] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:05.590888 22155 raft_consensus.cc:2468] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:05.591085 22364 raft_consensus.cc:697] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:05.591921 22379 raft_consensus.cc:2804] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.592530 22379 raft_consensus.cc:697] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:05.593755 22379 consensus_queue.cc:237] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.592584 22364 consensus_queue.cc:237] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.585469 22382 raft_consensus.cc:697] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:05.601279 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
W20260709 12:14:05.603891 22196 leader_election.cc:343] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.602706 22382 consensus_queue.cc:237] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.592137 22350 consensus_queue.cc:260] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.619431 22052 catalog_manager.cc:5697] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.631913 22350 ts_tablet_manager.cc:1434] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.005s
I20260709 12:14:05.634106 22350 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.633919 22050 catalog_manager.cc:5697] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 1 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.639088 22154 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:05.640694 22194 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:05.641722 22346 tablet_bootstrap.cc:492] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:05.642292 22346 ts_tablet_manager.cc:1403] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.020s
W20260709 12:14:05.643440 22120 consensus_peers.cc:597] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 -> Peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Couldn't send request to peer e5ce09705334405f86b6cdc8edcbc285. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:05.644929 22346 raft_consensus.cc:359] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.645736 22346 raft_consensus.cc:385] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.646056 22346 raft_consensus.cc:740] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.645321 22052 catalog_manager.cc:5697] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.646763 22346 consensus_queue.cc:260] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.648857 22346 ts_tablet_manager.cc:1434] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:14:05.651186 22345 tablet_bootstrap.cc:492] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.651793 22345 ts_tablet_manager.cc:1403] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.028s
I20260709 12:14:05.652249 22382 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.652832 22382 raft_consensus.cc:697] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:05.653795 22382 consensus_queue.cc:237] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.655365 22345 raft_consensus.cc:359] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.656297 22345 raft_consensus.cc:385] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.656658 22345 raft_consensus.cc:740] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.657673 22345 consensus_queue.cc:260] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.658365 22350 tablet_bootstrap.cc:654] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.667399 22364 consensus_queue.cc:1048] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:05.670820 22345 ts_tablet_manager.cc:1434] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 12:14:05.676908 22345 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.691008 22052 catalog_manager.cc:5697] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.692369 22350 tablet_bootstrap.cc:492] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.693073 22350 ts_tablet_manager.cc:1403] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.059s	user 0.030s	sys 0.011s
I20260709 12:14:05.696353 22350 raft_consensus.cc:359] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.697321 22350 raft_consensus.cc:385] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.697715 22350 raft_consensus.cc:740] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.698710 22350 consensus_queue.cc:260] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.701052 22350 ts_tablet_manager.cc:1434] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:14:05.702304 22350 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:05.691061 22345 tablet_bootstrap.cc:654] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.708925 22345 tablet_bootstrap.cc:492] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.709517 22345 ts_tablet_manager.cc:1403] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 12:14:05.709954 22350 tablet_bootstrap.cc:654] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.712815 22345 raft_consensus.cc:359] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.713656 22345 raft_consensus.cc:385] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.713884 22345 raft_consensus.cc:740] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.714586 22345 consensus_queue.cc:260] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.714998 22350 tablet_bootstrap.cc:492] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:05.715593 22350 ts_tablet_manager.cc:1403] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:14:05.716302 22345 ts_tablet_manager.cc:1434] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:05.718282 22345 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:05.718552 22350 raft_consensus.cc:359] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.719365 22350 raft_consensus.cc:385] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.719684 22350 raft_consensus.cc:740] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.720597 22350 consensus_queue.cc:260] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:05.723033 22350 ts_tablet_manager.cc:1434] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:05.726655 22345 tablet_bootstrap.cc:654] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.732035 22345 tablet_bootstrap.cc:492] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:05.732630 22345 ts_tablet_manager.cc:1403] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:14:05.735843 22345 raft_consensus.cc:359] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.736588 22345 raft_consensus.cc:385] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.736868 22345 raft_consensus.cc:740] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.737761 22345 consensus_queue.cc:260] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.739534 22345 ts_tablet_manager.cc:1434] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:05.770092 22379 consensus_queue.cc:1048] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:05.782821 22376 consensus_queue.cc:1048] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:05.875742 22364 raft_consensus.cc:493] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.876307 22364 raft_consensus.cc:515] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.878197 22364 leader_election.cc:290] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.879304 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:05.879347 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:05.880307 22231 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:05.880363 22304 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:05.881709 22120 leader_election.cc:304] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:05.882534 22364 raft_consensus.cc:2804] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.882915 22364 raft_consensus.cc:493] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.883176 22364 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.889575 22364 raft_consensus.cc:515] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.891487 22364 leader_election.cc:290] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:05.892462 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:05.892680 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:05.893091 22231 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.893293 22304 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.900255 22231 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:05.900112 22376 consensus_queue.cc:1048] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:05.901250 22304 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:05.901743 22120 leader_election.cc:304] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:05.902735 22364 raft_consensus.cc:2804] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.903483 22364 raft_consensus.cc:697] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:05.904377 22364 consensus_queue.cc:237] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:05.914209 22052 catalog_manager.cc:5697] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.914889 22376 consensus_queue.cc:1048] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.008512 22382 raft_consensus.cc:493] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.009207 22382 raft_consensus.cc:515] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.011468 22382 leader_election.cc:290] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.012410 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:06.012646 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:06.013211 22154 raft_consensus.cc:2468] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:06.013376 22304 raft_consensus.cc:2468] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:06.014703 22194 leader_election.cc:304] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.015559 22382 raft_consensus.cc:2804] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.015923 22382 raft_consensus.cc:493] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.016175 22382 raft_consensus.cc:3060] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.023576 22376 consensus_queue.cc:1048] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.023576 22382 raft_consensus.cc:515] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.026234 22382 leader_election.cc:290] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.026998 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:06.027493 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac18649239a34d48b6ebd3fa05651847" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:06.027827 22155 raft_consensus.cc:3060] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.028185 22304 raft_consensus.cc:3060] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.029347 22305 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.034456 22382 consensus_queue.cc:1048] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.054598 22155 raft_consensus.cc:2468] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:06.056409 22194 leader_election.cc:304] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.057593 22382 raft_consensus.cc:2804] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.058133 22382 raft_consensus.cc:697] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:06.059262 22382 consensus_queue.cc:237] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.059975 22376 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.060623 22376 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.062266 22364 consensus_queue.cc:1048] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.064649 22304 raft_consensus.cc:2468] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:06.067871 22376 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:06.069567 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:06.070950 22231 raft_consensus.cc:2468] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:06.072778 22269 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.078640 22303 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.085800 22358 consensus_queue.cc:1048] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.088099 22231 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.095413 22379 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.096626 22358 consensus_queue.cc:1048] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.096385 22379 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.098698 22351 consensus_queue.cc:1048] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.103634 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:06.104640 22156 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:06.104797 22411 raft_consensus.cc:493] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.105475 22411 raft_consensus.cc:515] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.106354 22268 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:06.108312 22379 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:06.109113 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:06.112610 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:06.115445 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:06.117739 22303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:06.119616 22196 leader_election.cc:304] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640
I20260709 12:14:06.120813 22414 raft_consensus.cc:2749] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.122776 22376 raft_consensus.cc:2804] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:06.123884 22376 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader aff3570d1f334780b5657a30a21bc640)
I20260709 12:14:06.124280 22376 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.130753 22364 consensus_queue.cc:1048] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.116114 22411 leader_election.cc:290] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.135013 22376 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.138717 22376 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:06.140734 22229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:06.139688 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:06.145346 22351 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:06.146775 22351 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5ce09705334405f86b6cdc8edcbc285)
I20260709 12:14:06.147323 22351 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.152969 22268 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb; no voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:06.151768 22050 catalog_manager.cc:5697] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.161168 22305 raft_consensus.cc:1240] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Rejecting Update request from peer aff3570d1f334780b5657a30a21bc640 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.163765 22376 raft_consensus.cc:2749] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:06.169274 22382 consensus_queue.cc:1048] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.173794 22364 consensus_queue.cc:1059] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.187947 22351 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.189429 22304 raft_consensus.cc:1240] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Rejecting Update request from peer e5ce09705334405f86b6cdc8edcbc285 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.199002 22230 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.202174 22351 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:06.202795 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:06.205794 22420 raft_consensus.cc:3055] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.206497 22420 raft_consensus.cc:740] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:06.208084 22382 consensus_queue.cc:1059] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.209993 22420 consensus_queue.cc:260] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.211266 22411 raft_consensus.cc:3055] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.211859 22411 raft_consensus.cc:740] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:06.212754 22411 consensus_queue.cc:260] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.214214 22411 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.222553 22420 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.243772 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:06.245434 22268 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb; no voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:06.249915 22351 raft_consensus.cc:2749] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:06.271533 22304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daa244f418d04148b0435b1f17b71534"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
mode: GRACEFUL
new_leader_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:54732
I20260709 12:14:06.272310 22304 raft_consensus.cc:606] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Received request to transfer leadership to TS aff3570d1f334780b5657a30a21bc640
I20260709 12:14:06.280957 22304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3854f00958e4ced815c758230862f17"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
mode: GRACEFUL
new_leader_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:54732
I20260709 12:14:06.281621 22304 raft_consensus.cc:606] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Received request to transfer leadership to TS aff3570d1f334780b5657a30a21bc640
I20260709 12:14:06.287096 22304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
mode: GRACEFUL
new_leader_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:54732
I20260709 12:14:06.287678 22304 raft_consensus.cc:606] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Received request to transfer leadership to TS aff3570d1f334780b5657a30a21bc640
I20260709 12:14:06.287536 22422 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.303061 22422 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.315696 22156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:06.316438 22156 raft_consensus.cc:606] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:06.316836 22156 raft_consensus.cc:614] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:06.325999 22156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:06.326601 22156 raft_consensus.cc:606] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:06.341743 22230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b23f9361e84944b27370b728f811c6"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:46654
I20260709 12:14:06.342381 22230 raft_consensus.cc:606] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:06.342768 22230 raft_consensus.cc:614] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:06.417243 22376 raft_consensus.cc:993] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: : Instructing follower aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.417832 22351 raft_consensus.cc:1081] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Signalling peer aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.419510 22156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:14:06.420100 22156 raft_consensus.cc:493] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.420429 22156 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.426808 22156 raft_consensus.cc:515] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.429122 22156 leader_election.cc:290] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.430143 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:06.430467 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86c7d7a9a8c4c959a2dbbc669d195bc" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:06.430852 22230 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.431169 22304 raft_consensus.cc:3055] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.431504 22304 raft_consensus.cc:740] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:06.432252 22304 consensus_queue.cc:260] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.433341 22304 raft_consensus.cc:3060] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.436937 22230 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.438392 22120 leader_election.cc:304] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.439327 22420 raft_consensus.cc:2804] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.439782 22420 raft_consensus.cc:697] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:06.440074 22304 raft_consensus.cc:2468] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.440647 22420 consensus_queue.cc:237] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.447811 22051 catalog_manager.cc:5697] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.587172 22376 raft_consensus.cc:993] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: : Instructing follower aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.587779 22351 raft_consensus.cc:1081] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Signalling peer aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.589514 22156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daa244f418d04148b0435b1f17b71534"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:14:06.590148 22156 raft_consensus.cc:493] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.590476 22156 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.597128 22156 raft_consensus.cc:515] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:06.599488 22156 leader_election.cc:290] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:06.600255 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:06.600782 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa244f418d04148b0435b1f17b71534" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:06.601585 22230 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.602293 22411 consensus_queue.cc:1048] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.603355 22305 raft_consensus.cc:3055] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.603842 22305 raft_consensus.cc:740] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:06.604822 22305 consensus_queue.cc:260] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:06.606528 22305 raft_consensus.cc:3060] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.611064 22230 raft_consensus.cc:2468] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.612820 22120 leader_election.cc:304] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.613991 22420 raft_consensus.cc:2804] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.614560 22420 raft_consensus.cc:697] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:06.615670 22420 consensus_queue.cc:237] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } }
I20260709 12:14:06.616525 22305 raft_consensus.cc:2468] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.622156 22414 consensus_queue.cc:1048] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.628490 22050 catalog_manager.cc:5697] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.686242 22376 raft_consensus.cc:993] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: : Instructing follower aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.686898 22351 raft_consensus.cc:1081] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Signalling peer aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:06.688616 22156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3854f00958e4ced815c758230862f17"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:14:06.689186 22156 raft_consensus.cc:493] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.689627 22156 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.696276 22156 raft_consensus.cc:515] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.699296 22156 leader_election.cc:290] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.699451 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:06.700239 22230 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.701856 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3854f00958e4ced815c758230862f17" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:06.702689 22305 raft_consensus.cc:3055] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.703016 22305 raft_consensus.cc:740] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:06.703853 22305 consensus_queue.cc:260] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.705086 22305 raft_consensus.cc:3060] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.710776 22230 raft_consensus.cc:2468] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.711751 22231 raft_consensus.cc:1240] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Rejecting Update request from peer 2b9dde5c4f214924a3e28f74351d72eb for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.712990 22120 leader_election.cc:304] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.713948 22420 raft_consensus.cc:2804] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.714490 22305 raft_consensus.cc:2468] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:06.714531 22420 raft_consensus.cc:697] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:06.715863 22420 consensus_queue.cc:237] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.723222 22050 catalog_manager.cc:5697] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.842289 22231 raft_consensus.cc:1275] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:06.843459 22305 raft_consensus.cc:1275] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:06.843886 22420 consensus_queue.cc:1048] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.844878 22422 consensus_queue.cc:1048] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.865501 22422 raft_consensus.cc:993] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: : Instructing follower e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:06.866119 22422 raft_consensus.cc:1081] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:06.867772 22231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:46638
I20260709 12:14:06.868371 22231 raft_consensus.cc:493] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.868790 22231 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.875150 22231 raft_consensus.cc:515] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.876951 22231 leader_election.cc:290] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:06.878144 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:06.878146 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:06.879194 22305 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.879343 22156 raft_consensus.cc:3055] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.879810 22156 raft_consensus.cc:740] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:06.880599 22156 consensus_queue.cc:260] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.881736 22156 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.886929 22305 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:06.887732 22156 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:06.888378 22196 leader_election.cc:304] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:06.889323 22414 raft_consensus.cc:2804] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.889847 22414 raft_consensus.cc:697] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:06.890723 22414 consensus_queue.cc:237] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:06.898255 22050 catalog_manager.cc:5697] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.096517 22305 raft_consensus.cc:1275] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.097849 22353 consensus_queue.cc:1048] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.103109 22231 raft_consensus.cc:1275] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.105290 22420 consensus_queue.cc:1048] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.130404 22305 raft_consensus.cc:1275] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.131839 22420 consensus_queue.cc:1048] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.142473 22231 raft_consensus.cc:1275] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.144238 22422 consensus_queue.cc:1048] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.406394 22422 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.407158 22422 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.409350 22422 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:07.410400 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:07.410544 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:07.412103 22121 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aff3570d1f334780b5657a30a21bc640; no voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:07.412855 22422 raft_consensus.cc:2749] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:07.478722 22305 raft_consensus.cc:1275] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.480263 22437 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.491179 22156 raft_consensus.cc:1275] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.493697 22413 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.674121 22420 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5ce09705334405f86b6cdc8edcbc285)
I20260709 12:14:07.674719 22420 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.677053 22420 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:07.677855 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:07.678160 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:07.678771 22231 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:07.678962 22304 raft_consensus.cc:2393] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aff3570d1f334780b5657a30a21bc640 in current term 2: Already voted for candidate 2b9dde5c4f214924a3e28f74351d72eb in this term.
I20260709 12:14:07.680155 22120 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:07.680922 22420 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:07.681281 22420 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5ce09705334405f86b6cdc8edcbc285)
I20260709 12:14:07.681645 22420 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.687621 22420 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.689492 22420 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:07.690569 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:07.690623 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:07.691550 22304 raft_consensus.cc:2393] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aff3570d1f334780b5657a30a21bc640 in current term 2: Already voted for candidate 2b9dde5c4f214924a3e28f74351d72eb in this term.
I20260709 12:14:07.698432 22231 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:07.699703 22120 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:07.700518 22420 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.700978 22420 raft_consensus.cc:697] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:07.701925 22420 consensus_queue.cc:237] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.710101 22413 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aff3570d1f334780b5657a30a21bc640)
I20260709 12:14:07.709905 22050 catalog_manager.cc:5697] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.710800 22413 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.713011 22413 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:07.714433 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:07.714458 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:07.715334 22156 raft_consensus.cc:2468] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:07.715636 22304 raft_consensus.cc:2393] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5ce09705334405f86b6cdc8edcbc285 in current term 2: Already voted for candidate 2b9dde5c4f214924a3e28f74351d72eb in this term.
I20260709 12:14:07.716635 22194 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:07.717443 22413 raft_consensus.cc:2804] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:07.717857 22413 raft_consensus.cc:493] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aff3570d1f334780b5657a30a21bc640)
I20260709 12:14:07.718187 22413 raft_consensus.cc:3060] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.726205 22413 raft_consensus.cc:515] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.728215 22413 leader_election.cc:290] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:07.729137 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:07.729411 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4303a3a87f349cdb3a21e89acacb43d" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:07.730655 22304 raft_consensus.cc:2393] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5ce09705334405f86b6cdc8edcbc285 in current term 2: Already voted for candidate 2b9dde5c4f214924a3e28f74351d72eb in this term.
I20260709 12:14:07.736594 22156 raft_consensus.cc:2468] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:07.737921 22194 leader_election.cc:304] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:07.738731 22413 raft_consensus.cc:2804] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.739259 22413 raft_consensus.cc:697] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:07.740105 22413 consensus_queue.cc:237] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.748353 22050 catalog_manager.cc:5697] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.842087 22351 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.842844 22351 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.845073 22351 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:07.846156 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:07.846338 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:07.847047 22231 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:07.848163 22269 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: aff3570d1f334780b5657a30a21bc640
I20260709 12:14:07.848879 22351 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:07.849217 22351 raft_consensus.cc:493] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.849594 22351 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.855710 22351 raft_consensus.cc:515] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.857970 22351 leader_election.cc:290] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:07.858922 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:07.859273 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b23f9361e84944b27370b728f811c6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:07.859972 22230 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.865962 22230 raft_consensus.cc:2468] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 3.
I20260709 12:14:07.867034 22269 leader_election.cc:304] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: aff3570d1f334780b5657a30a21bc640
I20260709 12:14:07.867738 22351 raft_consensus.cc:2804] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:07.868692 22351 raft_consensus.cc:697] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:07.869664 22351 consensus_queue.cc:237] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:07.877146 22050 catalog_manager.cc:5697] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 2 to 3, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 3 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.119632 22304 raft_consensus.cc:1240] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Rejecting Update request from peer aff3570d1f334780b5657a30a21bc640 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:08.121374 22420 consensus_queue.cc:1059] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:08.122143 22420 consensus_queue.cc:1243] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Peer 2b9dde5c4f214924a3e28f74351d72eb log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:14:08.122607 22422 raft_consensus.cc:3055] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:08.122972 22422 raft_consensus.cc:740] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:08.123847 22422 consensus_queue.cc:260] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:08.125052 22422 raft_consensus.cc:3060] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.156953 22156 raft_consensus.cc:1275] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.158794 22413 consensus_queue.cc:1048] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.171381 22304 raft_consensus.cc:1275] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.173480 22414 consensus_queue.cc:1048] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.269801 22154 raft_consensus.cc:1275] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:08.270228 22154 pending_rounds.cc:85] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Aborting all ops after (but not including) 1
I20260709 12:14:08.270406 22154 pending_rounds.cc:107] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:08.270614 22154 raft_consensus.cc:2889] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:08.272074 22351 consensus_queue.cc:1048] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.283843 22230 raft_consensus.cc:1275] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:08.285663 22453 consensus_queue.cc:1048] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.376837 22051 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40344:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:09.380394 22051 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:09.442353 22141 tablet_service.cc:1511] Processing CreateTablet for tablet 059e5679a4c24b13b9c8090c4b74a502 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:09.444193 22141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059e5679a4c24b13b9c8090c4b74a502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.445894 22295 tablet_service.cc:1511] Processing CreateTablet for tablet 059e5679a4c24b13b9c8090c4b74a502 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:09.447391 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059e5679a4c24b13b9c8090c4b74a502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.447681 22142 tablet_service.cc:1511] Processing CreateTablet for tablet e08b81dffd094e38990e06fed528d424 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:09.449172 22142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08b81dffd094e38990e06fed528d424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.450191 22221 tablet_service.cc:1511] Processing CreateTablet for tablet e08b81dffd094e38990e06fed528d424 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:09.451788 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08b81dffd094e38990e06fed528d424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.443815 22214 tablet_service.cc:1511] Processing CreateTablet for tablet 059e5679a4c24b13b9c8090c4b74a502 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:09.454571 22214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059e5679a4c24b13b9c8090c4b74a502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.455211 22294 tablet_service.cc:1511] Processing CreateTablet for tablet e08b81dffd094e38990e06fed528d424 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:09.456749 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08b81dffd094e38990e06fed528d424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.460916 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:09.462662 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.466074 22143 tablet_service.cc:1511] Processing CreateTablet for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:09.467749 22143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.468618 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 35311c3332b7476391f6bb644082332b (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:09.469044 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 9a34ce800f0543dfb7cb650abc575974 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:09.466074 22217 tablet_service.cc:1511] Processing CreateTablet for tablet 9a34ce800f0543dfb7cb650abc575974 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:09.470278 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35311c3332b7476391f6bb644082332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.470446 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a34ce800f0543dfb7cb650abc575974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.471010 22217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a34ce800f0543dfb7cb650abc575974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.473301 22145 tablet_service.cc:1511] Processing CreateTablet for tablet 35311c3332b7476391f6bb644082332b (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:09.473794 22218 tablet_service.cc:1511] Processing CreateTablet for tablet cddde433c47a48c9844b301153ab4a64 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:09.474915 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35311c3332b7476391f6bb644082332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.475154 22218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddde433c47a48c9844b301153ab4a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.479485 22213 tablet_service.cc:1511] Processing CreateTablet for tablet 24f8b2dc5f1b49d98e910c10e2238eb6 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:09.481446 22213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f8b2dc5f1b49d98e910c10e2238eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.484403 22291 tablet_service.cc:1511] Processing CreateTablet for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:09.486400 22291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e159d2e8cc24f1fb2a5dcdcf41890ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.523012 22216 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdc0654f6b4c00af364eeac4f3f4ea (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:09.524751 22216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdc0654f6b4c00af364eeac4f3f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.529016 22215 tablet_service.cc:1511] Processing CreateTablet for tablet c8b89c116dab47b49115cd7a68bd7f49 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:09.530646 22215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b89c116dab47b49115cd7a68bd7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.535607 22146 tablet_service.cc:1511] Processing CreateTablet for tablet cddde433c47a48c9844b301153ab4a64 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:09.550194 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddde433c47a48c9844b301153ab4a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.560381 22292 tablet_service.cc:1511] Processing CreateTablet for tablet 9a34ce800f0543dfb7cb650abc575974 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:09.562840 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 35311c3332b7476391f6bb644082332b (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:09.565318 22290 tablet_service.cc:1511] Processing CreateTablet for tablet cddde433c47a48c9844b301153ab4a64 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:09.567507 22289 tablet_service.cc:1511] Processing CreateTablet for tablet 24f8b2dc5f1b49d98e910c10e2238eb6 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:09.569568 22288 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdc0654f6b4c00af364eeac4f3f4ea (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:09.571273 22140 tablet_service.cc:1511] Processing CreateTablet for tablet 24f8b2dc5f1b49d98e910c10e2238eb6 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:09.571710 22287 tablet_service.cc:1511] Processing CreateTablet for tablet c8b89c116dab47b49115cd7a68bd7f49 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:09.572885 22140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f8b2dc5f1b49d98e910c10e2238eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.573228 22292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a34ce800f0543dfb7cb650abc575974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.573462 22138 tablet_service.cc:1511] Processing CreateTablet for tablet c8b89c116dab47b49115cd7a68bd7f49 (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:09.574872 22138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b89c116dab47b49115cd7a68bd7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.571710 22139 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdc0654f6b4c00af364eeac4f3f4ea (DEFAULT_TABLE table=soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:09.578301 22139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdc0654f6b4c00af364eeac4f3f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.582916 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35311c3332b7476391f6bb644082332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.585572 22289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f8b2dc5f1b49d98e910c10e2238eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.586500 22290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddde433c47a48c9844b301153ab4a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.588733 22287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b89c116dab47b49115cd7a68bd7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.593592 22288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdc0654f6b4c00af364eeac4f3f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.649271 22466 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:09.660316 22467 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.684616 22467 tablet_bootstrap.cc:654] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.690241 22468 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:09.702005 22468 tablet_bootstrap.cc:654] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.704136 22466 tablet_bootstrap.cc:654] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.706159 22467 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:09.706779 22467 ts_tablet_manager.cc:1403] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.005s
I20260709 12:14:09.711421 22467 raft_consensus.cc:359] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.712280 22467 raft_consensus.cc:385] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.712709 22467 raft_consensus.cc:740] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.714035 22467 consensus_queue.cc:260] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.715302 22466 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:09.715979 22466 ts_tablet_manager.cc:1403] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.004s
I20260709 12:14:09.718133 22467 ts_tablet_manager.cc:1434] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:14:09.719907 22467 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.719702 22466 raft_consensus.cc:359] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.720633 22466 raft_consensus.cc:385] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.720942 22466 raft_consensus.cc:740] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.721834 22466 consensus_queue.cc:260] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.730530 22467 tablet_bootstrap.cc:654] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.737767 22466 ts_tablet_manager.cc:1434] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 12:14:09.738469 22468 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:09.739060 22468 ts_tablet_manager.cc:1403] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.023s
I20260709 12:14:09.742492 22468 raft_consensus.cc:359] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.744146 22468 raft_consensus.cc:385] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.739015 22466 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:09.744292 22467 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:09.745401 22467 ts_tablet_manager.cc:1403] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.013s
I20260709 12:14:09.744451 22468 raft_consensus.cc:740] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.749118 22468 consensus_queue.cc:260] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.749154 22467 raft_consensus.cc:359] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.750200 22467 raft_consensus.cc:385] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.750543 22467 raft_consensus.cc:740] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.751398 22467 consensus_queue.cc:260] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.751749 22468 ts_tablet_manager.cc:1434] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:14:09.753651 22467 ts_tablet_manager.cc:1434] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:14:09.754660 22467 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.758841 22466 tablet_bootstrap.cc:654] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.762812 22467 tablet_bootstrap.cc:654] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.764590 22468 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:09.771974 22468 tablet_bootstrap.cc:654] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.778005 22466 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:09.778704 22466 ts_tablet_manager.cc:1403] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.005s
I20260709 12:14:09.782877 22466 raft_consensus.cc:359] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.784207 22466 raft_consensus.cc:385] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.784685 22466 raft_consensus.cc:740] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.786322 22466 consensus_queue.cc:260] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.797500 22466 ts_tablet_manager.cc:1434] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:14:09.799510 22466 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:09.801229 22468 tablet_bootstrap.cc:492] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:09.802003 22468 ts_tablet_manager.cc:1403] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.023s
I20260709 12:14:09.806128 22468 raft_consensus.cc:359] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.806993 22468 raft_consensus.cc:385] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.807206 22466 tablet_bootstrap.cc:654] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.807387 22468 raft_consensus.cc:740] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.808583 22468 consensus_queue.cc:260] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.810688 22468 ts_tablet_manager.cc:1434] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:09.819558 22468 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:09.837257 22414 raft_consensus.cc:493] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.838333 22414 raft_consensus.cc:515] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.842290 22468 tablet_bootstrap.cc:654] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.848217 22414 leader_election.cc:290] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:09.854045 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:09.855567 22466 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:09.856238 22466 ts_tablet_manager.cc:1403] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.030s
I20260709 12:14:09.857206 22467 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:09.857859 22467 ts_tablet_manager.cc:1403] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.103s	user 0.047s	sys 0.053s
W20260709 12:14:09.859045 22194 leader_election.cc:343] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.859068 22466 raft_consensus.cc:359] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.860246 22466 raft_consensus.cc:385] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.860116 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:09.860683 22466 raft_consensus.cc:740] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.861586 22466 consensus_queue.cc:260] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
W20260709 12:14:09.862025 22196 leader_election.cc:343] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.861579 22467 raft_consensus.cc:359] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.862669 22467 raft_consensus.cc:385] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.862629 22196 leader_election.cc:304] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640
I20260709 12:14:09.863173 22467 raft_consensus.cc:740] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.864058 22467 consensus_queue.cc:260] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.865965 22478 raft_consensus.cc:2749] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.867883 22467 ts_tablet_manager.cc:1434] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:09.869115 22467 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.869683 22466 ts_tablet_manager.cc:1434] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:14:09.870863 22466 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:09.870946 22468 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:09.871518 22468 ts_tablet_manager.cc:1403] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.007s
I20260709 12:14:09.875150 22468 raft_consensus.cc:359] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.875964 22468 raft_consensus.cc:385] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.876291 22468 raft_consensus.cc:740] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.877228 22467 tablet_bootstrap.cc:654] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.877285 22468 consensus_queue.cc:260] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.883592 22466 tablet_bootstrap.cc:654] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.884023 22468 ts_tablet_manager.cc:1434] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:14:09.885353 22468 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:09.892021 22467 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:09.892709 22467 ts_tablet_manager.cc:1403] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.009s
I20260709 12:14:09.893392 22466 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:09.893594 22468 tablet_bootstrap.cc:654] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.894030 22466 ts_tablet_manager.cc:1403] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:14:09.896147 22467 raft_consensus.cc:359] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.897027 22467 raft_consensus.cc:385] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.897329 22467 raft_consensus.cc:740] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.897306 22466 raft_consensus.cc:359] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.898159 22466 raft_consensus.cc:385] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.898499 22466 raft_consensus.cc:740] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.898424 22467 consensus_queue.cc:260] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.899487 22466 consensus_queue.cc:260] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.902415 22466 ts_tablet_manager.cc:1434] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:09.903152 22467 ts_tablet_manager.cc:1434] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:14:09.904386 22467 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.909473 22478 raft_consensus.cc:493] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.910271 22478 raft_consensus.cc:515] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.912406 22467 tablet_bootstrap.cc:654] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.914534 22466 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:09.914908 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:09.915675 22304 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:09.918428 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:09.919724 22154 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 0.
I20260709 12:14:09.923017 22466 tablet_bootstrap.cc:654] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.929795 22196 leader_election.cc:304] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:09.935066 22478 leader_election.cc:290] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:09.938082 22422 raft_consensus.cc:493] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.946581 22474 raft_consensus.cc:2804] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.946722 22422 raft_consensus.cc:515] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.947288 22474 raft_consensus.cc:493] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.948203 22474 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.949762 22422 leader_election.cc:290] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:09.952363 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e159d2e8cc24f1fb2a5dcdcf41890ef" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
W20260709 12:14:09.957937 22120 leader_election.cc:343] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.958920 22467 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:09.959115 22453 raft_consensus.cc:493] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.959611 22467 ts_tablet_manager.cc:1403] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.017s
I20260709 12:14:09.959690 22468 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:09.960538 22468 ts_tablet_manager.cc:1403] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.075s	user 0.037s	sys 0.037s
I20260709 12:14:09.960438 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e159d2e8cc24f1fb2a5dcdcf41890ef" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:09.961410 22304 raft_consensus.cc:2468] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:09.963143 22121 leader_election.cc:304] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:09.964533 22422 raft_consensus.cc:2804] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.964712 22468 raft_consensus.cc:359] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.964592 22467 raft_consensus.cc:359] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.965034 22422 raft_consensus.cc:493] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.965951 22468 raft_consensus.cc:385] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.966115 22467 raft_consensus.cc:385] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.959775 22453 raft_consensus.cc:515] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.966790 22467 raft_consensus.cc:740] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.967794 22467 consensus_queue.cc:260] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.966666 22468 raft_consensus.cc:740] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.970551 22468 consensus_queue.cc:260] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.973369 22468 ts_tablet_manager.cc:1434] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:09.973716 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:09.974656 22468 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
W20260709 12:14:09.975822 22268 leader_election.cc:343] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.966663 22422 raft_consensus.cc:3060] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.977303 22467 ts_tablet_manager.cc:1434] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:14:09.978951 22467 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:09.983853 22468 tablet_bootstrap.cc:654] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.988842 22467 tablet_bootstrap.cc:654] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.995504 22478 raft_consensus.cc:493] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.996906 22468 tablet_bootstrap.cc:492] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:09.996381 22478 raft_consensus.cc:515] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:09.997691 22468 ts_tablet_manager.cc:1403] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.005s
I20260709 12:14:09.997378 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:09.998489 22230 raft_consensus.cc:2468] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
I20260709 12:14:10.000098 22269 leader_election.cc:304] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.001382 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.002521 22468 raft_consensus.cc:359] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.003445 22468 raft_consensus.cc:385] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.003791 22468 raft_consensus.cc:740] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
W20260709 12:14:10.003822 22196 leader_election.cc:343] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.004954 22478 leader_election.cc:290] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.004804 22468 consensus_queue.cc:260] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.007897 22468 ts_tablet_manager.cc:1434] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:10.009187 22468 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:10.010131 22455 raft_consensus.cc:493] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.010701 22487 raft_consensus.cc:2804] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.011343 22487 raft_consensus.cc:493] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.011718 22487 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.010893 22455 raft_consensus.cc:515] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
W20260709 12:14:10.012111 22121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:40553, user_credentials={real_user=slave}} blocked reactor thread for 49085.4us
I20260709 12:14:10.014283 22455 leader_election.cc:290] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:09.996912 22453 leader_election.cc:290] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.019011 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.020638 22467 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:10.023196 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.024814 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:10.026162 22467 ts_tablet_manager.cc:1403] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.008s
W20260709 12:14:10.030216 22121 leader_election.cc:343] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.031004 22467 raft_consensus.cc:359] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.032009 22467 raft_consensus.cc:385] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.032382 22467 raft_consensus.cc:740] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
W20260709 12:14:10.032961 22120 leader_election.cc:343] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.033354 22467 consensus_queue.cc:260] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.036444 22467 ts_tablet_manager.cc:1434] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:10.036520 22120 leader_election.cc:304] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aff3570d1f334780b5657a30a21bc640; no voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285
W20260709 12:14:10.032395 22194 leader_election.cc:343] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.038439 22194 leader_election.cc:304] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.042362 22467 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:10.041460 22487 raft_consensus.cc:515] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.047885 22478 raft_consensus.cc:2749] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.049052 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
W20260709 12:14:10.050983 22268 leader_election.cc:343] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.051283 22422 raft_consensus.cc:515] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.053715 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.053953 22455 raft_consensus.cc:2749] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.054580 22230 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.055109 22467 tablet_bootstrap.cc:654] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.065457 22487 leader_election.cc:290] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.067775 22468 tablet_bootstrap.cc:654] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.075541 22230 raft_consensus.cc:2468] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:10.078141 22269 leader_election.cc:304] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.079231 22466 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:10.078924 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e159d2e8cc24f1fb2a5dcdcf41890ef" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.079862 22305 raft_consensus.cc:3060] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.080281 22487 raft_consensus.cc:2804] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.080839 22422 leader_election.cc:290] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.064559 22474 raft_consensus.cc:515] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.081386 22487 raft_consensus.cc:697] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:10.081632 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e159d2e8cc24f1fb2a5dcdcf41890ef" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.082901 22487 consensus_queue.cc:237] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.079955 22466 ts_tablet_manager.cc:1403] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.166s	user 0.056s	sys 0.075s
I20260709 12:14:10.085129 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:10.085721 22474 leader_election.cc:290] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.086279 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.087006 22304 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.089732 22305 raft_consensus.cc:2468] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.090520 22466 raft_consensus.cc:359] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.091324 22466 raft_consensus.cc:385] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.091233 22121 leader_election.cc:304] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:10.091802 22466 raft_consensus.cc:740] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.092319 22455 raft_consensus.cc:493] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.092832 22455 raft_consensus.cc:515] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
W20260709 12:14:10.094198 22120 leader_election.cc:343] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.094787 22466 consensus_queue.cc:260] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.095566 22455 leader_election.cc:290] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.096175 22455 raft_consensus.cc:2804] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.096617 22455 raft_consensus.cc:697] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.097608 22455 consensus_queue.cc:237] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.098488 22154 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.101475 22468 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:10.102147 22468 ts_tablet_manager.cc:1403] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.009s
I20260709 12:14:10.103113 22303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
W20260709 12:14:10.105173 22121 leader_election.cc:343] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.105885 22468 raft_consensus.cc:359] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.106726 22468 raft_consensus.cc:385] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.107028 22468 raft_consensus.cc:740] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.107827 22468 consensus_queue.cc:260] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.110668 22466 ts_tablet_manager.cc:1434] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:14:10.112795 22468 ts_tablet_manager.cc:1434] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:14:10.115005 22467 tablet_bootstrap.cc:492] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:10.115653 22467 ts_tablet_manager.cc:1403] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.018s
I20260709 12:14:10.116137 22468 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:10.115103 22466 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:10.120453 22478 raft_consensus.cc:493] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.121304 22478 raft_consensus.cc:515] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.124464 22453 raft_consensus.cc:493] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.126453 22468 tablet_bootstrap.cc:654] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.125906 22453 raft_consensus.cc:515] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.127318 22467 raft_consensus.cc:359] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.128221 22467 raft_consensus.cc:385] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.128566 22467 raft_consensus.cc:740] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.129333 22466 tablet_bootstrap.cc:654] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.135463 22467 consensus_queue.cc:260] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.144665 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.145933 22230 raft_consensus.cc:2468] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.147128 22154 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:10.147661 22467 ts_tablet_manager.cc:1434] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.007s
I20260709 12:14:10.145287 22304 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 1.
I20260709 12:14:10.152166 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:10.152482 22196 leader_election.cc:304] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.152952 22156 raft_consensus.cc:2468] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 0.
I20260709 12:14:10.153481 22414 raft_consensus.cc:2804] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.160883 22467 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:10.161566 22120 leader_election.cc:304] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:10.163156 22453 leader_election.cc:290] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.149770 22050 catalog_manager.cc:5697] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.168006 22268 leader_election.cc:304] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:10.169799 22453 raft_consensus.cc:2804] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.170248 22453 raft_consensus.cc:493] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.170644 22453 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.170817 22478 leader_election.cc:290] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.171043 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
W20260709 12:14:10.173719 22196 leader_election.cc:343] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.167254 22455 raft_consensus.cc:2804] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.176355 22455 raft_consensus.cc:493] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.185793 22455 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.189576 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.175894 22414 raft_consensus.cc:697] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
W20260709 12:14:10.191789 22269 leader_election.cc:343] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.192005 22053 catalog_manager.cc:5697] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 1 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.191797 22414 consensus_queue.cc:237] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.195564 22455 raft_consensus.cc:515] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.198048 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:10.199052 22156 raft_consensus.cc:2393] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5ce09705334405f86b6cdc8edcbc285 in current term 1: Already voted for candidate aff3570d1f334780b5657a30a21bc640 in this term.
I20260709 12:14:10.200223 22453 raft_consensus.cc:515] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.203215 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.200670 22194 leader_election.cc:304] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.205986 22494 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.208254 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:10.209153 22156 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.209267 22468 tablet_bootstrap.cc:492] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:10.209707 22455 leader_election.cc:290] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.212625 22466 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:10.213307 22466 ts_tablet_manager.cc:1403] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.008s
I20260709 12:14:10.213974 22467 tablet_bootstrap.cc:654] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.208416 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.210000 22468 ts_tablet_manager.cc:1403] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.094s	user 0.048s	sys 0.023s
W20260709 12:14:10.217689 22269 leader_election.cc:343] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.218286 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
W20260709 12:14:10.220806 22121 leader_election.cc:343] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.217303 22466 raft_consensus.cc:359] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.222658 22466 raft_consensus.cc:385] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.223122 22466 raft_consensus.cc:740] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.227078 22455 raft_consensus.cc:493] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.227846 22455 raft_consensus.cc:515] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.228258 22467 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:10.229317 22467 ts_tablet_manager.cc:1403] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.010s
I20260709 12:14:10.224426 22466 consensus_queue.cc:260] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.210624 22453 leader_election.cc:290] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.215977 22494 raft_consensus.cc:2749] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.233429 22467 raft_consensus.cc:359] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.233479 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.234263 22467 raft_consensus.cc:385] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.234615 22467 raft_consensus.cc:740] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.234683 22230 raft_consensus.cc:2468] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.235432 22467 consensus_queue.cc:260] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.236698 22120 leader_election.cc:304] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.237957 22467 ts_tablet_manager.cc:1434] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:10.233934 22466 ts_tablet_manager.cc:1434] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:14:10.229318 22156 raft_consensus.cc:2468] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 1.
I20260709 12:14:10.240090 22467 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: Bootstrap starting.
I20260709 12:14:10.229336 22468 raft_consensus.cc:359] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.244017 22422 raft_consensus.cc:2804] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.248015 22422 raft_consensus.cc:493] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.248210 22466 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:10.248589 22422 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.250459 22268 leader_election.cc:304] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.252174 22453 raft_consensus.cc:2804] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.252912 22453 raft_consensus.cc:697] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:10.253621 22468 raft_consensus.cc:385] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.254112 22468 raft_consensus.cc:740] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.254029 22453 consensus_queue.cc:237] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.255220 22468 consensus_queue.cc:260] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.256837 22231 raft_consensus.cc:2468] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.265193 22455 leader_election.cc:290] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.266052 22455 raft_consensus.cc:493] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.267076 22455 raft_consensus.cc:515] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.269229 22466 tablet_bootstrap.cc:654] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.270447 22120 leader_election.cc:304] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:10.272380 22422 raft_consensus.cc:515] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.274137 22051 catalog_manager.cc:5697] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.276186 22455 leader_election.cc:290] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.276729 22422 leader_election.cc:290] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.276849 22455 raft_consensus.cc:2804] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.258144 22468 ts_tablet_manager.cc:1434] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.003s
I20260709 12:14:10.264554 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.279465 22468 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:10.280759 22455 raft_consensus.cc:697] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.281844 22455 consensus_queue.cc:237] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.285012 22467 tablet_bootstrap.cc:654] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.299247 22053 catalog_manager.cc:5697] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 1 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.306957 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.307948 22231 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.310436 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
W20260709 12:14:10.316150 22121 leader_election.cc:343] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.317909 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.317237 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.319804 22304 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.320948 22468 tablet_bootstrap.cc:654] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:10.322114 22121 leader_election.cc:343] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.323254 22121 leader_election.cc:304] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:10.314815 22231 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.325696 22422 raft_consensus.cc:2804] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.326372 22422 raft_consensus.cc:493] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.326726 22422 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:10.327191 22102 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:10.331235 22466 tablet_bootstrap.cc:492] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:10.331921 22466 ts_tablet_manager.cc:1403] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.005s
I20260709 12:14:10.333740 22422 raft_consensus.cc:515] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.341277 22231 raft_consensus.cc:2468] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.350579 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.347683 22422 leader_election.cc:290] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.342243 22466 raft_consensus.cc:359] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.351819 22466 raft_consensus.cc:385] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.352231 22466 raft_consensus.cc:740] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.349002 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.351408 22230 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.353014 22120 leader_election.cc:304] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:10.354672 22304 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.353139 22466 consensus_queue.cc:260] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.357626 22422 raft_consensus.cc:2804] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.358673 22422 raft_consensus.cc:697] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.358935 22468 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:10.359809 22468 ts_tablet_manager.cc:1403] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.009s
I20260709 12:14:10.359819 22422 consensus_queue.cc:237] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.363014 22466 ts_tablet_manager.cc:1434] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:14:10.364065 22468 raft_consensus.cc:359] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.364975 22468 raft_consensus.cc:385] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.365315 22468 raft_consensus.cc:740] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.366214 22466 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:10.366135 22468 consensus_queue.cc:260] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.368549 22468 ts_tablet_manager.cc:1434] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:10.375468 22230 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.376850 22468 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: Bootstrap starting.
I20260709 12:14:10.381402 22120 leader_election.cc:304] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.381754 22467 tablet_bootstrap.cc:492] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: No bootstrap required, opened a new log
I20260709 12:14:10.382346 22467 ts_tablet_manager.cc:1403] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.007s
I20260709 12:14:10.382403 22455 raft_consensus.cc:2804] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.383119 22455 raft_consensus.cc:697] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.384451 22304 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.385938 22502 raft_consensus.cc:493] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.385457 22053 catalog_manager.cc:5697] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.386693 22502 raft_consensus.cc:515] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.384131 22455 consensus_queue.cc:237] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.391364 22468 tablet_bootstrap.cc:654] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.385684 22467 raft_consensus.cc:359] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.392273 22467 raft_consensus.cc:385] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.392740 22467 raft_consensus.cc:740] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.393530 22467 consensus_queue.cc:260] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.393914 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.394584 22230 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.395318 22466 tablet_bootstrap.cc:654] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.396212 22120 leader_election.cc:304] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.398917 22500 raft_consensus.cc:2804] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.401810 22500 raft_consensus.cc:493] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.396189 22502 leader_election.cc:290] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.402249 22500 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.402007 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.400810 22467 ts_tablet_manager.cc:1434] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:14:10.404918 22304 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.411760 22414 raft_consensus.cc:493] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.412672 22414 raft_consensus.cc:515] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.415940 22500 raft_consensus.cc:515] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.418829 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.419099 22305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.419472 22230 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.419907 22305 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.420682 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:10.421830 22156 raft_consensus.cc:2393] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5ce09705334405f86b6cdc8edcbc285 in current term 1: Already voted for candidate 2b9dde5c4f214924a3e28f74351d72eb in this term.
I20260709 12:14:10.419799 22414 leader_election.cc:290] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.418926 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.426019 22196 leader_election.cc:304] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5ce09705334405f86b6cdc8edcbc285; no voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.428107 22230 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.429643 22120 leader_election.cc:304] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.430588 22502 raft_consensus.cc:2804] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.431043 22502 raft_consensus.cc:697] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.431941 22502 consensus_queue.cc:237] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.434470 22466 tablet_bootstrap.cc:492] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:10.428139 22414 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.435204 22466 ts_tablet_manager.cc:1403] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.022s
I20260709 12:14:10.435482 22500 leader_election.cc:290] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.439298 22053 catalog_manager.cc:5697] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.440212 22466 raft_consensus.cc:359] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.441134 22466 raft_consensus.cc:385] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.441473 22466 raft_consensus.cc:740] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.442327 22466 consensus_queue.cc:260] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.444370 22466 ts_tablet_manager.cc:1434] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:10.444914 22414 raft_consensus.cc:2749] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.428115 22305 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.446108 22466 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: Bootstrap starting.
I20260709 12:14:10.445497 22053 catalog_manager.cc:5697] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.453191 22468 tablet_bootstrap.cc:492] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: No bootstrap required, opened a new log
I20260709 12:14:10.453859 22468 ts_tablet_manager.cc:1403] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.000s
I20260709 12:14:10.455943 22466 tablet_bootstrap.cc:654] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.456996 22468 raft_consensus.cc:359] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.457839 22468 raft_consensus.cc:385] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.458122 22468 raft_consensus.cc:740] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.458915 22468 consensus_queue.cc:260] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.461186 22468 ts_tablet_manager.cc:1434] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:10.468194 22466 tablet_bootstrap.cc:492] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: No bootstrap required, opened a new log
I20260709 12:14:10.469074 22466 ts_tablet_manager.cc:1403] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:14:10.472334 22453 consensus_queue.cc:1048] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.476579 22466 raft_consensus.cc:359] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.477469 22466 raft_consensus.cc:385] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.477838 22466 raft_consensus.cc:740] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.478729 22466 consensus_queue.cc:260] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.480479 22466 ts_tablet_manager.cc:1434] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:14:10.481233 22052 catalog_manager.cc:5697] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.497816 22156 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.508261 22453 consensus_queue.cc:1048] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.525990 22502 consensus_queue.cc:1048] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.535841 22500 raft_consensus.cc:493] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.536064 22230 raft_consensus.cc:3060] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.536480 22500 raft_consensus.cc:515] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.539701 22500 leader_election.cc:290] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.540359 22231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.541188 22231 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.541306 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb" is_pre_election: true
I20260709 12:14:10.542235 22304 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 0.
I20260709 12:14:10.543624 22121 leader_election.cc:304] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:10.544569 22500 raft_consensus.cc:2804] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.545020 22500 raft_consensus.cc:493] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.545420 22500 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.550675 22422 consensus_queue.cc:1048] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.554847 22500 raft_consensus.cc:515] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.558466 22500 leader_election.cc:290] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.558689 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.559424 22304 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.559465 22229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.560331 22229 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.570551 22304 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.570629 22229 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 1.
I20260709 12:14:10.572165 22120 leader_election.cc:304] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.573227 22500 raft_consensus.cc:2804] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.573787 22500 raft_consensus.cc:697] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.574697 22500 consensus_queue.cc:237] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.585896 22053 catalog_manager.cc:5697] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 0 to 1, leader changed from <none> to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.678434 22414 consensus_queue.cc:1048] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.679315 22229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
mode: GRACEFUL
new_leader_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:46654
I20260709 12:14:10.680147 22229 raft_consensus.cc:606] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Received request to transfer leadership to TS aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.679979 22494 consensus_queue.cc:1048] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.691172 22478 raft_consensus.cc:993] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: : Instructing follower aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:10.693125 22478 raft_consensus.cc:1081] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Signalling peer aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:10.698720 22500 consensus_queue.cc:1048] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.703153 22154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:52438
I20260709 12:14:10.707713 22304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
mode: GRACEFUL
new_leader_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:54732
I20260709 12:14:10.711643 22304 raft_consensus.cc:606] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Received request to transfer leadership to TS aff3570d1f334780b5657a30a21bc640
I20260709 12:14:10.711459 22453 consensus_queue.cc:1048] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.710035 22305 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.718822 22453 consensus_queue.cc:1048] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.725485 22153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35311c3332b7476391f6bb644082332b"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:10.726213 22153 raft_consensus.cc:606] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.734908 22453 raft_consensus.cc:493] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.736387 22453 raft_consensus.cc:515] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.737804 22154 raft_consensus.cc:493] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.738363 22154 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.739439 22453 leader_election.cc:290] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.740723 22153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3570d1f334780b5657a30a21bc640" is_pre_election: true
I20260709 12:14:10.741796 22156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:10.742529 22156 raft_consensus.cc:606] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.750451 22154 raft_consensus.cc:515] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.752072 22156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:10.752698 22156 raft_consensus.cc:606] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.751718 22229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5ce09705334405f86b6cdc8edcbc285" is_pre_election: true
I20260709 12:14:10.753651 22229 raft_consensus.cc:2393] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b9dde5c4f214924a3e28f74351d72eb in current term 1: Already voted for candidate aff3570d1f334780b5657a30a21bc640 in this term.
I20260709 12:14:10.757885 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.758104 22269 leader_election.cc:304] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb; no voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.758872 22230 raft_consensus.cc:3055] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.759256 22230 raft_consensus.cc:740] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:10.759088 22500 consensus_queue.cc:1048] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.760080 22154 leader_election.cc:290] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.760250 22230 consensus_queue.cc:260] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.763984 22230 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.762653 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059e5679a4c24b13b9c8090c4b74a502" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.769062 22304 raft_consensus.cc:3060] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.778103 22230 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:10.780053 22120 leader_election.cc:304] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.782094 22500 raft_consensus.cc:2804] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.782773 22500 raft_consensus.cc:697] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.782085 22305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
mode: GRACEFUL
new_leader_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:54732
I20260709 12:14:10.783926 22305 raft_consensus.cc:606] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Received request to transfer leadership to TS e5ce09705334405f86b6cdc8edcbc285
I20260709 12:14:10.783707 22500 consensus_queue.cc:237] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.787680 22304 raft_consensus.cc:2468] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:10.788769 22531 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.794449 22156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:52454
I20260709 12:14:10.795112 22156 raft_consensus.cc:606] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:10.809826 22453 raft_consensus.cc:993] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: : Instructing follower aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:10.810374 22453 raft_consensus.cc:1081] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Signalling peer aff3570d1f334780b5657a30a21bc640 to start an election
I20260709 12:14:10.812516 22531 raft_consensus.cc:2749] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.812695 22156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
 from {username='slave'} at 127.0.0.1:52428
I20260709 12:14:10.813347 22156 raft_consensus.cc:493] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.813831 22156 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.821694 22156 raft_consensus.cc:515] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.824549 22229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.825204 22229 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.832394 22229 raft_consensus.cc:2468] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:10.833683 22156 leader_election.cc:290] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Requested vote from peers e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.833699 22120 leader_election.cc:304] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.834749 22303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a34ce800f0543dfb7cb650abc575974" candidate_uuid: "aff3570d1f334780b5657a30a21bc640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.835022 22500 raft_consensus.cc:2804] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.835436 22303 raft_consensus.cc:3055] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.835624 22500 raft_consensus.cc:697] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Becoming Leader. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.835811 22303 raft_consensus.cc:740] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:10.836666 22500 consensus_queue.cc:237] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.836802 22303 consensus_queue.cc:260] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.837524 22051 catalog_manager.cc:5697] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.838352 22303 raft_consensus.cc:3060] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.845016 22303 raft_consensus.cc:2468] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff3570d1f334780b5657a30a21bc640 in term 2.
I20260709 12:14:10.852707 22051 catalog_manager.cc:5697] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 reported cstate change: term changed from 1 to 2, leader changed from 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67) to aff3570d1f334780b5657a30a21bc640 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "aff3570d1f334780b5657a30a21bc640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.863838 22500 consensus_queue.cc:1048] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.877233 22502 consensus_queue.cc:1048] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.883484 22503 consensus_queue.cc:1048] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.892243 22502 raft_consensus.cc:993] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: : Instructing follower 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:10.892897 22455 raft_consensus.cc:1081] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:10.894793 22303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54710
I20260709 12:14:10.895426 22303 raft_consensus.cc:493] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.895875 22303 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.900588 22500 consensus_queue.cc:1048] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.904284 22303 raft_consensus.cc:515] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.908089 22303 leader_election.cc:290] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:10.908027 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:10.908818 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b89c116dab47b49115cd7a68bd7f49" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:10.909343 22156 raft_consensus.cc:3055] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.909462 22230 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.909888 22156 raft_consensus.cc:740] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.910827 22156 consensus_queue.cc:260] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.912231 22156 raft_consensus.cc:3060] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.915964 22230 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:10.916400 22500 raft_consensus.cc:993] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: : Instructing follower e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:10.916926 22500 raft_consensus.cc:1081] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:10.917191 22269 leader_election.cc:304] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.918745 22530 raft_consensus.cc:2804] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.919061 22229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:46638
I20260709 12:14:10.919245 22530 raft_consensus.cc:697] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:10.919713 22229 raft_consensus.cc:493] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.920137 22229 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.920248 22530 consensus_queue.cc:237] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.924778 22156 raft_consensus.cc:2468] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:10.928418 22229 raft_consensus.cc:515] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.931150 22229 leader_election.cc:290] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:10.931718 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:10.931792 22303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f8b2dc5f1b49d98e910c10e2238eb6" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:10.932646 22303 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.931752 22052 catalog_manager.cc:5697] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 2 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.933836 22156 raft_consensus.cc:3055] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.934201 22156 raft_consensus.cc:740] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:10.935011 22156 consensus_queue.cc:260] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.936362 22156 raft_consensus.cc:3060] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.941797 22303 raft_consensus.cc:2468] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:10.943164 22196 leader_election.cc:304] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:10.944010 22414 raft_consensus.cc:2804] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.944530 22414 raft_consensus.cc:697] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:10.944562 22156 raft_consensus.cc:2468] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:10.945482 22414 consensus_queue.cc:237] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:10.952804 22052 catalog_manager.cc:5697] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.998570 22531 raft_consensus.cc:993] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: : Instructing follower e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:10.999135 22530 raft_consensus.cc:1081] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Signalling peer e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:11.001014 22229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:46646
I20260709 12:14:11.001631 22229 raft_consensus.cc:493] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.002022 22229 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.004088 22500 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.008149 22500 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.010804 22229 raft_consensus.cc:515] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.013770 22229 leader_election.cc:290] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:11.018227 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:11.018949 22503 raft_consensus.cc:993] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: : Instructing follower e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:11.019837 22304 raft_consensus.cc:3055] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.019934 22500 raft_consensus.cc:1081] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:11.020424 22304 raft_consensus.cc:740] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:11.019191 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdc0654f6b4c00af364eeac4f3f4ea" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:11.021360 22156 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.021366 22304 consensus_queue.cc:260] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.025516 22304 raft_consensus.cc:3060] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.029841 22156 raft_consensus.cc:2468] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.031805 22194 leader_election.cc:304] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:11.033116 22229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35311c3332b7476391f6bb644082332b"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:46638
I20260709 12:14:11.033605 22304 raft_consensus.cc:2468] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.033757 22494 raft_consensus.cc:2804] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.033875 22229 raft_consensus.cc:493] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.034330 22494 raft_consensus.cc:697] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:11.034435 22229 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.035305 22494 consensus_queue.cc:237] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.039623 22455 consensus_queue.cc:1048] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.043804 22229 raft_consensus.cc:515] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.047016 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:11.047587 22156 raft_consensus.cc:3055] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.047904 22156 raft_consensus.cc:740] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:11.048633 22156 consensus_queue.cc:260] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.049784 22156 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.052899 22052 catalog_manager.cc:5697] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.055240 22303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:11.055882 22303 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.056174 22156 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.057407 22194 leader_election.cc:304] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:11.058297 22494 raft_consensus.cc:2804] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.058780 22494 raft_consensus.cc:697] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:11.059723 22500 raft_consensus.cc:993] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: : Instructing follower e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:11.059870 22229 leader_election.cc:290] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:11.059644 22494 consensus_queue.cc:237] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.060278 22502 raft_consensus.cc:1081] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer e5ce09705334405f86b6cdc8edcbc285 to start an election
I20260709 12:14:11.066190 22422 consensus_queue.cc:1048] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.067162 22303 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.069718 22230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
 from {username='slave'} at 127.0.0.1:46638
I20260709 12:14:11.071435 22230 raft_consensus.cc:493] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.071805 22230 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.080638 22230 raft_consensus.cc:515] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.084478 22156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:11.084811 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddde433c47a48c9844b301153ab4a64" candidate_uuid: "e5ce09705334405f86b6cdc8edcbc285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
I20260709 12:14:11.085160 22156 raft_consensus.cc:3055] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.085486 22156 raft_consensus.cc:740] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:11.085611 22230 leader_election.cc:290] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67:40553)
I20260709 12:14:11.086366 22156 consensus_queue.cc:260] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.087625 22156 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.085475 22304 raft_consensus.cc:3060] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.093601 22156 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.093843 22051 catalog_manager.cc:5697] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.094951 22194 leader_election.cc:304] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3570d1f334780b5657a30a21bc640, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:11.095854 22494 raft_consensus.cc:2804] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.096331 22494 raft_consensus.cc:697] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Leader. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:11.097616 22304 raft_consensus.cc:2468] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5ce09705334405f86b6cdc8edcbc285 in term 2.
I20260709 12:14:11.097254 22494 consensus_queue.cc:237] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:11.109400 22053 catalog_manager.cc:5697] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "e5ce09705334405f86b6cdc8edcbc285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.192353 22304 raft_consensus.cc:1275] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.193765 22422 consensus_queue.cc:1048] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.202407 22230 raft_consensus.cc:1275] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.204517 22502 consensus_queue.cc:1048] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.331636 22230 raft_consensus.cc:1275] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.333010 22530 consensus_queue.cc:1048] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.341799 22156 raft_consensus.cc:1275] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.344421 22530 consensus_queue.cc:1048] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:11.380625 22230 raft_consensus.cc:1275] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.382151 22502 consensus_queue.cc:1048] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.390471 22304 raft_consensus.cc:1275] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer aff3570d1f334780b5657a30a21bc640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.392186 22503 consensus_queue.cc:1048] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.456933 22156 raft_consensus.cc:1275] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.458182 22494 consensus_queue.cc:1048] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.466060 22303 raft_consensus.cc:1275] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.467772 22526 consensus_queue.cc:1048] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.480875 22303 raft_consensus.cc:1275] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.482264 22526 consensus_queue.cc:1048] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.490178 22156 raft_consensus.cc:1275] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.491932 22414 consensus_queue.cc:1048] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.544692 22303 raft_consensus.cc:1275] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.546205 22414 consensus_queue.cc:1048] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.554617 22156 raft_consensus.cc:1275] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.556409 22494 consensus_queue.cc:1048] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.566859 22303 raft_consensus.cc:1275] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.568272 22494 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.576839 22156 raft_consensus.cc:1275] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer e5ce09705334405f86b6cdc8edcbc285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.579370 22414 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.806105 22051 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40344:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:13.831295 22051 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40344:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:13.881912 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:14:14.007258 22194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:34213, user_credentials={real_user=slave}} blocked reactor thread for 57897us
W20260709 12:14:14.025267 22269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:46269, user_credentials={real_user=slave}} blocked reactor thread for 52947.2us
W20260709 12:14:14.166756 22584 log.cc:927] Time spent T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
W20260709 12:14:14.174379 22121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:40553, user_credentials={real_user=slave}} blocked reactor thread for 76706.5us
I20260709 12:14:14.113126 22582 tablet.cc:1724] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.180840 22598 tablet.cc:1724] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:14.230252 22591 log.cc:927] Time spent T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:14:14.230939 22257 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:35311c3332b7476391f6bb644082332b)
I20260709 12:14:14.207392 22600 tablet.cc:1724] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.246130 22601 tablet.cc:1724] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.177199 22593 tablet.cc:1724] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.223160 22596 tablet.cc:1724] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:14.240991 22257 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:35311c3332b7476391f6bb644082332b)
W20260709 12:14:14.254703 22257 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:35311c3332b7476391f6bb644082332b)
I20260709 12:14:14.293922 22614 tablet.cc:1724] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.263839 22605 tablet.cc:1724] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:14.324689 22607 log.cc:927] Time spent T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.002s
I20260709 12:14:14.282191 22603 tablet.cc:1724] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.362103 22608 tablet.cc:1724] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.352749 22612 tablet.cc:1724] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.402477 22605 tablet.cc:1724] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.421792 22600 tablet.cc:1724] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.433673 22593 tablet.cc:1724] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.435737 22229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35311c3332b7476391f6bb644082332b"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:52388
I20260709 12:14:14.436524 22229 raft_consensus.cc:606] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:14.441284 22616 tablet.cc:1724] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.443756 22596 tablet.cc:1724] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.450007 22598 tablet.cc:1724] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.446372 22582 tablet.cc:1724] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.467726 22616 tablet.cc:1724] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.473232 22608 tablet.cc:1724] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.477169 22614 tablet.cc:1724] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.478574 22603 tablet.cc:1724] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.490692 22601 tablet.cc:1724] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.507371 22616 tablet.cc:1724] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.516059 22603 tablet.cc:1724] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.507476 22612 tablet.cc:1724] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.510850 22605 tablet.cc:1724] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.543043 22154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e08b81dffd094e38990e06fed528d424"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54046
I20260709 12:14:14.543789 22154 raft_consensus.cc:606] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:14.546314 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:14:14.549867 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:14.567431 22230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9"
dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:52388
I20260709 12:14:14.568177 22230 raft_consensus.cc:606] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:14.571771 22154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76b1897177794a36b78693d594d976ad"
dest_uuid: "aff3570d1f334780b5657a30a21bc640"
mode: GRACEFUL
new_leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54046
I20260709 12:14:14.572479 22154 raft_consensus.cc:606] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Received request to transfer leadership to TS 2b9dde5c4f214924a3e28f74351d72eb
I20260709 12:14:14.573668 22052 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: soft_deleted_table [id=89df2aceac5b47d9979059ef18275f21] alter complete (version 1)
I20260709 12:14:14.575592 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:14.576421 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:14.618067 22545 raft_consensus.cc:993] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: : Instructing follower 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.618723 22572 raft_consensus.cc:1081] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Signalling peer 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.620661 22299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35311c3332b7476391f6bb644082332b"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54724
I20260709 12:14:14.621279 22299 raft_consensus.cc:493] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.621642 22299 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.628768 22299 raft_consensus.cc:515] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.630841 22299 leader_election.cc:290] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:14.632100 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:14.632155 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35311c3332b7476391f6bb644082332b" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:14.632846 22154 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.632870 22230 raft_consensus.cc:3055] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:14.633285 22230 raft_consensus.cc:740] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:14.634127 22230 consensus_queue.cc:260] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.635103 22230 raft_consensus.cc:3060] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.639526 22154 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 3.
I20260709 12:14:14.641085 22268 leader_election.cc:304] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:14.641865 22230 raft_consensus.cc:2468] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 3.
I20260709 12:14:14.642217 22577 raft_consensus.cc:2804] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:14.643479 22577 raft_consensus.cc:697] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:14.644531 22586 raft_consensus.cc:993] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: : Instructing follower 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.644621 22577 consensus_queue.cc:237] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.645344 22597 raft_consensus.cc:1081] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.647220 22299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76b1897177794a36b78693d594d976ad"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54710
I20260709 12:14:14.647853 22299 raft_consensus.cc:493] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.648281 22299 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.654106 22052 catalog_manager.cc:5697] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 2 to 3, leader changed from e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 3 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.655877 22299 raft_consensus.cc:515] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.658242 22299 leader_election.cc:290] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:14.658977 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:14.659452 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b1897177794a36b78693d594d976ad" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:14.659776 22154 raft_consensus.cc:3055] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.660053 22230 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.660187 22154 raft_consensus.cc:740] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:14.661197 22154 consensus_queue.cc:260] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.662503 22154 raft_consensus.cc:3060] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.667059 22230 raft_consensus.cc:2468] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:14.668372 22269 leader_election.cc:304] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:14.669309 22577 raft_consensus.cc:2804] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:14.669935 22577 raft_consensus.cc:697] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:14.670503 22154 raft_consensus.cc:2468] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:14.670872 22577 consensus_queue.cc:237] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.677817 22545 raft_consensus.cc:993] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: : Instructing follower 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.678392 22572 raft_consensus.cc:1081] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Signalling peer 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.680042 22299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54724
I20260709 12:14:14.680671 22299 raft_consensus.cc:493] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.681073 22299 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.681355 22052 catalog_manager.cc:5697] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 2 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.688838 22299 raft_consensus.cc:515] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.691316 22299 leader_election.cc:290] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:14.692698 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:14.693084 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131f1a7a55c04d9fbc603cf478a569e9" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:14.693461 22154 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.693848 22230 raft_consensus.cc:3055] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:14.694185 22230 raft_consensus.cc:740] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5ce09705334405f86b6cdc8edcbc285, State: Running, Role: LEADER
I20260709 12:14:14.694967 22230 consensus_queue.cc:260] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.696000 22230 raft_consensus.cc:3060] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.699968 22154 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 3.
I20260709 12:14:14.701028 22230 raft_consensus.cc:2468] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 3.
I20260709 12:14:14.701223 22268 leader_election.cc:304] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, aff3570d1f334780b5657a30a21bc640; no voters: 
I20260709 12:14:14.702261 22577 raft_consensus.cc:2804] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:14.702791 22577 raft_consensus.cc:697] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:14.703691 22577 consensus_queue.cc:237] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.711897 22052 catalog_manager.cc:5697] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 2 to 3, leader changed from e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 3 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.749907 22586 raft_consensus.cc:993] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: : Instructing follower 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.750526 22597 raft_consensus.cc:1081] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Signalling peer 2b9dde5c4f214924a3e28f74351d72eb to start an election
I20260709 12:14:14.752312 22299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e08b81dffd094e38990e06fed528d424"
dest_uuid: "2b9dde5c4f214924a3e28f74351d72eb"
 from {username='slave'} at 127.0.0.1:54710
I20260709 12:14:14.752820 22299 raft_consensus.cc:493] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.753113 22299 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.759763 22299 raft_consensus.cc:515] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.761801 22299 leader_election.cc:290] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Requested vote from peers aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213), e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269)
I20260709 12:14:14.762907 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "aff3570d1f334780b5657a30a21bc640"
I20260709 12:14:14.763029 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08b81dffd094e38990e06fed528d424" candidate_uuid: "2b9dde5c4f214924a3e28f74351d72eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e5ce09705334405f86b6cdc8edcbc285"
I20260709 12:14:14.763721 22154 raft_consensus.cc:3055] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.763834 22230 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.764102 22154 raft_consensus.cc:740] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aff3570d1f334780b5657a30a21bc640, State: Running, Role: LEADER
I20260709 12:14:14.765064 22154 consensus_queue.cc:260] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.766276 22154 raft_consensus.cc:3060] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.771450 22230 raft_consensus.cc:2468] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:14.772953 22269 leader_election.cc:304] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9dde5c4f214924a3e28f74351d72eb, e5ce09705334405f86b6cdc8edcbc285; no voters: 
I20260709 12:14:14.773896 22577 raft_consensus.cc:2804] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:14.774796 22577 raft_consensus.cc:697] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Becoming Leader. State: Replica: 2b9dde5c4f214924a3e28f74351d72eb, State: Running, Role: LEADER
I20260709 12:14:14.775596 22154 raft_consensus.cc:2468] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9dde5c4f214924a3e28f74351d72eb in term 2.
I20260709 12:14:14.775830 22577 consensus_queue.cc:237] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } }
I20260709 12:14:14.791503 22052 catalog_manager.cc:5697] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb reported cstate change: term changed from 1 to 2, leader changed from aff3570d1f334780b5657a30a21bc640 (127.10.114.65) to 2b9dde5c4f214924a3e28f74351d72eb (127.10.114.67). New cstate: current_term: 2 leader_uuid: "2b9dde5c4f214924a3e28f74351d72eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9dde5c4f214924a3e28f74351d72eb" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 40553 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.051354 22154 raft_consensus.cc:1275] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.052956 22577 consensus_queue.cc:1048] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.067023 22230 raft_consensus.cc:1275] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.069866 22625 consensus_queue.cc:1048] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.139876 22231 raft_consensus.cc:1275] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:15.145166 22602 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:15.167584 22154 raft_consensus.cc:1275] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:15.170974 22602 consensus_queue.cc:1048] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:15.171190 22153 raft_consensus.cc:1275] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:15.175190 22602 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:15.194656 22229 raft_consensus.cc:1275] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:15.200955 22577 consensus_queue.cc:1048] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:15.378455 22153 raft_consensus.cc:1275] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:15.379642 22229 raft_consensus.cc:1275] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Refusing update from remote peer 2b9dde5c4f214924a3e28f74351d72eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:15.380296 22577 consensus_queue.cc:1048] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3570d1f334780b5657a30a21bc640" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:15.381316 22625 consensus_queue.cc:1048] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5ce09705334405f86b6cdc8edcbc285" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 46269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:15.578132 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:15.584542 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:15.585155 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.591950 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:15.592455 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:16.593951 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:16.599375 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:16.599965 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.605218 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:16.605752 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.606832 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:17.612485 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:17.613091 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.617957 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:17.618491 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:18.619763 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:18.626819 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:18.627362 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:18.632220 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:18.632702 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.634174 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:19.642715 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:19.643399 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.649405 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:19.649870 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:20.651118 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:20.656637 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:20.657207 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:20.662101 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:20.662715 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.663973 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:21.669378 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:21.669912 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.675045 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:21.675516 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:22.676774 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:22.683228 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:22.683956 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:22.690696 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:22.691265 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:23.692523 10697 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:23.699313 10697 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:23.699879 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.705180 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:23.705717 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:24.773373 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
I20260709 12:14:24.818706 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:24.819517 10697 tablet_replica.cc:333] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.820472 10697 raft_consensus.cc:2243] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.821231 10697 raft_consensus.cc:2272] T cddde433c47a48c9844b301153ab4a64 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.824277 10697 tablet_replica.cc:333] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.825027 10697 raft_consensus.cc:2243] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.825840 10697 raft_consensus.cc:2272] T c8b89c116dab47b49115cd7a68bd7f49 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.830372 10697 tablet_replica.cc:333] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.831313 10697 raft_consensus.cc:2243] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.832144 10697 raft_consensus.cc:2272] T 42fdc0654f6b4c00af364eeac4f3f4ea P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.835253 10697 tablet_replica.cc:333] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.836010 10697 raft_consensus.cc:2243] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.836642 10697 raft_consensus.cc:2272] T 24f8b2dc5f1b49d98e910c10e2238eb6 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.839483 10697 tablet_replica.cc:333] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.840248 10697 raft_consensus.cc:2243] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.841305 10697 raft_consensus.cc:2272] T 9a34ce800f0543dfb7cb650abc575974 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.844072 10697 tablet_replica.cc:333] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.844810 10697 raft_consensus.cc:2243] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.845314 10697 raft_consensus.cc:2272] T e08b81dffd094e38990e06fed528d424 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.848042 10697 tablet_replica.cc:333] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.848716 10697 raft_consensus.cc:2243] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.849833 10697 raft_consensus.cc:2272] T 059e5679a4c24b13b9c8090c4b74a502 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.852809 10697 tablet_replica.cc:333] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.853593 10697 raft_consensus.cc:2243] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.854640 10697 raft_consensus.cc:2272] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.857337 10697 tablet_replica.cc:333] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.858018 10697 raft_consensus.cc:2243] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.858580 10697 raft_consensus.cc:2272] T ac18649239a34d48b6ebd3fa05651847 P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.861394 10697 tablet_replica.cc:333] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.862079 10697 raft_consensus.cc:2243] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.862598 10697 raft_consensus.cc:2272] T 35311c3332b7476391f6bb644082332b P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.865358 10697 tablet_replica.cc:333] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.866075 10697 raft_consensus.cc:2243] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.866660 10697 raft_consensus.cc:2272] T 131f1a7a55c04d9fbc603cf478a569e9 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.869673 10697 tablet_replica.cc:333] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.870667 10697 raft_consensus.cc:2243] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.871352 10697 raft_consensus.cc:2272] T b8667f7d6fc24ab5953a0cb0b728f28c P aff3570d1f334780b5657a30a21bc640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.874886 10697 tablet_replica.cc:333] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.875556 10697 raft_consensus.cc:2243] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.876142 10697 raft_consensus.cc:2272] T 43b23f9361e84944b27370b728f811c6 P aff3570d1f334780b5657a30a21bc640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.879136 10697 tablet_replica.cc:333] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.879801 10697 raft_consensus.cc:2243] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.880496 10697 raft_consensus.cc:2272] T e4303a3a87f349cdb3a21e89acacb43d P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.881188 22268 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:14:24.883975 10697 tablet_replica.cc:333] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.885037 10697 raft_consensus.cc:2243] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:14:24.885501 22268 consensus_peers.cc:597] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.886394 10697 raft_consensus.cc:2272] T f86c7d7a9a8c4c959a2dbbc669d195bc P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.889324 10697 tablet_replica.cc:333] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.889969 10697 raft_consensus.cc:2243] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.890923 10697 raft_consensus.cc:2272] T daa244f418d04148b0435b1f17b71534 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.894065 10697 tablet_replica.cc:333] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.894804 10697 raft_consensus.cc:2243] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.895944 10697 raft_consensus.cc:2272] T a3854f00958e4ced815c758230862f17 P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.898828 22194 consensus_peers.cc:597] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.899398 10697 tablet_replica.cc:333] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640: stopping tablet replica
I20260709 12:14:24.900059 10697 raft_consensus.cc:2243] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.900595 10697 raft_consensus.cc:2272] T 76b1897177794a36b78693d594d976ad P aff3570d1f334780b5657a30a21bc640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.953656 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
W20260709 12:14:24.954459 22268 consensus_peers.cc:597] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.957129 22194 consensus_peers.cc:597] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.967543 22194 consensus_peers.cc:597] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.994272 22268 consensus_peers.cc:597] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.010212 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
I20260709 12:14:25.046429 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:25.046272 22268 consensus_peers.cc:597] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.047501 10697 tablet_replica.cc:333] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.048477 10697 raft_consensus.cc:2243] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.049026 10697 raft_consensus.cc:2272] T e08b81dffd094e38990e06fed528d424 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.051716 10697 tablet_replica.cc:333] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.052500 10697 raft_consensus.cc:2243] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.053642 10697 raft_consensus.cc:2272] T cddde433c47a48c9844b301153ab4a64 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.056304 10697 tablet_replica.cc:333] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.056931 10697 raft_consensus.cc:2243] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.057456 10697 raft_consensus.cc:2272] T c8b89c116dab47b49115cd7a68bd7f49 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.059963 10697 tablet_replica.cc:333] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.060712 10697 raft_consensus.cc:2243] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.061874 10697 raft_consensus.cc:2272] T 42fdc0654f6b4c00af364eeac4f3f4ea P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.064458 10697 tablet_replica.cc:333] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.065114 10697 raft_consensus.cc:2243] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.065791 10697 raft_consensus.cc:2272] T 059e5679a4c24b13b9c8090c4b74a502 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.068266 10697 tablet_replica.cc:333] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.068967 10697 raft_consensus.cc:2243] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.069490 10697 raft_consensus.cc:2272] T daa244f418d04148b0435b1f17b71534 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.072713 10697 tablet_replica.cc:333] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.073853 10697 raft_consensus.cc:2243] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.074581 10697 raft_consensus.cc:2272] T 9a34ce800f0543dfb7cb650abc575974 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.077592 22269 consensus_peers.cc:597] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Couldn't send request to peer e5ce09705334405f86b6cdc8edcbc285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.077994 10697 tablet_replica.cc:333] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.078728 10697 raft_consensus.cc:2243] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.079615 10697 raft_consensus.cc:2272] T 24f8b2dc5f1b49d98e910c10e2238eb6 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.082870 10697 tablet_replica.cc:333] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.083868 10697 raft_consensus.cc:2243] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.084481 10697 raft_consensus.cc:2272] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.087211 10697 tablet_replica.cc:333] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.087879 10697 raft_consensus.cc:2243] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.088879 10697 raft_consensus.cc:2272] T ac18649239a34d48b6ebd3fa05651847 P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.091382 10697 tablet_replica.cc:333] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.091985 10697 raft_consensus.cc:2243] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.092482 10697 raft_consensus.cc:2272] T 35311c3332b7476391f6bb644082332b P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.094802 10697 tablet_replica.cc:333] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.095413 10697 raft_consensus.cc:2243] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.095888 10697 raft_consensus.cc:2272] T 131f1a7a55c04d9fbc603cf478a569e9 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.098199 10697 tablet_replica.cc:333] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.098816 10697 raft_consensus.cc:2243] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.099301 10697 raft_consensus.cc:2272] T f86c7d7a9a8c4c959a2dbbc669d195bc P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.101815 10697 tablet_replica.cc:333] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.102397 10697 raft_consensus.cc:2243] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.102919 10697 raft_consensus.cc:2272] T 76b1897177794a36b78693d594d976ad P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.105374 10697 tablet_replica.cc:333] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.105964 10697 raft_consensus.cc:2243] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.106410 10697 raft_consensus.cc:2272] T a3854f00958e4ced815c758230862f17 P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.108774 10697 tablet_replica.cc:333] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.109324 10697 raft_consensus.cc:2243] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.110456 10697 raft_consensus.cc:2272] T b8667f7d6fc24ab5953a0cb0b728f28c P e5ce09705334405f86b6cdc8edcbc285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.113619 10697 tablet_replica.cc:333] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.114238 10697 raft_consensus.cc:2243] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.115289 10697 raft_consensus.cc:2272] T e4303a3a87f349cdb3a21e89acacb43d P e5ce09705334405f86b6cdc8edcbc285 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.115481 22269 consensus_peers.cc:597] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb -> Peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Couldn't send request to peer e5ce09705334405f86b6cdc8edcbc285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.117969 10697 tablet_replica.cc:333] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285: stopping tablet replica
I20260709 12:14:25.118659 10697 raft_consensus.cc:2243] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.119232 10697 raft_consensus.cc:2272] T 43b23f9361e84944b27370b728f811c6 P e5ce09705334405f86b6cdc8edcbc285 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.143824 22268 consensus_peers.cc:597] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.202411 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
W20260709 12:14:25.228798 22269 consensus_peers.cc:597] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Couldn't send request to peer e5ce09705334405f86b6cdc8edcbc285. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:25.270795 22268 consensus_peers.cc:597] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer aff3570d1f334780b5657a30a21bc640 (127.10.114.65:34213): Couldn't send request to peer aff3570d1f334780b5657a30a21bc640. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.288707 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
I20260709 12:14:25.332129 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:25.333663 10697 tablet_replica.cc:333] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.335793 10697 raft_consensus.cc:2243] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.337984 10697 raft_consensus.cc:2272] T e08b81dffd094e38990e06fed528d424 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.341866 10697 tablet_replica.cc:333] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.343374 10697 raft_consensus.cc:2243] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.345832 10697 raft_consensus.cc:2272] T c8b89c116dab47b49115cd7a68bd7f49 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.349897 10697 tablet_replica.cc:333] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
W20260709 12:14:25.350620 22269 consensus_peers.cc:597] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb -> Peer e5ce09705334405f86b6cdc8edcbc285 (127.10.114.66:46269): Couldn't send request to peer e5ce09705334405f86b6cdc8edcbc285. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:46269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.350899 10697 raft_consensus.cc:2243] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.351943 10697 raft_consensus.cc:2272] T cddde433c47a48c9844b301153ab4a64 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.355269 10697 tablet_replica.cc:333] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.356245 10697 raft_consensus.cc:2243] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.356966 10697 raft_consensus.cc:2272] T 24f8b2dc5f1b49d98e910c10e2238eb6 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.359776 10697 tablet_replica.cc:333] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.360586 10697 raft_consensus.cc:2243] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.361287 10697 raft_consensus.cc:2272] T 9a34ce800f0543dfb7cb650abc575974 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.364324 10697 tablet_replica.cc:333] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.365249 10697 raft_consensus.cc:2243] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.366055 10697 raft_consensus.cc:2272] T 059e5679a4c24b13b9c8090c4b74a502 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.369127 10697 tablet_replica.cc:333] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.369853 10697 raft_consensus.cc:2243] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.370594 10697 raft_consensus.cc:2272] T e4303a3a87f349cdb3a21e89acacb43d P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.373898 10697 tablet_replica.cc:333] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.374680 10697 raft_consensus.cc:2243] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.376101 10697 raft_consensus.cc:2272] T 43b23f9361e84944b27370b728f811c6 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.379043 10697 tablet_replica.cc:333] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.379797 10697 raft_consensus.cc:2243] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.380577 10697 raft_consensus.cc:2272] T 42fdc0654f6b4c00af364eeac4f3f4ea P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.383611 10697 tablet_replica.cc:333] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.384289 10697 raft_consensus.cc:2243] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.386725 10697 raft_consensus.cc:2272] T 35311c3332b7476391f6bb644082332b P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.389602 10697 tablet_replica.cc:333] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.390256 10697 raft_consensus.cc:2243] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.391454 10697 raft_consensus.cc:2272] T 131f1a7a55c04d9fbc603cf478a569e9 P 2b9dde5c4f214924a3e28f74351d72eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.394658 10697 tablet_replica.cc:333] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.395637 10697 raft_consensus.cc:2243] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.396531 10697 raft_consensus.cc:2272] T b8667f7d6fc24ab5953a0cb0b728f28c P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.401134 10697 tablet_replica.cc:333] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.402050 10697 raft_consensus.cc:2243] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.402801 10697 raft_consensus.cc:2272] T 8e159d2e8cc24f1fb2a5dcdcf41890ef P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.405602 10697 tablet_replica.cc:333] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.406318 10697 raft_consensus.cc:2243] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.406972 10697 raft_consensus.cc:2272] T ac18649239a34d48b6ebd3fa05651847 P 2b9dde5c4f214924a3e28f74351d72eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.409821 10697 tablet_replica.cc:333] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.410475 10697 raft_consensus.cc:2243] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.411271 10697 raft_consensus.cc:2272] T f86c7d7a9a8c4c959a2dbbc669d195bc P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.414143 10697 tablet_replica.cc:333] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.414772 10697 raft_consensus.cc:2243] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.415432 10697 raft_consensus.cc:2272] T daa244f418d04148b0435b1f17b71534 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.418212 10697 tablet_replica.cc:333] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.418793 10697 raft_consensus.cc:2243] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.420159 10697 raft_consensus.cc:2272] T 76b1897177794a36b78693d594d976ad P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.423149 10697 tablet_replica.cc:333] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb: stopping tablet replica
I20260709 12:14:25.423756 10697 raft_consensus.cc:2243] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.424434 10697 raft_consensus.cc:2272] T a3854f00958e4ced815c758230862f17 P 2b9dde5c4f214924a3e28f74351d72eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.478365 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:14:25.530182 10697 master.cc:562] Master@127.10.114.126:35205 shutting down...
I20260709 12:14:25.561522 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.562628 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.563006 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P 996d4b1c7c8c4df0af9fe32ede04d4c3: stopping tablet replica
I20260709 12:14:25.588259 10697 master.cc:584] Master@127.10.114.126:35205 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21618 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:14:25.661098 10697 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.114.126:45595
I20260709 12:14:25.662621 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:25.668552 22661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:25.669147 22662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:25.670290 22664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:25.671563 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:25.672791 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:25.672976 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:25.673202 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599265673164 us; error 0 us; skew 500 ppm
I20260709 12:14:25.673848 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:25.676472 10697 webserver.cc:533] Webserver started at http://127.10.114.126:43547/ using document root <none> and password file <none>
I20260709 12:14:25.677007 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:25.677213 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:25.677515 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:25.679039 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/master-0-root/instance:
uuid: "a22d8ac9603a4176ab2e7963df24f9b6"
format_stamp: "Formatted at 2026-07-09 12:14:25 on dist-test-slave-08l4"
I20260709 12:14:25.684131 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:14:25.688257 22669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:25.689091 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:25.689417 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/master-0-root
uuid: "a22d8ac9603a4176ab2e7963df24f9b6"
format_stamp: "Formatted at 2026-07-09 12:14:25 on dist-test-slave-08l4"
I20260709 12:14:25.689822 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:25.699832 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:25.701264 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:25.747553 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.126:45595
I20260709 12:14:25.747696 22720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.126:45595 every 8 connection(s)
I20260709 12:14:25.752427 22721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:25.767958 22721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: Bootstrap starting.
I20260709 12:14:25.773658 22721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.778712 22721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: No bootstrap required, opened a new log
I20260709 12:14:25.781334 22721 raft_consensus.cc:359] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER }
I20260709 12:14:25.781858 22721 raft_consensus.cc:385] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.782047 22721 raft_consensus.cc:740] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a22d8ac9603a4176ab2e7963df24f9b6, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.782725 22721 consensus_queue.cc:260] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER }
I20260709 12:14:25.783217 22721 raft_consensus.cc:399] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:25.783425 22721 raft_consensus.cc:493] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:25.783654 22721 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.789426 22721 raft_consensus.cc:515] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER }
I20260709 12:14:25.790032 22721 leader_election.cc:304] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a22d8ac9603a4176ab2e7963df24f9b6; no voters: 
I20260709 12:14:25.791267 22721 leader_election.cc:290] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:25.791853 22724 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:25.793459 22724 raft_consensus.cc:697] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 1 LEADER]: Becoming Leader. State: Replica: a22d8ac9603a4176ab2e7963df24f9b6, State: Running, Role: LEADER
I20260709 12:14:25.794278 22724 consensus_queue.cc:237] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER }
I20260709 12:14:25.794866 22721 sys_catalog.cc:565] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:25.801246 22726 sys_catalog.cc:455] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a22d8ac9603a4176ab2e7963df24f9b6. Latest consensus state: current_term: 1 leader_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER } }
I20260709 12:14:25.802008 22726 sys_catalog.cc:458] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:25.803820 22725 sys_catalog.cc:455] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a22d8ac9603a4176ab2e7963df24f9b6" member_type: VOTER } }
I20260709 12:14:25.804250 22731 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:25.804574 22725 sys_catalog.cc:458] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:25.810598 22731 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:25.813825 10697 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:25.821817 22731 catalog_manager.cc:1383] Generated new cluster ID: fdf1e16a22d0426694b58c0855c63133
I20260709 12:14:25.822188 22731 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:25.851060 22731 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:25.852733 22731 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:25.867600 22731 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: Generated new TSK 0
I20260709 12:14:25.868372 22731 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:25.882020 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:25.889528 22742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:25.890718 22743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:25.894094 22745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:25.897047 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:25.898403 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:25.898605 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:25.898778 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599265898763 us; error 0 us; skew 500 ppm
I20260709 12:14:25.899298 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:25.901886 10697 webserver.cc:533] Webserver started at http://127.10.114.65:43251/ using document root <none> and password file <none>
I20260709 12:14:25.902387 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:25.902549 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:25.902783 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:25.904013 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-0-root/instance:
uuid: "5a0fdbf077294379970db4d8b22f74b8"
format_stamp: "Formatted at 2026-07-09 12:14:25 on dist-test-slave-08l4"
I20260709 12:14:25.909195 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:25.913259 22750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:25.914196 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:25.914549 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-0-root
uuid: "5a0fdbf077294379970db4d8b22f74b8"
format_stamp: "Formatted at 2026-07-09 12:14:25 on dist-test-slave-08l4"
I20260709 12:14:25.914882 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:25.929131 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:25.930683 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:25.932456 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:25.935276 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:25.935523 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:25.935801 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:25.935998 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:25.986644 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.65:38103
I20260709 12:14:25.986809 22812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.65:38103 every 8 connection(s)
I20260709 12:14:25.992697 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:26.003046 22817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:26.006111 22818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:26.008956 10697 server_base.cc:1061] running on GCE node
W20260709 12:14:26.009441 22820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:26.011003 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:26.011305 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:26.011493 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599266011477 us; error 0 us; skew 500 ppm
I20260709 12:14:26.012140 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:26.014462 22813 heartbeater.cc:344] Connected to a master server at 127.10.114.126:45595
I20260709 12:14:26.014933 22813 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:26.015426 10697 webserver.cc:533] Webserver started at http://127.10.114.66:42329/ using document root <none> and password file <none>
I20260709 12:14:26.016077 22813 heartbeater.cc:507] Master 127.10.114.126:45595 requested a full tablet report, sending...
I20260709 12:14:26.016263 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:26.016571 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:26.016950 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:26.018656 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-1-root/instance:
uuid: "1d6712191714461bb98713ea89b05425"
format_stamp: "Formatted at 2026-07-09 12:14:26 on dist-test-slave-08l4"
I20260709 12:14:26.018821 22686 ts_manager.cc:194] Registered new tserver with Master: 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103)
I20260709 12:14:26.021742 22686 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38630
I20260709 12:14:26.024987 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:14:26.029594 22825 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.030519 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:26.030886 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-1-root
uuid: "1d6712191714461bb98713ea89b05425"
format_stamp: "Formatted at 2026-07-09 12:14:26 on dist-test-slave-08l4"
I20260709 12:14:26.031241 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:26.056699 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:26.058331 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:26.060065 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:26.062788 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:26.063045 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.063304 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:26.063512 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.111747 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.66:37935
I20260709 12:14:26.111981 22887 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.66:37935 every 8 connection(s)
I20260709 12:14:26.117439 10697 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:26.126241 22891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:26.128837 22892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:26.130412 22894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:26.132871 22888 heartbeater.cc:344] Connected to a master server at 127.10.114.126:45595
I20260709 12:14:26.133375 22888 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:26.133492 10697 server_base.cc:1061] running on GCE node
I20260709 12:14:26.134418 22888 heartbeater.cc:507] Master 127.10.114.126:45595 requested a full tablet report, sending...
I20260709 12:14:26.134786 10697 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:26.135067 10697 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:26.135259 10697 hybrid_clock.cc:648] HybridClock initialized: now 1783599266135241 us; error 0 us; skew 500 ppm
I20260709 12:14:26.136071 10697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:26.136965 22686 ts_manager.cc:194] Registered new tserver with Master: 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:26.138957 22686 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38638
I20260709 12:14:26.139205 10697 webserver.cc:533] Webserver started at http://127.10.114.67:46089/ using document root <none> and password file <none>
I20260709 12:14:26.139932 10697 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:26.140189 10697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:26.140518 10697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:26.142004 10697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-2-root/instance:
uuid: "4b9317ffa3014610919433e0f17a80c0"
format_stamp: "Formatted at 2026-07-09 12:14:26 on dist-test-slave-08l4"
I20260709 12:14:26.147177 10697 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:26.151161 22899 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.151971 10697 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:26.152307 10697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-2-root
uuid: "4b9317ffa3014610919433e0f17a80c0"
format_stamp: "Formatted at 2026-07-09 12:14:26 on dist-test-slave-08l4"
I20260709 12:14:26.152599 10697 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkYz7F8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894049046-10697-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:26.172695 10697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:26.174288 10697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:26.176002 10697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:26.178725 10697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:26.178920 10697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.179231 10697 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:26.179407 10697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:26.227461 10697 rpc_server.cc:307] RPC server started. Bound to: 127.10.114.67:45191
I20260709 12:14:26.227591 22961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.114.67:45191 every 8 connection(s)
I20260709 12:14:26.244406 22962 heartbeater.cc:344] Connected to a master server at 127.10.114.126:45595
I20260709 12:14:26.244978 22962 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:26.245899 22962 heartbeater.cc:507] Master 127.10.114.126:45595 requested a full tablet report, sending...
I20260709 12:14:26.248118 22686 ts_manager.cc:194] Registered new tserver with Master: 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.248395 10697 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017324125s
I20260709 12:14:26.249845 22686 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38644
I20260709 12:14:26.279994 22686 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38658:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:26.283181 22686 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:26.360368 22853 tablet_service.cc:1511] Processing CreateTablet for tablet dcef81395f40461d98fa8200460db3ea (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:26.360754 22852 tablet_service.cc:1511] Processing CreateTablet for tablet 74d98dcf7da143dd90c25a48d77d05f6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:26.362424 22853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcef81395f40461d98fa8200460db3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.363270 22852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d98dcf7da143dd90c25a48d77d05f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.375773 22778 tablet_service.cc:1511] Processing CreateTablet for tablet dcef81395f40461d98fa8200460db3ea (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:26.378793 22777 tablet_service.cc:1511] Processing CreateTablet for tablet 74d98dcf7da143dd90c25a48d77d05f6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:26.377480 22778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcef81395f40461d98fa8200460db3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.386052 22777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d98dcf7da143dd90c25a48d77d05f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.400202 22853 tablet_service.cc:1511] Processing CreateTablet for tablet 5be59d1d165244dfa1164fb844d3ecff (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:26.401990 22853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be59d1d165244dfa1164fb844d3ecff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.403295 22926 tablet_service.cc:1511] Processing CreateTablet for tablet 74d98dcf7da143dd90c25a48d77d05f6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:26.405197 22926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d98dcf7da143dd90c25a48d77d05f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.407390 22925 tablet_service.cc:1511] Processing CreateTablet for tablet 5be59d1d165244dfa1164fb844d3ecff (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:26.408769 22849 tablet_service.cc:1511] Processing CreateTablet for tablet 9adf59b620814dd184bf594b18b063c6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:26.410398 22849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adf59b620814dd184bf594b18b063c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.411350 22923 tablet_service.cc:1511] Processing CreateTablet for tablet 7c23da28b775471cabe6b849c0229e5c (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:26.415467 22850 tablet_service.cc:1511] Processing CreateTablet for tablet 7c23da28b775471cabe6b849c0229e5c (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:26.416815 22773 tablet_service.cc:1511] Processing CreateTablet for tablet 9adf59b620814dd184bf594b18b063c6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:26.418393 22773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adf59b620814dd184bf594b18b063c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.419356 22776 tablet_service.cc:1511] Processing CreateTablet for tablet 5be59d1d165244dfa1164fb844d3ecff (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:26.401321 22927 tablet_service.cc:1511] Processing CreateTablet for tablet dcef81395f40461d98fa8200460db3ea (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:26.423460 22775 tablet_service.cc:1511] Processing CreateTablet for tablet 74c86b130f4c4908b7c4426ecfcccb51 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:26.426591 22850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c23da28b775471cabe6b849c0229e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.432268 22847 tablet_service.cc:1511] Processing CreateTablet for tablet c1ffca70b11f43b7af441db56ba64464 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:26.427332 22774 tablet_service.cc:1511] Processing CreateTablet for tablet 7c23da28b775471cabe6b849c0229e5c (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:26.433614 22920 tablet_service.cc:1511] Processing CreateTablet for tablet c1ffca70b11f43b7af441db56ba64464 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:26.421367 22776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be59d1d165244dfa1164fb844d3ecff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.434829 22770 tablet_service.cc:1511] Processing CreateTablet for tablet 222905fa333c4fc3aa29a0b31fc170cf (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:26.436285 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 222905fa333c4fc3aa29a0b31fc170cf (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:26.436844 22848 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9e39336cf94298b6800cd6bb7c8c39 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:26.429695 22772 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9e39336cf94298b6800cd6bb7c8c39 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:26.438323 22848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9e39336cf94298b6800cd6bb7c8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.429956 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 9adf59b620814dd184bf594b18b063c6 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:26.430919 22771 tablet_service.cc:1511] Processing CreateTablet for tablet c1ffca70b11f43b7af441db56ba64464 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:26.440832 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be59d1d165244dfa1164fb844d3ecff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.441597 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ffca70b11f43b7af441db56ba64464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.430984 22924 tablet_service.cc:1511] Processing CreateTablet for tablet 74c86b130f4c4908b7c4426ecfcccb51 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:26.432287 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9e39336cf94298b6800cd6bb7c8c39 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:26.428917 22851 tablet_service.cc:1511] Processing CreateTablet for tablet 74c86b130f4c4908b7c4426ecfcccb51 (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:26.430023 22846 tablet_service.cc:1511] Processing CreateTablet for tablet 222905fa333c4fc3aa29a0b31fc170cf (DEFAULT_TABLE table=test-workload [id=b8456b765528496091ceb315a776bef5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:26.449175 22770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222905fa333c4fc3aa29a0b31fc170cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.449954 22771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ffca70b11f43b7af441db56ba64464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.450644 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c86b130f4c4908b7c4426ecfcccb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.452576 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9e39336cf94298b6800cd6bb7c8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.453102 22851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c86b130f4c4908b7c4426ecfcccb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.457942 22846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222905fa333c4fc3aa29a0b31fc170cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.458330 22927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcef81395f40461d98fa8200460db3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.461930 22847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ffca70b11f43b7af441db56ba64464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.465969 22772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9e39336cf94298b6800cd6bb7c8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.469916 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adf59b620814dd184bf594b18b063c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.474006 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222905fa333c4fc3aa29a0b31fc170cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.474143 22775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c86b130f4c4908b7c4426ecfcccb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.476873 22923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c23da28b775471cabe6b849c0229e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.481969 22774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c23da28b775471cabe6b849c0229e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.566085 22977 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:26.584065 22978 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:26.598361 22979 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:26.589229 22977 tablet_bootstrap.cc:654] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.614773 22979 tablet_bootstrap.cc:654] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.619737 22978 tablet_bootstrap.cc:654] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.635782 22977 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:26.636396 22977 ts_tablet_manager.cc:1403] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.000s
I20260709 12:14:26.637447 22978 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:26.638150 22978 ts_tablet_manager.cc:1403] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.006s
I20260709 12:14:26.639760 22977 raft_consensus.cc:359] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.640633 22977 raft_consensus.cc:385] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.640964 22977 raft_consensus.cc:740] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.641989 22977 consensus_queue.cc:260] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.643052 22978 raft_consensus.cc:359] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.644168 22978 raft_consensus.cc:385] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.644644 22978 raft_consensus.cc:740] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.647694 22888 heartbeater.cc:499] Master 127.10.114.126:45595 was elected leader, sending a full tablet report...
I20260709 12:14:26.648468 22979 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:26.647895 22978 consensus_queue.cc:260] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.649061 22979 ts_tablet_manager.cc:1403] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.025s
I20260709 12:14:26.649837 22977 ts_tablet_manager.cc:1434] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:14:26.651101 22977 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:26.652585 22979 raft_consensus.cc:359] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.653565 22979 raft_consensus.cc:385] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.653888 22979 raft_consensus.cc:740] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.654771 22979 consensus_queue.cc:260] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.658658 22978 ts_tablet_manager.cc:1434] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 12:14:26.659657 22962 heartbeater.cc:499] Master 127.10.114.126:45595 was elected leader, sending a full tablet report...
I20260709 12:14:26.661010 22977 tablet_bootstrap.cc:654] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.669826 22978 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:26.678695 22978 tablet_bootstrap.cc:654] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.691666 22978 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:26.692414 22978 ts_tablet_manager.cc:1403] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 12:14:26.696195 22978 raft_consensus.cc:359] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.697192 22978 raft_consensus.cc:385] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.700006 22813 heartbeater.cc:499] Master 127.10.114.126:45595 was elected leader, sending a full tablet report...
I20260709 12:14:26.697582 22978 raft_consensus.cc:740] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.701749 22978 consensus_queue.cc:260] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.702324 22977 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:26.703090 22977 ts_tablet_manager.cc:1403] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.026s
I20260709 12:14:26.704533 22978 ts_tablet_manager.cc:1434] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:14:26.705960 22978 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:26.706712 22977 raft_consensus.cc:359] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.707592 22977 raft_consensus.cc:385] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.708815 22977 raft_consensus.cc:740] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.700220 22979 ts_tablet_manager.cc:1434] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.051s	user 0.012s	sys 0.039s
I20260709 12:14:26.709925 22977 consensus_queue.cc:260] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.711100 22979 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:26.712598 22977 ts_tablet_manager.cc:1434] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:14:26.715667 22978 tablet_bootstrap.cc:654] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.715826 22977 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:26.724529 22977 tablet_bootstrap.cc:654] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.724869 22979 tablet_bootstrap.cc:654] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:26.732232 22963 tablet.cc:2406] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:26.743587 22977 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:26.744359 22977 ts_tablet_manager.cc:1403] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.014s
I20260709 12:14:26.747864 22977 raft_consensus.cc:359] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.748639 22977 raft_consensus.cc:385] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.748956 22977 raft_consensus.cc:740] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.750197 22977 consensus_queue.cc:260] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.752418 22979 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:26.752519 22977 ts_tablet_manager.cc:1434] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:14:26.752594 22978 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:26.753616 22979 ts_tablet_manager.cc:1403] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.012s
I20260709 12:14:26.753933 22978 ts_tablet_manager.cc:1403] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.022s
I20260709 12:14:26.754331 22977 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:26.757103 22979 raft_consensus.cc:359] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.757936 22979 raft_consensus.cc:385] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.757412 22978 raft_consensus.cc:359] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.758486 22979 raft_consensus.cc:740] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.758878 22978 raft_consensus.cc:385] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.759301 22978 raft_consensus.cc:740] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.759459 22979 consensus_queue.cc:260] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.760458 22978 consensus_queue.cc:260] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.762584 22977 tablet_bootstrap.cc:654] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.764425 22979 ts_tablet_manager.cc:1434] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:14:26.765815 22979 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:26.766669 22978 ts_tablet_manager.cc:1434] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:14:26.768158 22978 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:26.777642 22978 tablet_bootstrap.cc:654] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.781885 22979 tablet_bootstrap.cc:654] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.797123 22984 raft_consensus.cc:493] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.797832 22979 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:26.797708 22978 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:26.797794 22984 raft_consensus.cc:515] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.798856 22978 ts_tablet_manager.cc:1403] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.004s
I20260709 12:14:26.798854 22979 ts_tablet_manager.cc:1403] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.014s
I20260709 12:14:26.799688 22977 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:26.800393 22977 ts_tablet_manager.cc:1403] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.008s
I20260709 12:14:26.802609 22978 raft_consensus.cc:359] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.803511 22978 raft_consensus.cc:385] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.803105 22979 raft_consensus.cc:359] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.803881 22978 raft_consensus.cc:740] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.804311 22979 raft_consensus.cc:385] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.803928 22977 raft_consensus.cc:359] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.804898 22977 raft_consensus.cc:385] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.804596 22984 leader_election.cc:290] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:26.804821 22979 raft_consensus.cc:740] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.805580 22977 raft_consensus.cc:740] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.804986 22978 consensus_queue.cc:260] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.806457 22979 consensus_queue.cc:260] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.806636 22977 consensus_queue.cc:260] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
W20260709 12:14:26.808465 22734 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:26.809353 22977 ts_tablet_manager.cc:1434] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:26.810411 22983 raft_consensus.cc:493] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.810981 22983 raft_consensus.cc:515] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.814530 22979 ts_tablet_manager.cc:1434] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.008s
I20260709 12:14:26.815593 22983 leader_election.cc:290] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.817727 22978 ts_tablet_manager.cc:1434] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:14:26.819892 22978 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:26.817574 22977 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:26.839483 22979 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:26.853171 22978 tablet_bootstrap.cc:654] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.872176 22983 raft_consensus.cc:493] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.872818 22983 raft_consensus.cc:515] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.875628 22983 leader_election.cc:290] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.882344 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:26.879154 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:26.884403 22983 raft_consensus.cc:493] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.885092 22983 raft_consensus.cc:515] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.887251 22978 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:26.888198 22978 ts_tablet_manager.cc:1403] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.000s
W20260709 12:14:26.888777 22828 leader_election.cc:343] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:26.889657 22828 leader_election.cc:343] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.890745 22983 leader_election.cc:290] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.891232 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:26.892320 22788 raft_consensus.cc:2468] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:26.894040 22828 leader_election.cc:304] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:26.894464 22979 tablet_bootstrap.cc:654] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.895249 22983 raft_consensus.cc:2804] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:26.895772 22983 raft_consensus.cc:493] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.896237 22983 raft_consensus.cc:3060] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.896570 22978 raft_consensus.cc:359] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.897841 22978 raft_consensus.cc:385] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.898469 22978 raft_consensus.cc:740] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.899708 22978 consensus_queue.cc:260] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.904560 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:26.904893 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:26.905750 22937 raft_consensus.cc:2468] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:26.907374 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:26.908601 22983 raft_consensus.cc:515] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.910511 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:26.912916 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:26.913249 22983 leader_election.cc:290] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.913626 22788 raft_consensus.cc:3060] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.913475 22829 leader_election.cc:304] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:26.914819 22983 raft_consensus.cc:2804] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:26.915306 22829 leader_election.cc:343] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.915401 22983 raft_consensus.cc:493] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.916276 22983 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.916031 22829 leader_election.cc:304] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6712191714461bb98713ea89b05425; no voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:26.922658 22978 ts_tablet_manager.cc:1434] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 12:14:26.928516 22788 raft_consensus.cc:2468] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:26.929700 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:26.930241 22828 leader_election.cc:304] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
W20260709 12:14:26.932403 22902 leader_election.cc:343] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.935923 22978 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
W20260709 12:14:26.936264 22902 leader_election.cc:343] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.936801 22902 leader_election.cc:304] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:26.937878 22984 raft_consensus.cc:2749] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.928719 22983 raft_consensus.cc:515] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.939604 23001 raft_consensus.cc:493] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.940281 22977 tablet_bootstrap.cc:654] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.940239 23001 raft_consensus.cc:515] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.942469 22983 leader_election.cc:290] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.944625 23002 raft_consensus.cc:2749] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.945701 22983 raft_consensus.cc:2804] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:26.945822 22829 leader_election.cc:343] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.947333 22983 raft_consensus.cc:697] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:26.948508 22985 raft_consensus.cc:493] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.951810 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:26.952378 22985 raft_consensus.cc:515] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:26.953639 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:26.949436 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:26.949925 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
W20260709 12:14:26.955375 22828 leader_election.cc:343] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.955518 22936 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:26.956398 22829 leader_election.cc:343] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.956894 22829 leader_election.cc:304] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6712191714461bb98713ea89b05425; no voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:26.956558 22983 consensus_queue.cc:237] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
W20260709 12:14:26.958539 22829 leader_election.cc:343] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.958586 23003 raft_consensus.cc:2749] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.968526 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
W20260709 12:14:26.971071 22828 leader_election.cc:343] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.943112 23001 leader_election.cc:290] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.996213 22979 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:26.996531 22985 leader_election.cc:290] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:26.996941 22979 ts_tablet_manager.cc:1403] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.171s	user 0.062s	sys 0.034s
I20260709 12:14:27.001259 22683 catalog_manager.cc:5697] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.002599 22979 raft_consensus.cc:359] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.003643 22936 raft_consensus.cc:2468] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:27.003700 22979 raft_consensus.cc:385] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.004397 22979 raft_consensus.cc:740] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.004873 22978 tablet_bootstrap.cc:654] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.005393 22829 leader_election.cc:304] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.005745 22979 consensus_queue.cc:260] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.006469 22983 raft_consensus.cc:2804] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.008852 22979 ts_tablet_manager.cc:1434] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 12:14:27.010066 22979 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:27.017627 22979 tablet_bootstrap.cc:654] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.020872 22977 tablet_bootstrap.cc:492] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:27.021711 22977 ts_tablet_manager.cc:1403] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.205s	user 0.027s	sys 0.016s
I20260709 12:14:27.025444 22983 raft_consensus.cc:697] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:27.027202 22983 consensus_queue.cc:237] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.047420 22977 raft_consensus.cc:359] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.048804 22977 raft_consensus.cc:385] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.051760 22979 tablet_bootstrap.cc:492] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:27.052522 22979 ts_tablet_manager.cc:1403] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.021s
I20260709 12:14:27.056097 22979 raft_consensus.cc:359] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.056602 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.056962 22979 raft_consensus.cc:385] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.057667 22979 raft_consensus.cc:740] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.058691 22979 consensus_queue.cc:260] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.061020 22979 ts_tablet_manager.cc:1434] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:27.062171 22979 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:27.069278 22979 tablet_bootstrap.cc:654] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.049261 22977 raft_consensus.cc:740] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.072273 22978 tablet_bootstrap.cc:492] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:27.072866 22978 ts_tablet_manager.cc:1403] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.137s	user 0.032s	sys 0.043s
I20260709 12:14:27.076315 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:27.077196 22936 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.075958 22977 consensus_queue.cc:260] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.078552 22863 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.076381 22978 raft_consensus.cc:359] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.080348 22978 raft_consensus.cc:385] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.080704 22978 raft_consensus.cc:740] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.081427 22754 leader_election.cc:304] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.081858 22978 consensus_queue.cc:260] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.082820 22985 raft_consensus.cc:2804] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.083240 22985 raft_consensus.cc:493] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.083616 22985 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.090042 22977 ts_tablet_manager.cc:1434] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 12:14:27.091881 22977 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:27.093991 22979 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:27.094671 22979 ts_tablet_manager.cc:1403] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 12:14:27.090459 22978 ts_tablet_manager.cc:1434] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:14:27.096629 22978 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:27.098479 22979 raft_consensus.cc:359] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.099361 22979 raft_consensus.cc:385] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.099699 22979 raft_consensus.cc:740] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.099804 22977 tablet_bootstrap.cc:654] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.100761 22979 consensus_queue.cc:260] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.104810 22978 tablet_bootstrap.cc:654] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.111609 22979 ts_tablet_manager.cc:1434] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 12:14:27.113263 22977 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:27.114061 22977 ts_tablet_manager.cc:1403] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:14:27.117760 22977 raft_consensus.cc:359] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.118850 22977 raft_consensus.cc:385] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.120549 22977 raft_consensus.cc:740] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.121673 22977 consensus_queue.cc:260] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.124553 22977 ts_tablet_manager.cc:1434] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:27.123836 22684 catalog_manager.cc:5697] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.124958 22978 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:27.125672 22978 ts_tablet_manager.cc:1403] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 12:14:27.126082 22977 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:27.129767 22978 raft_consensus.cc:359] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.130499 22979 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:27.130828 22978 raft_consensus.cc:385] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.131193 22978 raft_consensus.cc:740] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.132139 22978 consensus_queue.cc:260] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.135025 22977 tablet_bootstrap.cc:654] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.138386 22978 ts_tablet_manager.cc:1434] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.005s
I20260709 12:14:27.138931 22979 tablet_bootstrap.cc:654] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.139622 22978 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:27.141319 23015 raft_consensus.cc:493] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.141911 23015 raft_consensus.cc:515] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.143390 22985 raft_consensus.cc:515] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.145606 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
W20260709 12:14:27.149204 22753 leader_election.cc:343] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.150583 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.151397 22978 tablet_bootstrap.cc:654] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.151479 22863 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.155079 22977 tablet_bootstrap.cc:492] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:27.155750 22977 ts_tablet_manager.cc:1403] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.000s
I20260709 12:14:27.156213 22984 raft_consensus.cc:493] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.156528 22985 leader_election.cc:290] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.156872 22984 raft_consensus.cc:515] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.159302 22984 leader_election.cc:290] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.156292 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.159495 22977 raft_consensus.cc:359] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.160495 22936 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.160569 22977 raft_consensus.cc:385] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.161180 22977 raft_consensus.cc:740] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.161237 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.162254 23015 leader_election.cc:290] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.162300 22977 consensus_queue.cc:260] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.164844 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:27.165593 22977 ts_tablet_manager.cc:1434] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:14:27.165987 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adf59b620814dd184bf594b18b063c6" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:27.165683 22935 raft_consensus.cc:2468] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.166471 23015 raft_consensus.cc:493] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.166905 22788 raft_consensus.cc:2393] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b9317ffa3014610919433e0f17a80c0 in current term 1: Already voted for candidate 1d6712191714461bb98713ea89b05425 in this term.
I20260709 12:14:27.167203 22977 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:27.167037 23015 raft_consensus.cc:515] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.167794 22754 leader_election.cc:304] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 1d6712191714461bb98713ea89b05425
I20260709 12:14:27.169803 22902 leader_election.cc:304] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.170601 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.171288 22984 raft_consensus.cc:3060] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.172642 22936 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.173635 22863 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.174356 22754 leader_election.cc:304] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.175642 23015 leader_election.cc:290] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.176350 22977 tablet_bootstrap.cc:654] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.176314 23015 raft_consensus.cc:2804] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.177839 23018 raft_consensus.cc:2804] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.177959 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:27.177968 23015 raft_consensus.cc:493] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.178951 22936 raft_consensus.cc:2393] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a0fdbf077294379970db4d8b22f74b8 in current term 1: Already voted for candidate 1d6712191714461bb98713ea89b05425 in this term.
I20260709 12:14:27.179168 23015 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.184706 22978 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:27.185441 22978 ts_tablet_manager.cc:1403] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.011s
I20260709 12:14:27.189003 22978 raft_consensus.cc:359] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.189248 22754 leader_election.cc:304] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a0fdbf077294379970db4d8b22f74b8; no voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:27.189316 22977 tablet_bootstrap.cc:492] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:27.189823 22978 raft_consensus.cc:385] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.190193 22978 raft_consensus.cc:740] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.190393 22977 ts_tablet_manager.cc:1403] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 12:14:27.190881 22985 raft_consensus.cc:493] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.191434 22985 raft_consensus.cc:515] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.191406 22978 consensus_queue.cc:260] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.194831 22977 raft_consensus.cc:359] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.195958 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.196947 22977 raft_consensus.cc:385] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.197149 22863 raft_consensus.cc:2468] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.197398 22977 raft_consensus.cc:740] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.198545 22977 consensus_queue.cc:260] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.198822 22753 leader_election.cc:304] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.202071 22977 ts_tablet_manager.cc:1434] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:14:27.202286 22978 ts_tablet_manager.cc:1434] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:14:27.203598 22977 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:27.205199 22979 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:27.205834 22979 ts_tablet_manager.cc:1403] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.011s
I20260709 12:14:27.203598 22978 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:27.212479 22977 tablet_bootstrap.cc:654] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.214881 23015 raft_consensus.cc:515] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.218644 23025 raft_consensus.cc:493] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.219364 23025 raft_consensus.cc:515] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.219849 22979 raft_consensus.cc:359] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.221120 22979 raft_consensus.cc:385] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.221582 22979 raft_consensus.cc:740] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.222976 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:27.224761 23015 leader_election.cc:290] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
W20260709 12:14:27.225147 22902 leader_election.cc:343] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.227679 23025 leader_election.cc:290] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.227835 22979 consensus_queue.cc:260] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.230275 22978 tablet_bootstrap.cc:654] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.230760 22979 ts_tablet_manager.cc:1434] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.005s
I20260709 12:14:27.230911 22977 tablet_bootstrap.cc:492] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:27.231353 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.231607 22977 ts_tablet_manager.cc:1403] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 12:14:27.232281 22863 raft_consensus.cc:2468] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:27.233368 23015 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.234640 22902 leader_election.cc:304] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.235486 22977 raft_consensus.cc:359] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.236085 23025 raft_consensus.cc:2804] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.236505 22977 raft_consensus.cc:385] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.236594 23025 raft_consensus.cc:493] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.236917 22977 raft_consensus.cc:740] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.237143 23025 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.238397 22985 leader_election.cc:290] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.239141 22985 raft_consensus.cc:2804] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.239527 22985 raft_consensus.cc:493] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.238435 22977 consensus_queue.cc:260] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.239871 22985 raft_consensus.cc:3060] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.241461 22979 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:27.242393 22977 ts_tablet_manager.cc:1434] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:14:27.244108 22754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:45191, user_credentials={real_user=slave}} blocked reactor thread for 54995.3us
W20260709 12:14:27.249009 22753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.66:37935, user_credentials={real_user=slave}} blocked reactor thread for 50298.8us
I20260709 12:14:27.246433 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.249794 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
W20260709 12:14:27.259541 22754 leader_election.cc:343] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.255998 22978 tablet_bootstrap.cc:492] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:27.261487 23015 raft_consensus.cc:2749] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.251286 22936 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.262180 22978 ts_tablet_manager.cc:1403] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.003s
I20260709 12:14:27.257349 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.261829 22979 tablet_bootstrap.cc:654] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.265906 22863 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.266515 22985 raft_consensus.cc:515] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.270720 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.273458 22978 raft_consensus.cc:359] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.274216 22978 raft_consensus.cc:385] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.274574 22978 raft_consensus.cc:740] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.254643 23018 raft_consensus.cc:697] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.272825 22936 raft_consensus.cc:2468] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.270761 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.276075 22862 raft_consensus.cc:3060] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.276129 22978 consensus_queue.cc:260] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.272936 23025 raft_consensus.cc:515] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
W20260709 12:14:27.272789 22754 leader_election.cc:343] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.279582 22754 leader_election.cc:304] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.281149 23025 leader_election.cc:290] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.281731 22978 ts_tablet_manager.cc:1434] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 12:14:27.283125 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
W20260709 12:14:27.284926 22902 leader_election.cc:343] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.280337 22984 raft_consensus.cc:2749] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.284824 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.287878 22862 raft_consensus.cc:2468] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.288549 22861 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.274375 22985 leader_election.cc:290] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.290524 22753 leader_election.cc:304] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:27.291509 22863 raft_consensus.cc:2468] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.292944 22979 tablet_bootstrap.cc:492] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:27.293480 22979 ts_tablet_manager.cc:1403] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.015s
I20260709 12:14:27.295483 23022 raft_consensus.cc:2804] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.297333 22979 raft_consensus.cc:359] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.298202 22979 raft_consensus.cc:385] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.298532 22979 raft_consensus.cc:740] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.299295 22979 consensus_queue.cc:260] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.300508 23026 raft_consensus.cc:2804] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.301578 23026 raft_consensus.cc:697] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.302888 23030 raft_consensus.cc:493] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.302645 23026 consensus_queue.cc:237] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.303433 23022 raft_consensus.cc:697] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.303619 23030 raft_consensus.cc:515] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.304487 23022 consensus_queue.cc:237] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.301594 22979 ts_tablet_manager.cc:1434] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:27.306809 22979 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:27.307859 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:27.302764 22861 raft_consensus.cc:2468] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:27.308657 22788 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:27.290732 23018 consensus_queue.cc:237] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.310693 22902 leader_election.cc:304] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.314163 22902 leader_election.cc:304] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.314353 22979 tablet_bootstrap.cc:654] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.315132 23025 raft_consensus.cc:2804] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.316509 23025 raft_consensus.cc:697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.317132 23034 raft_consensus.cc:2804] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.317654 23025 consensus_queue.cc:237] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.318365 23034 raft_consensus.cc:493] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.318797 23034 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.325243 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.326159 22861 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:27.327989 22979 tablet_bootstrap.cc:492] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:27.328830 22979 ts_tablet_manager.cc:1403] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:14:27.333267 22979 raft_consensus.cc:359] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.334322 22979 raft_consensus.cc:385] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.334764 22979 raft_consensus.cc:740] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.333973 22684 catalog_manager.cc:5697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.335949 22979 consensus_queue.cc:260] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.337893 22984 raft_consensus.cc:493] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.339246 22984 raft_consensus.cc:515] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.344161 22984 leader_election.cc:290] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.344769 23030 leader_election.cc:290] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.345002 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:27.345393 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.339576 23034 raft_consensus.cc:515] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.340222 22979 ts_tablet_manager.cc:1434] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:14:27.346352 22861 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:27.347779 22902 leader_election.cc:304] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:27.348914 23034 leader_election.cc:290] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.349520 23034 raft_consensus.cc:2804] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.351287 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:27.352339 22787 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.349905 23034 raft_consensus.cc:493] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.353699 23034 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.359091 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.359923 22861 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.361708 22788 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:27.366220 22983 consensus_queue.cc:1048] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.369086 23034 raft_consensus.cc:515] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.374307 22861 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:27.376405 22902 leader_election.cc:304] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:27.378949 23030 raft_consensus.cc:2804] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.382380 23034 leader_election.cc:290] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.386154 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.387024 22861 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.388600 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:27.389354 22786 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.390650 22787 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:27.391039 22684 catalog_manager.cc:5697] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.383008 23030 raft_consensus.cc:697] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.394469 23030 consensus_queue.cc:237] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.396029 22861 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:27.397369 22902 leader_election.cc:304] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:27.398799 23034 raft_consensus.cc:2804] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.399376 23034 raft_consensus.cc:697] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.400259 23034 consensus_queue.cc:237] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.413965 23001 consensus_queue.cc:1048] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.419724 22786 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:27.433329 22684 catalog_manager.cc:5697] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.440533 22683 catalog_manager.cc:5697] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.442854 22683 catalog_manager.cc:5697] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.453208 23026 raft_consensus.cc:493] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.454063 23026 raft_consensus.cc:515] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.453763 22684 catalog_manager.cc:5697] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.457036 23026 leader_election.cc:290] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.457978 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:27.459127 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.459926 22861 raft_consensus.cc:2468] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.460829 22936 raft_consensus.cc:2468] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:27.461151 22753 leader_election.cc:304] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.462276 23026 raft_consensus.cc:2804] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.462683 23026 raft_consensus.cc:493] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.463076 23026 raft_consensus.cc:3060] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.472288 23026 raft_consensus.cc:515] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.474225 23026 leader_election.cc:290] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.475126 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.475363 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c86b130f4c4908b7c4426ecfcccb51" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.475867 22861 raft_consensus.cc:3060] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.476002 22936 raft_consensus.cc:3060] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.482147 22861 raft_consensus.cc:2468] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.482148 22936 raft_consensus.cc:2468] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:27.483546 22754 leader_election.cc:304] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.484402 23026 raft_consensus.cc:2804] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.484935 23026 raft_consensus.cc:697] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.485850 23030 raft_consensus.cc:493] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.485816 23026 consensus_queue.cc:237] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.486393 23030 raft_consensus.cc:515] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.488536 23030 leader_election.cc:290] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103)
I20260709 12:14:27.489480 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.489995 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcef81395f40461d98fa8200460db3ea" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:27.490548 22861 raft_consensus.cc:2393] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b9317ffa3014610919433e0f17a80c0 in current term 1: Already voted for candidate 5a0fdbf077294379970db4d8b22f74b8 in this term.
I20260709 12:14:27.492903 22902 leader_election.cc:304] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.493857 23030 raft_consensus.cc:3060] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.497164 22683 catalog_manager.cc:5697] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.502573 23030 raft_consensus.cc:2749] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.554039 23001 consensus_queue.cc:1048] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.566735 22983 consensus_queue.cc:1048] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.610074 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6"
dest_uuid: "1d6712191714461bb98713ea89b05425"
mode: GRACEFUL
new_leader_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:47130
I20260709 12:14:27.610800 22861 raft_consensus.cc:606] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Received request to transfer leadership to TS 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.627133 22935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
mode: GRACEFUL
new_leader_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:14:27.627804 22935 raft_consensus.cc:606] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Received request to transfer leadership to TS 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.645076 23026 raft_consensus.cc:493] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.645869 23026 raft_consensus.cc:515] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.648267 22788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
mode: GRACEFUL
new_leader_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:38070
I20260709 12:14:27.648273 23026 leader_election.cc:290] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.648931 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:27.649119 22788 raft_consensus.cc:606] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Received request to transfer leadership to TS 1d6712191714461bb98713ea89b05425
I20260709 12:14:27.649525 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:27.649900 22861 raft_consensus.cc:2393] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a0fdbf077294379970db4d8b22f74b8 in current term 1: Already voted for candidate 4b9317ffa3014610919433e0f17a80c0 in this term.
I20260709 12:14:27.651336 22754 leader_election.cc:304] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a0fdbf077294379970db4d8b22f74b8; no voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:27.652124 23026 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.659693 22935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
mode: GRACEFUL
new_leader_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:14:27.660084 23026 raft_consensus.cc:2749] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.660533 22935 raft_consensus.cc:606] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Received request to transfer leadership to TS 1d6712191714461bb98713ea89b05425
I20260709 12:14:27.667253 22935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
mode: GRACEFUL
new_leader_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:14:27.667872 22935 raft_consensus.cc:606] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Received request to transfer leadership to TS 1d6712191714461bb98713ea89b05425
I20260709 12:14:27.674163 22788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
mode: GRACEFUL
new_leader_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:38070
I20260709 12:14:27.674753 22788 raft_consensus.cc:606] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Received request to transfer leadership to TS 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:27.732242 23030 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.735517 23026 consensus_queue.cc:1048] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.739638 23018 consensus_queue.cc:1048] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.748175 23034 raft_consensus.cc:993] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: : Instructing follower 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:27.754104 23018 consensus_queue.cc:1048] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.759769 23030 raft_consensus.cc:1081] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Signalling peer 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:27.760934 22984 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.767211 22861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39"
dest_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:47112
I20260709 12:14:27.768172 22861 raft_consensus.cc:493] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.768671 22861 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.769073 23022 raft_consensus.cc:993] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: : Instructing follower 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:27.769748 23022 raft_consensus.cc:1081] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Signalling peer 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:27.772352 22936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:44776
I20260709 12:14:27.773079 22936 raft_consensus.cc:493] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.773511 22936 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.775348 23018 consensus_queue.cc:1048] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.784472 22936 raft_consensus.cc:515] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.786149 22861 raft_consensus.cc:515] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.788589 22861 leader_election.cc:290] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.791733 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:27.792659 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.793485 22935 raft_consensus.cc:3055] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.793998 22935 raft_consensus.cc:740] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.794474 23034 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.795323 22935 consensus_queue.cc:260] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.797833 22935 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.798595 22936 leader_election.cc:290] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:27.801721 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:27.802512 22786 raft_consensus.cc:3055] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.802932 22786 raft_consensus.cc:740] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.803936 22786 consensus_queue.cc:260] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.801757 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222905fa333c4fc3aa29a0b31fc170cf" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.808656 22860 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.808948 23018 raft_consensus.cc:993] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: : Instructing follower 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:27.809597 23018 raft_consensus.cc:1081] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Signalling peer 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:27.805444 22786 raft_consensus.cc:3060] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.812386 22863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c"
dest_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:47120
I20260709 12:14:27.813055 22863 raft_consensus.cc:493] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.813498 22863 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.808537 22935 raft_consensus.cc:2468] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:27.820516 23026 consensus_queue.cc:1048] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.821213 22829 leader_election.cc:304] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:27.822467 22860 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 2.
I20260709 12:14:27.823145 23001 raft_consensus.cc:2804] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.823841 23001 raft_consensus.cc:697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:27.826517 22786 raft_consensus.cc:2468] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 2.
I20260709 12:14:27.827310 22902 leader_election.cc:304] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:27.828176 22863 raft_consensus.cc:515] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.829512 23034 raft_consensus.cc:2804] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.830336 23034 raft_consensus.cc:697] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.824997 23001 consensus_queue.cc:237] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.831583 23034 consensus_queue.cc:237] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.832945 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:27.848028 22863 leader_election.cc:290] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.850441 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c23da28b775471cabe6b849c0229e5c" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.851346 22936 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.860491 22985 consensus_queue.cc:1048] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.863498 22936 raft_consensus.cc:2468] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:27.847710 22786 raft_consensus.cc:3055] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.865274 22829 leader_election.cc:304] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:27.866557 22786 raft_consensus.cc:740] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.867059 23003 raft_consensus.cc:2804] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.868484 23003 raft_consensus.cc:697] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:27.869846 23003 consensus_queue.cc:237] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.874526 22684 catalog_manager.cc:5697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 1 to 2, leader changed from 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67) to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.878121 22786 consensus_queue.cc:260] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.879992 22786 raft_consensus.cc:3060] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.885658 22984 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.899834 22681 catalog_manager.cc:5697] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 1 to 2, leader changed from 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65) to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.903142 22786 raft_consensus.cc:2468] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:27.912137 23030 raft_consensus.cc:993] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: : Instructing follower 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:27.912657 22984 raft_consensus.cc:1081] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Signalling peer 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:27.914422 22788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:38052
I20260709 12:14:27.915310 22788 raft_consensus.cc:493] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.914397 22683 catalog_manager.cc:5697] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 1 to 2, leader changed from 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65) to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.915695 22788 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.925223 22788 raft_consensus.cc:515] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.927531 22788 leader_election.cc:290] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:27.928509 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:27.928830 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:27.929368 22861 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.929597 22935 raft_consensus.cc:3055] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.930076 22935 raft_consensus.cc:740] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:27.931010 22935 consensus_queue.cc:260] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.932493 22935 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.938241 22861 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:27.939610 22753 leader_election.cc:304] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:27.940594 23015 raft_consensus.cc:2804] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.941191 23015 raft_consensus.cc:697] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:27.942451 22935 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:27.942274 23015 consensus_queue.cc:237] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:27.943771 22985 consensus_queue.cc:1048] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.952389 22681 catalog_manager.cc:5697] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 1 to 2, leader changed from 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67) to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.955129 23015 consensus_queue.cc:1048] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:28.000998 22984 consensus_queue.cc:1048] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:28.008940 23030 raft_consensus.cc:993] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: : Instructing follower 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:28.009593 23034 raft_consensus.cc:1081] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Signalling peer 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:28.013429 22862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464"
dest_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:47112
I20260709 12:14:28.014169 22862 raft_consensus.cc:493] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.014560 22862 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.016152 23025 consensus_queue.cc:1048] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:28.024946 22862 raft_consensus.cc:515] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.027733 22861 raft_consensus.cc:1240] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Rejecting Update request from peer 4b9317ffa3014610919433e0f17a80c0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.030141 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:28.030836 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ffca70b11f43b7af441db56ba64464" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:28.031033 22788 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.031550 22935 raft_consensus.cc:3055] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.031945 22935 raft_consensus.cc:740] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:28.032922 22935 consensus_queue.cc:260] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.034495 22935 raft_consensus.cc:3060] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.036651 22862 leader_election.cc:290] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:28.041875 22935 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:28.041875 22788 raft_consensus.cc:2468] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:28.043437 22829 leader_election.cc:304] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:28.044430 23001 raft_consensus.cc:2804] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.045013 23001 raft_consensus.cc:697] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:28.046018 23001 consensus_queue.cc:237] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.053390 22681 catalog_manager.cc:5697] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 1 to 2, leader changed from 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67) to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.113251 22983 raft_consensus.cc:993] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: : Instructing follower 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:28.113852 23001 raft_consensus.cc:1081] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Signalling peer 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:28.115500 22788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:38064
I20260709 12:14:28.116089 22788 raft_consensus.cc:493] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.116432 22788 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.122542 22788 raft_consensus.cc:515] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.124468 22788 leader_election.cc:290] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:28.125726 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:28.125548 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d98dcf7da143dd90c25a48d77d05f6" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:28.126459 22935 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.126536 22862 raft_consensus.cc:3055] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.127043 22862 raft_consensus.cc:740] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:28.127962 22862 consensus_queue.cc:260] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.129370 22862 raft_consensus.cc:3060] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.135342 22935 raft_consensus.cc:2468] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:28.136914 22754 leader_election.cc:304] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:28.137619 22862 raft_consensus.cc:2468] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:28.137814 23015 raft_consensus.cc:2804] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.138422 23015 raft_consensus.cc:697] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:28.139370 23015 consensus_queue.cc:237] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:28.147146 22681 catalog_manager.cc:5697] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 1 to 2, leader changed from 1d6712191714461bb98713ea89b05425 (127.10.114.66) to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.287539 22788 raft_consensus.cc:1275] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.289078 23025 consensus_queue.cc:1048] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.297235 22862 raft_consensus.cc:1275] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.299378 23034 consensus_queue.cc:1048] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.341504 22935 raft_consensus.cc:1275] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.343111 23001 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.350589 22788 raft_consensus.cc:1275] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.352739 23003 consensus_queue.cc:1048] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.353402 22788 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.365077 22935 raft_consensus.cc:1275] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.367157 22983 consensus_queue.cc:1048] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.367200 22936 raft_consensus.cc:1275] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.369467 23022 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.374944 22788 raft_consensus.cc:1275] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.379261 23001 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:28.387236 22861 raft_consensus.cc:1275] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.388834 23015 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.482563 22788 raft_consensus.cc:1275] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.484159 23001 consensus_queue.cc:1048] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.492990 22936 raft_consensus.cc:1275] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.494653 23001 consensus_queue.cc:1048] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.642043 22936 raft_consensus.cc:1275] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.643535 23065 consensus_queue.cc:1048] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.653918 22861 raft_consensus.cc:1275] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.656780 22985 consensus_queue.cc:1048] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:30.724148 22684 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59582:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:30.726697 22684 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:30.784852 22776 tablet_service.cc:1511] Processing CreateTablet for tablet 81f75985bac34212af112a33371315ae (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:30.785970 22851 tablet_service.cc:1511] Processing CreateTablet for tablet 81f75985bac34212af112a33371315ae (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:30.786487 22776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f75985bac34212af112a33371315ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.787432 22851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f75985bac34212af112a33371315ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.787320 22927 tablet_service.cc:1511] Processing CreateTablet for tablet 81f75985bac34212af112a33371315ae (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:30.788636 22927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f75985bac34212af112a33371315ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.792088 22772 tablet_service.cc:1511] Processing CreateTablet for tablet b010ba4af92d48af888fa9925c8ee367 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:30.792538 22847 tablet_service.cc:1511] Processing CreateTablet for tablet b010ba4af92d48af888fa9925c8ee367 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:30.793684 22772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010ba4af92d48af888fa9925c8ee367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.793913 22847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010ba4af92d48af888fa9925c8ee367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.797412 22926 tablet_service.cc:1511] Processing CreateTablet for tablet bd286fa593a54e44ba0c7af9eb628bb4 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:30.799002 22926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd286fa593a54e44ba0c7af9eb628bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.799467 22775 tablet_service.cc:1511] Processing CreateTablet for tablet bd286fa593a54e44ba0c7af9eb628bb4 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:30.800315 22850 tablet_service.cc:1511] Processing CreateTablet for tablet bd286fa593a54e44ba0c7af9eb628bb4 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:30.801739 22850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd286fa593a54e44ba0c7af9eb628bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.802098 22778 tablet_service.cc:1511] Processing CreateTablet for tablet b7b7f990da8c44099ccf21a815c4132c (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:30.800827 22775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd286fa593a54e44ba0c7af9eb628bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.806862 22778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b7f990da8c44099ccf21a815c4132c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.798629 22925 tablet_service.cc:1511] Processing CreateTablet for tablet b010ba4af92d48af888fa9925c8ee367 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:30.810676 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b010ba4af92d48af888fa9925c8ee367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.827508 22848 tablet_service.cc:1511] Processing CreateTablet for tablet b7b7f990da8c44099ccf21a815c4132c (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:30.829170 22848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b7f990da8c44099ccf21a815c4132c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.832269 22922 tablet_service.cc:1511] Processing CreateTablet for tablet b7b7f990da8c44099ccf21a815c4132c (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:30.832368 22777 tablet_service.cc:1511] Processing CreateTablet for tablet 88796f34c90e411093004e363d11d6e9 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:30.840274 22777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88796f34c90e411093004e363d11d6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.842454 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b7f990da8c44099ccf21a815c4132c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.860122 22846 tablet_service.cc:1511] Processing CreateTablet for tablet 88796f34c90e411093004e363d11d6e9 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:30.861864 22846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88796f34c90e411093004e363d11d6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.866569 22923 tablet_service.cc:1511] Processing CreateTablet for tablet 88796f34c90e411093004e363d11d6e9 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:30.868237 22923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88796f34c90e411093004e363d11d6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.869001 22771 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea4039dfedc47f2b3189c8279d6efdd (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:30.870574 22771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea4039dfedc47f2b3189c8279d6efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.888548 22920 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea4039dfedc47f2b3189c8279d6efdd (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:30.890300 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea4039dfedc47f2b3189c8279d6efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.889988 22847 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea4039dfedc47f2b3189c8279d6efdd (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:30.891305 22774 tablet_service.cc:1511] Processing CreateTablet for tablet bda7181f54764982b462aaab78ba1917 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:30.892948 22774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda7181f54764982b462aaab78ba1917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.893745 22847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea4039dfedc47f2b3189c8279d6efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.897814 22849 tablet_service.cc:1511] Processing CreateTablet for tablet bda7181f54764982b462aaab78ba1917 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:30.899362 22849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda7181f54764982b462aaab78ba1917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.911675 22921 tablet_service.cc:1511] Processing CreateTablet for tablet bda7181f54764982b462aaab78ba1917 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:30.913287 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda7181f54764982b462aaab78ba1917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.922519 22853 tablet_service.cc:1511] Processing CreateTablet for tablet 8002f41aaf7f436abfa8b9095a09ebf1 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:30.924158 22853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002f41aaf7f436abfa8b9095a09ebf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.926887 23083 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
W20260709 12:14:30.927320 22734 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:30.930787 23084 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:30.943481 22926 tablet_service.cc:1511] Processing CreateTablet for tablet 8002f41aaf7f436abfa8b9095a09ebf1 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:30.945906 22926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002f41aaf7f436abfa8b9095a09ebf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.922519 22775 tablet_service.cc:1511] Processing CreateTablet for tablet 8002f41aaf7f436abfa8b9095a09ebf1 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:30.947063 22775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8002f41aaf7f436abfa8b9095a09ebf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.956688 22852 tablet_service.cc:1511] Processing CreateTablet for tablet f82574060263464baab9dad1d23232f8 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:30.958323 22852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82574060263464baab9dad1d23232f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.957701 22771 tablet_service.cc:1511] Processing CreateTablet for tablet f82574060263464baab9dad1d23232f8 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:30.959522 22771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82574060263464baab9dad1d23232f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.964738 23083 tablet_bootstrap.cc:654] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.973524 22927 tablet_service.cc:1511] Processing CreateTablet for tablet f82574060263464baab9dad1d23232f8 (DEFAULT_TABLE table=soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:30.978482 23084 tablet_bootstrap.cc:654] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.980584 22927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82574060263464baab9dad1d23232f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.982641 23082 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.019200 23083 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.020021 23083 ts_tablet_manager.cc:1403] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.010s
I20260709 12:14:31.027046 23083 raft_consensus.cc:359] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.027930 23083 raft_consensus.cc:385] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.028262 23083 raft_consensus.cc:740] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.029078 23083 consensus_queue.cc:260] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.031989 23083 ts_tablet_manager.cc:1434] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:14:31.032191 23084 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.033054 23084 ts_tablet_manager.cc:1403] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.013s
I20260709 12:14:31.033126 23083 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.035415 23082 tablet_bootstrap.cc:654] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.036782 23084 raft_consensus.cc:359] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.037726 23084 raft_consensus.cc:385] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.038020 23084 raft_consensus.cc:740] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.039083 23084 consensus_queue.cc:260] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.041332 23083 tablet_bootstrap.cc:654] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.041721 23084 ts_tablet_manager.cc:1434] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:14:31.043126 23084 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.048924 23082 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.049644 23082 ts_tablet_manager.cc:1403] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.005s
I20260709 12:14:31.051884 23084 tablet_bootstrap.cc:654] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.053118 23082 raft_consensus.cc:359] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.054010 23082 raft_consensus.cc:385] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.054294 23082 raft_consensus.cc:740] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.055395 23082 consensus_queue.cc:260] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.063901 23082 ts_tablet_manager.cc:1434] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:14:31.065452 23082 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.080673 23082 tablet_bootstrap.cc:654] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.084271 23084 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.085011 23084 ts_tablet_manager.cc:1403] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.012s
I20260709 12:14:31.088861 23084 raft_consensus.cc:359] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.090019 23084 raft_consensus.cc:385] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.090441 23084 raft_consensus.cc:740] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.091806 23084 consensus_queue.cc:260] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.094602 23084 ts_tablet_manager.cc:1434] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.005s
I20260709 12:14:31.095269 23082 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.095757 23084 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.095925 23082 ts_tablet_manager.cc:1403] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 12:14:31.099623 23082 raft_consensus.cc:359] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.100482 23082 raft_consensus.cc:385] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.100792 23082 raft_consensus.cc:740] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.101678 23082 consensus_queue.cc:260] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.104283 23082 ts_tablet_manager.cc:1434] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:31.105602 23082 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.108465 23084 tablet_bootstrap.cc:654] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.113996 23082 tablet_bootstrap.cc:654] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.122407 23084 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.122407 23082 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.123116 23084 ts_tablet_manager.cc:1403] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 12:14:31.126729 23084 raft_consensus.cc:359] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.127574 23084 raft_consensus.cc:385] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.127902 23084 raft_consensus.cc:740] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.128737 23084 consensus_queue.cc:260] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.131520 23084 ts_tablet_manager.cc:1434] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:31.132717 23084 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.123128 23082 ts_tablet_manager.cc:1403] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:14:31.138224 23082 raft_consensus.cc:359] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.139168 23082 raft_consensus.cc:385] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.139511 23082 raft_consensus.cc:740] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.140681 23084 tablet_bootstrap.cc:654] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.142112 23082 consensus_queue.cc:260] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.145385 23082 ts_tablet_manager.cc:1434] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:31.146946 23082 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.153419 23083 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.154218 23083 ts_tablet_manager.cc:1403] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.121s	user 0.045s	sys 0.074s
I20260709 12:14:31.158030 23084 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.157821 23083 raft_consensus.cc:359] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.158631 23083 raft_consensus.cc:385] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.158680 23082 tablet_bootstrap.cc:654] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.159062 23083 raft_consensus.cc:740] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.160184 23083 consensus_queue.cc:260] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.158665 23084 ts_tablet_manager.cc:1403] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.011s
I20260709 12:14:31.163388 23083 ts_tablet_manager.cc:1434] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:31.164788 23083 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.166738 23084 raft_consensus.cc:359] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.167747 23084 raft_consensus.cc:385] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.168077 23084 raft_consensus.cc:740] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.169122 23084 consensus_queue.cc:260] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.170918 23001 raft_consensus.cc:493] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.171646 23001 raft_consensus.cc:515] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.175762 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.176578 22936 raft_consensus.cc:2468] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:31.177642 23083 tablet_bootstrap.cc:654] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.178042 23084 ts_tablet_manager.cc:1434] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:14:31.178524 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.180269 23084 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
W20260709 12:14:31.180359 22828 leader_election.cc:343] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.183609 23070 raft_consensus.cc:493] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.184262 23070 raft_consensus.cc:515] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.186164 23082 tablet_bootstrap.cc:492] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.190382 23082 ts_tablet_manager.cc:1403] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.004s
I20260709 12:14:31.190577 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b7f990da8c44099ccf21a815c4132c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.182730 22829 leader_election.cc:304] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.193375 22936 raft_consensus.cc:2468] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.195191 23084 tablet_bootstrap.cc:654] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.198848 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b7f990da8c44099ccf21a815c4132c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.199024 22754 leader_election.cc:304] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.175776 23001 leader_election.cc:290] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.203606 23001 raft_consensus.cc:2804] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.198966 23082 raft_consensus.cc:359] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.211519 23001 raft_consensus.cc:493] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.211174 23070 leader_election.cc:290] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.214044 23082 raft_consensus.cc:385] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.217645 23001 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.233011 23070 raft_consensus.cc:2804] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.223412 23082 raft_consensus.cc:740] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.250411 23083 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.251103 23083 ts_tablet_manager.cc:1403] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.087s	user 0.024s	sys 0.014s
I20260709 12:14:31.252859 23001 raft_consensus.cc:515] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
W20260709 12:14:31.244581 22829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.114.67:45191, user_credentials={real_user=slave}} blocked reactor thread for 62526.3us
I20260709 12:14:31.246415 23070 raft_consensus.cc:493] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.257992 23070 raft_consensus.cc:3060] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.265316 23001 leader_election.cc:290] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.259519 23082 consensus_queue.cc:260] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.269200 23083 raft_consensus.cc:359] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.270323 23083 raft_consensus.cc:385] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.270359 22861 raft_consensus.cc:2468] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.270756 23083 raft_consensus.cc:740] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.271586 23083 consensus_queue.cc:260] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.274832 23083 ts_tablet_manager.cc:1434] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:14:31.275988 23083 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.277010 23084 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.284009 23084 ts_tablet_manager.cc:1403] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.011s
I20260709 12:14:31.289090 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.289928 22936 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.291030 23082 ts_tablet_manager.cc:1434] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.100s	user 0.012s	sys 0.000s
I20260709 12:14:31.294237 23097 raft_consensus.cc:493] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.294860 23097 raft_consensus.cc:515] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.297283 23097 leader_election.cc:290] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.298204 23082 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.299376 23070 raft_consensus.cc:515] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.301448 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
W20260709 12:14:31.308537 22828 leader_election.cc:343] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.303072 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.304001 23084 raft_consensus.cc:359] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.310930 23084 raft_consensus.cc:385] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.311331 23084 raft_consensus.cc:740] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.311781 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b7f990da8c44099ccf21a815c4132c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.312541 22937 raft_consensus.cc:3060] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.309762 23083 tablet_bootstrap.cc:654] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.305126 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.312314 23084 consensus_queue.cc:260] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
W20260709 12:14:31.316047 22829 leader_election.cc:343] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.309940 23070 leader_election.cc:290] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.310114 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b7f990da8c44099ccf21a815c4132c" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:31.316896 23084 ts_tablet_manager.cc:1434] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 12:14:31.316951 22861 raft_consensus.cc:3060] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.318316 23084 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.320051 23082 tablet_bootstrap.cc:654] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.325227 22937 raft_consensus.cc:2468] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.326503 23084 tablet_bootstrap.cc:654] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.326988 22754 leader_election.cc:304] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.328027 23070 raft_consensus.cc:2804] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.328802 23070 raft_consensus.cc:697] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:31.329743 23070 consensus_queue.cc:237] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.330869 22936 raft_consensus.cc:2468] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
W20260709 12:14:31.337584 22828 leader_election.cc:343] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.340620 22828 leader_election.cc:304] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6712191714461bb98713ea89b05425; no voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.341024 23082 tablet_bootstrap.cc:492] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.344142 23082 ts_tablet_manager.cc:1403] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.004s
I20260709 12:14:31.344751 23097 raft_consensus.cc:2749] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:31.349025 22861 raft_consensus.cc:2468] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.350757 23082 raft_consensus.cc:359] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.351632 23082 raft_consensus.cc:385] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.351940 23082 raft_consensus.cc:740] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.351979 22829 leader_election.cc:304] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.353325 23097 raft_consensus.cc:2804] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.353855 23097 raft_consensus.cc:697] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:31.354820 23097 consensus_queue.cc:237] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.354699 22683 catalog_manager.cc:5697] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.352726 23082 consensus_queue.cc:260] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.358224 23082 ts_tablet_manager.cc:1434] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:14:31.359951 23082 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.361323 23084 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.361349 23083 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.362195 23084 ts_tablet_manager.cc:1403] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.005s
I20260709 12:14:31.362354 23001 raft_consensus.cc:493] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.362928 23001 raft_consensus.cc:515] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.363564 23069 raft_consensus.cc:493] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.364248 23069 raft_consensus.cc:515] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.365826 23084 raft_consensus.cc:359] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.366624 23084 raft_consensus.cc:385] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.366942 23084 raft_consensus.cc:740] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.368089 23082 tablet_bootstrap.cc:654] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.367859 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.362169 23083 ts_tablet_manager.cc:1403] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.011s
I20260709 12:14:31.368851 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.369645 22936 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
W20260709 12:14:31.370324 22902 leader_election.cc:343] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.367893 22787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.371174 22829 leader_election.cc:304] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:31.371585 22787 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:31.372313 23095 raft_consensus.cc:2804] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.371975 23083 raft_consensus.cc:359] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.372771 23095 raft_consensus.cc:493] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.367756 23084 consensus_queue.cc:260] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.373257 23095 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.372826 23083 raft_consensus.cc:385] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.376582 23083 raft_consensus.cc:740] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.377655 23001 leader_election.cc:290] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.377524 23083 consensus_queue.cc:260] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.379914 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.380918 22861 raft_consensus.cc:2468] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:31.377331 23069 leader_election.cc:290] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:31.385433 23083 ts_tablet_manager.cc:1434] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:31.385459 22902 leader_election.cc:304] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.387089 23083 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.389374 23069 raft_consensus.cc:2804] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.390713 23069 raft_consensus.cc:493] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.391793 23069 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.393417 23084 ts_tablet_manager.cc:1434] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.003s
I20260709 12:14:31.395074 23084 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.390264 23095 raft_consensus.cc:515] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.403532 23084 tablet_bootstrap.cc:654] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.406749 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:31.407646 22788 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.410457 22684 catalog_manager.cc:5697] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.412142 23083 tablet_bootstrap.cc:654] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.418731 23082 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.418895 22788 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:31.419340 23082 ts_tablet_manager.cc:1403] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.005s
I20260709 12:14:31.420796 22828 leader_election.cc:304] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.421859 23097 raft_consensus.cc:2804] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.422351 23097 raft_consensus.cc:697] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:31.423230 23097 consensus_queue.cc:237] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.425057 23082 raft_consensus.cc:359] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.425931 23082 raft_consensus.cc:385] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.426252 23082 raft_consensus.cc:740] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.426404 23083 tablet_bootstrap.cc:492] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.427567 23083 ts_tablet_manager.cc:1403] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.002s
I20260709 12:14:31.429769 23082 consensus_queue.cc:260] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.434708 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.435731 22936 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.436209 23082 ts_tablet_manager.cc:1434] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 12:14:31.436232 23095 leader_election.cc:290] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.443885 23095 raft_consensus.cc:493] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.444495 23095 raft_consensus.cc:515] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.448083 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.437646 23082 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.449417 22788 raft_consensus.cc:2468] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:31.449919 23083 raft_consensus.cc:359] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.450766 22828 leader_election.cc:304] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.451012 23083 raft_consensus.cc:385] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.451496 23083 raft_consensus.cc:740] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.451864 23001 raft_consensus.cc:2804] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.452322 23001 raft_consensus.cc:493] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.452672 23001 raft_consensus.cc:3060] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.459686 23069 raft_consensus.cc:515] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.463948 23082 tablet_bootstrap.cc:654] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.464830 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
W20260709 12:14:31.473562 22829 leader_election.cc:343] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.465611 23095 leader_election.cc:290] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.474197 23084 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.474907 23084 ts_tablet_manager.cc:1403] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.080s	user 0.038s	sys 0.039s
I20260709 12:14:31.474958 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:31.452672 23083 consensus_queue.cc:260] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.476154 22788 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.478742 23083 ts_tablet_manager.cc:1434] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:14:31.480000 23083 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.448342 22936 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:31.482530 23084 raft_consensus.cc:359] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.483371 23084 raft_consensus.cc:385] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.483696 23084 raft_consensus.cc:740] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.484572 23084 consensus_queue.cc:260] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.485975 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:31.486637 22861 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.487299 23084 ts_tablet_manager.cc:1434] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:31.488469 23084 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.488899 23083 tablet_bootstrap.cc:654] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.479991 23001 raft_consensus.cc:515] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.492551 23001 leader_election.cc:290] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.494274 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:31.495011 22786 raft_consensus.cc:3060] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.497000 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.497661 23069 leader_election.cc:290] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:31.502830 22829 leader_election.cc:343] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.499831 23084 tablet_bootstrap.cc:654] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.503000 22861 raft_consensus.cc:2468] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:31.504520 22902 leader_election.cc:304] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:31.505509 23069 raft_consensus.cc:2804] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.506098 23069 raft_consensus.cc:697] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:31.508713 22788 raft_consensus.cc:2468] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:31.513121 22786 raft_consensus.cc:2468] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:31.514324 22828 leader_election.cc:304] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:31.515043 23001 raft_consensus.cc:2804] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.515529 23001 raft_consensus.cc:697] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:31.516407 23001 consensus_queue.cc:237] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.517378 23082 tablet_bootstrap.cc:492] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.517180 23109 raft_consensus.cc:493] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.518054 23109 raft_consensus.cc:515] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.518079 23082 ts_tablet_manager.cc:1403] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.008s
I20260709 12:14:31.507829 22683 catalog_manager.cc:5697] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.526273 23069 consensus_queue.cc:237] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.524605 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.528364 23109 leader_election.cc:290] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:31.532229 22902 leader_election.cc:343] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.533473 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
W20260709 12:14:31.536213 22902 leader_election.cc:343] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:31.536700 22902 leader_election.cc:304] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.536500 23082 raft_consensus.cc:359] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.537350 23082 raft_consensus.cc:385] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.537678 23082 raft_consensus.cc:740] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.538936 23109 raft_consensus.cc:2749] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:31.542793 23082 consensus_queue.cc:260] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.548593 23084 tablet_bootstrap.cc:492] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.549238 23084 ts_tablet_manager.cc:1403] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.018s
I20260709 12:14:31.549894 23082 ts_tablet_manager.cc:1434] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 12:14:31.551100 23082 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.551430 22683 catalog_manager.cc:5697] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.552423 23084 raft_consensus.cc:359] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.553208 23084 raft_consensus.cc:385] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.553519 23084 raft_consensus.cc:740] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.554656 23084 consensus_queue.cc:260] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.556192 23083 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.556783 23083 ts_tablet_manager.cc:1403] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.002s
I20260709 12:14:31.558197 23084 ts_tablet_manager.cc:1434] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:14:31.559402 23084 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Bootstrap starting.
I20260709 12:14:31.560314 23083 raft_consensus.cc:359] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.561131 23083 raft_consensus.cc:385] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.561408 23083 raft_consensus.cc:740] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.562255 23083 consensus_queue.cc:260] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.566941 23084 tablet_bootstrap.cc:654] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.571524 22681 catalog_manager.cc:5697] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.572614 23082 tablet_bootstrap.cc:654] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.577437 23083 ts_tablet_manager.cc:1434] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:14:31.577689 23084 tablet_bootstrap.cc:492] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: No bootstrap required, opened a new log
I20260709 12:14:31.578315 23084 ts_tablet_manager.cc:1403] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:14:31.578876 23083 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.582619 23084 raft_consensus.cc:359] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.599005 23084 raft_consensus.cc:385] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.599377 23084 raft_consensus.cc:740] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.600099 23084 consensus_queue.cc:260] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.601809 23084 ts_tablet_manager.cc:1434] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 12:14:31.604125 23083 tablet_bootstrap.cc:654] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.608254 23082 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.608736 23082 ts_tablet_manager.cc:1403] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.001s
I20260709 12:14:31.611506 23082 raft_consensus.cc:359] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.612035 23082 raft_consensus.cc:385] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.612252 23082 raft_consensus.cc:740] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.612910 23082 consensus_queue.cc:260] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.614852 23082 ts_tablet_manager.cc:1434] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:31.616276 23082 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Bootstrap starting.
I20260709 12:14:31.620723 23083 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.621421 23083 ts_tablet_manager.cc:1403] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 12:14:31.622923 23082 tablet_bootstrap.cc:654] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.624717 23083 raft_consensus.cc:359] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.625511 23083 raft_consensus.cc:385] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.625841 23083 raft_consensus.cc:740] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.626627 23083 consensus_queue.cc:260] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.629048 23083 ts_tablet_manager.cc:1434] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:14:31.630172 23083 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.638324 23083 tablet_bootstrap.cc:654] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.639447 23082 tablet_bootstrap.cc:492] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: No bootstrap required, opened a new log
I20260709 12:14:31.639930 23082 ts_tablet_manager.cc:1403] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 12:14:31.641726 23069 raft_consensus.cc:493] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.642316 23069 raft_consensus.cc:515] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.642834 23082 raft_consensus.cc:359] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.643589 23082 raft_consensus.cc:385] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.643867 23082 raft_consensus.cc:740] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.644608 23069 leader_election.cc:290] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:31.644642 23082 consensus_queue.cc:260] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.645998 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.646904 22786 raft_consensus.cc:2393] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b9317ffa3014610919433e0f17a80c0 in current term 1: Already voted for candidate 1d6712191714461bb98713ea89b05425 in this term.
I20260709 12:14:31.647069 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea4039dfedc47f2b3189c8279d6efdd" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.648555 22902 leader_election.cc:304] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:31.650485 23109 raft_consensus.cc:3060] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.651315 23083 tablet_bootstrap.cc:492] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.653622 23082 ts_tablet_manager.cc:1434] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:14:31.655205 23083 ts_tablet_manager.cc:1403] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 12:14:31.657855 23083 raft_consensus.cc:359] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.658613 23083 raft_consensus.cc:385] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.658890 23083 raft_consensus.cc:740] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.659626 23109 raft_consensus.cc:2749] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:31.659540 23083 consensus_queue.cc:260] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.661861 23083 ts_tablet_manager.cc:1434] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:31.663133 23083 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: Bootstrap starting.
I20260709 12:14:31.668309 23083 tablet_bootstrap.cc:654] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.672760 23083 tablet_bootstrap.cc:492] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: No bootstrap required, opened a new log
I20260709 12:14:31.673226 23083 ts_tablet_manager.cc:1403] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:31.675387 23083 raft_consensus.cc:359] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.675943 23083 raft_consensus.cc:385] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.676153 23083 raft_consensus.cc:740] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.676787 23083 consensus_queue.cc:260] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.678424 23083 ts_tablet_manager.cc:1434] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:31.740872 23109 raft_consensus.cc:493] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.741443 23109 raft_consensus.cc:515] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.743414 23109 leader_election.cc:290] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:31.744427 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.744720 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.745177 22788 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:31.745419 22861 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 0.
I20260709 12:14:31.746305 22902 leader_election.cc:304] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.746994 23109 raft_consensus.cc:2804] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.747313 23109 raft_consensus.cc:493] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.747601 23109 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.753458 23109 raft_consensus.cc:515] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.755728 23109 leader_election.cc:290] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:31.756860 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:31.756713 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:31.757606 22861 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.757647 22788 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.765956 22788 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:31.765956 22861 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 1.
I20260709 12:14:31.767328 22902 leader_election.cc:304] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:31.768191 23109 raft_consensus.cc:2804] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.768790 23109 raft_consensus.cc:697] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:31.769680 23109 consensus_queue.cc:237] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.778512 22681 catalog_manager.cc:5697] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 1 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.798192 23070 raft_consensus.cc:493] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.798821 23070 raft_consensus.cc:515] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.801015 23070 leader_election.cc:290] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.801962 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.802225 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.802659 22861 raft_consensus.cc:2468] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.802949 22936 raft_consensus.cc:2468] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.804185 22753 leader_election.cc:304] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.805310 23070 raft_consensus.cc:2804] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.805743 23070 raft_consensus.cc:493] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.806016 23070 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.812121 23070 raft_consensus.cc:515] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.814052 23070 leader_election.cc:290] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.814901 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:31.815696 22861 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.815869 22936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.816659 22936 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.819229 23070 consensus_queue.cc:1048] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.825163 22861 raft_consensus.cc:2468] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.825395 22936 raft_consensus.cc:2468] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.826478 22753 leader_election.cc:304] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.827410 23070 raft_consensus.cc:2804] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.827899 23070 raft_consensus.cc:697] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:31.828740 23070 consensus_queue.cc:237] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.835758 23129 consensus_queue.cc:1048] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.841984 22681 catalog_manager.cc:5697] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.842722 22788 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.854964 23095 consensus_queue.cc:1048] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:31.877405 23001 consensus_queue.cc:1048] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.919196 23129 raft_consensus.cc:493] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.919943 23129 raft_consensus.cc:515] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.922036 23129 leader_election.cc:290] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.922864 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425" is_pre_election: true
I20260709 12:14:31.923063 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.923563 22862 raft_consensus.cc:2468] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.923734 22937 raft_consensus.cc:2468] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 0.
I20260709 12:14:31.924732 22753 leader_election.cc:304] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.925652 23129 raft_consensus.cc:2804] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.925987 23129 raft_consensus.cc:493] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.926355 23129 raft_consensus.cc:3060] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.928798 23001 raft_consensus.cc:493] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.929334 23001 raft_consensus.cc:515] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.931355 23001 leader_election.cc:290] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.932406 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002f41aaf7f436abfa8b9095a09ebf1" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8" is_pre_election: true
I20260709 12:14:31.932652 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002f41aaf7f436abfa8b9095a09ebf1" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0" is_pre_election: true
I20260709 12:14:31.933261 22786 raft_consensus.cc:2468] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
I20260709 12:14:31.933269 22937 raft_consensus.cc:2468] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 0.
W20260709 12:14:31.934773 22734 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:31.934684 23129 raft_consensus.cc:515] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.934868 22829 leader_election.cc:304] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 4b9317ffa3014610919433e0f17a80c0; no voters: 
I20260709 12:14:31.936128 23001 raft_consensus.cc:2804] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:31.936471 23001 raft_consensus.cc:493] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.936772 23001 raft_consensus.cc:3060] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.937006 23129 leader_election.cc:290] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.937974 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:31.938102 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b010ba4af92d48af888fa9925c8ee367" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.938725 22862 raft_consensus.cc:3060] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.938841 22937 raft_consensus.cc:3060] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.945111 22862 raft_consensus.cc:2468] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.945277 23001 raft_consensus.cc:515] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.946403 22753 leader_election.cc:304] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.946987 22937 raft_consensus.cc:2468] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 1.
I20260709 12:14:31.947146 23129 raft_consensus.cc:2804] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.947835 23129 raft_consensus.cc:697] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:31.948674 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002f41aaf7f436abfa8b9095a09ebf1" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:31.948918 23001 leader_election.cc:290] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:31.949379 22786 raft_consensus.cc:3060] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.950026 23129 consensus_queue.cc:237] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.952015 23097 consensus_queue.cc:1048] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:31.957958 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8002f41aaf7f436abfa8b9095a09ebf1" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:31.958643 22937 raft_consensus.cc:3060] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.959115 22786 raft_consensus.cc:2468] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:31.961077 22828 leader_election.cc:304] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:31.962075 23095 raft_consensus.cc:2804] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.960863 22681 catalog_manager.cc:5697] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 1 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.971191 23097 consensus_queue.cc:1048] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.973402 22937 raft_consensus.cc:2468] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 1.
I20260709 12:14:31.979990 23095 raft_consensus.cc:697] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:31.981261 23095 consensus_queue.cc:237] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:31.994365 22684 catalog_manager.cc:5697] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 1 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.072005 23109 consensus_queue.cc:1048] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:32.084720 23109 consensus_queue.cc:1048] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:32.086911 23095 consensus_queue.cc:1048] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:14:32.106407 23001 consensus_queue.cc:1048] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:32.262072 23109 consensus_queue.cc:1048] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:32.265726 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f75985bac34212af112a33371315ae"
dest_uuid: "1d6712191714461bb98713ea89b05425"
mode: GRACEFUL
new_leader_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:47130
I20260709 12:14:32.266364 22862 raft_consensus.cc:606] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Received request to transfer leadership to TS 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:32.281502 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4"
dest_uuid: "1d6712191714461bb98713ea89b05425"
mode: GRACEFUL
new_leader_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:47130
I20260709 12:14:32.281575 23145 consensus_queue.cc:1048] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.282284 22862 raft_consensus.cc:606] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Received request to transfer leadership to TS 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:32.293280 22936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88796f34c90e411093004e363d11d6e9"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
mode: GRACEFUL
new_leader_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:14:32.294044 22936 raft_consensus.cc:606] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Received request to transfer leadership to TS 1d6712191714461bb98713ea89b05425
I20260709 12:14:32.303964 22936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda7181f54764982b462aaab78ba1917"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
mode: GRACEFUL
new_leader_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:14:32.304636 22936 raft_consensus.cc:606] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Received request to transfer leadership to TS 1d6712191714461bb98713ea89b05425
I20260709 12:14:32.313944 22786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f82574060263464baab9dad1d23232f8"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
mode: GRACEFUL
new_leader_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:38070
I20260709 12:14:32.314585 22786 raft_consensus.cc:606] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Received request to transfer leadership to TS 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:32.357503 23131 consensus_queue.cc:1048] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.366106 23129 raft_consensus.cc:993] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: : Instructing follower 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:32.366788 23129 raft_consensus.cc:1081] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Signalling peer 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:32.369634 22937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f82574060263464baab9dad1d23232f8"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:44776
I20260709 12:14:32.370311 22937 raft_consensus.cc:493] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.370702 22937 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.375392 23131 consensus_queue.cc:1048] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.382436 22937 raft_consensus.cc:515] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.386375 22937 leader_election.cc:290] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:32.386951 22786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:32.387753 22786 raft_consensus.cc:3055] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.388105 22786 raft_consensus.cc:740] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:32.388149 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82574060263464baab9dad1d23232f8" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:32.389180 22786 consensus_queue.cc:260] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.393074 22786 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.392310 22936 raft_consensus.cc:1240] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Rejecting Update request from peer 5a0fdbf077294379970db4d8b22f74b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:32.404186 22786 raft_consensus.cc:2468] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 2.
I20260709 12:14:32.405404 22902 leader_election.cc:304] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 1d6712191714461bb98713ea89b05425
I20260709 12:14:32.405239 23131 consensus_queue.cc:1048] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.406378 23145 raft_consensus.cc:2804] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.406992 23145 raft_consensus.cc:697] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:32.407972 23145 consensus_queue.cc:237] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.418905 22682 catalog_manager.cc:5697] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 1 to 2, leader changed from 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65) to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 2 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:32.419590 23131 consensus_queue.cc:1048] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.493654 23095 consensus_queue.cc:1048] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.495705 23140 raft_consensus.cc:993] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: : Instructing follower 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:32.496404 23140 raft_consensus.cc:1081] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Signalling peer 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:32.498180 23140 raft_consensus.cc:993] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: : Instructing follower 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:32.498515 22788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81f75985bac34212af112a33371315ae"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:38064
I20260709 12:14:32.498669 23140 raft_consensus.cc:1081] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Signalling peer 5a0fdbf077294379970db4d8b22f74b8 to start an election
I20260709 12:14:32.499302 22788 raft_consensus.cc:493] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.499934 22788 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.502561 22787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
 from {username='slave'} at 127.0.0.1:38064
I20260709 12:14:32.503366 22787 raft_consensus.cc:493] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.503780 22787 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.512625 23097 consensus_queue.cc:1048] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.512993 22788 raft_consensus.cc:515] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.515684 22787 raft_consensus.cc:515] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.516178 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:32.517084 22862 raft_consensus.cc:3055] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.517843 22862 raft_consensus.cc:740] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:32.518885 22788 leader_election.cc:290] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:32.518786 22862 consensus_queue.cc:260] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.520274 22862 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.520517 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f75985bac34212af112a33371315ae" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:32.521260 22935 raft_consensus.cc:3060] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.522778 22787 leader_election.cc:290] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Requested vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:32.529426 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:32.530310 22937 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.535070 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd286fa593a54e44ba0c7af9eb628bb4" candidate_uuid: "5a0fdbf077294379970db4d8b22f74b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:32.536339 22861 raft_consensus.cc:3055] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.536703 22861 raft_consensus.cc:740] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:32.537575 22861 consensus_queue.cc:260] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.538990 22861 raft_consensus.cc:3060] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.543865 22935 raft_consensus.cc:2468] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:32.545950 22754 leader_election.cc:304] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:32.547175 23131 raft_consensus.cc:2804] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.547847 23131 raft_consensus.cc:697] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:32.548962 23131 consensus_queue.cc:237] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.549929 22862 raft_consensus.cc:2468] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:32.555060 22937 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:32.556509 22754 leader_election.cc:304] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:32.557443 23070 raft_consensus.cc:2804] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.558050 23070 raft_consensus.cc:697] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:32.559036 23070 consensus_queue.cc:237] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.560855 22861 raft_consensus.cc:2468] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a0fdbf077294379970db4d8b22f74b8 in term 2.
I20260709 12:14:32.571007 22682 catalog_manager.cc:5697] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 1 to 2, leader changed from 1d6712191714461bb98713ea89b05425 (127.10.114.66) to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.573087 22682 catalog_manager.cc:5697] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 reported cstate change: term changed from 1 to 2, leader changed from 1d6712191714461bb98713ea89b05425 (127.10.114.66) to 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65). New cstate: current_term: 2 leader_uuid: "5a0fdbf077294379970db4d8b22f74b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.643292 23069 raft_consensus.cc:993] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: : Instructing follower 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:32.643921 23069 raft_consensus.cc:1081] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Signalling peer 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:32.645823 22861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda7181f54764982b462aaab78ba1917"
dest_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:47112
I20260709 12:14:32.646430 22861 raft_consensus.cc:493] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.647205 22861 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.656221 22861 raft_consensus.cc:515] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.657981 22861 leader_election.cc:290] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:32.659018 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:32.659198 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda7181f54764982b462aaab78ba1917" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:32.659840 22788 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.659919 22935 raft_consensus.cc:3055] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.660351 22935 raft_consensus.cc:740] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:32.661311 22935 consensus_queue.cc:260] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.662791 22935 raft_consensus.cc:3060] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.668299 22788 raft_consensus.cc:2468] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:32.669975 22828 leader_election.cc:304] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:32.670950 23097 raft_consensus.cc:2804] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.671195 22935 raft_consensus.cc:2468] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:32.671466 23097 raft_consensus.cc:697] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:32.672602 23097 consensus_queue.cc:237] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.680516 22682 catalog_manager.cc:5697] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 1 to 2, leader changed from 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67) to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.822201 22861 raft_consensus.cc:3060] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.828641 22861 raft_consensus.cc:1275] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:32.830276 23145 consensus_queue.cc:1048] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:32.839634 22787 raft_consensus.cc:1275] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:32.842041 23069 consensus_queue.cc:1048] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:32.911172 23109 raft_consensus.cc:993] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: : Instructing follower 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:32.911775 23145 raft_consensus.cc:1081] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Signalling peer 1d6712191714461bb98713ea89b05425 to start an election
I20260709 12:14:32.913802 22862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88796f34c90e411093004e363d11d6e9"
dest_uuid: "1d6712191714461bb98713ea89b05425"
 from {username='slave'} at 127.0.0.1:47112
I20260709 12:14:32.914471 22862 raft_consensus.cc:493] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.914805 22862 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.920939 22862 raft_consensus.cc:515] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.922799 22862 leader_election.cc:290] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67:45191)
I20260709 12:14:32.923887 22788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:32.924085 22935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88796f34c90e411093004e363d11d6e9" candidate_uuid: "1d6712191714461bb98713ea89b05425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
I20260709 12:14:32.924539 22788 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.924803 22935 raft_consensus.cc:3055] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.925187 22935 raft_consensus.cc:740] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:32.926013 22935 consensus_queue.cc:260] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.927228 22935 raft_consensus.cc:3060] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.930694 22788 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:32.932098 22828 leader_election.cc:304] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:32.933238 23140 raft_consensus.cc:2804] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.933836 23140 raft_consensus.cc:697] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Leader. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:32.934379 22935 raft_consensus.cc:2468] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6712191714461bb98713ea89b05425 in term 2.
I20260709 12:14:32.934926 23140 consensus_queue.cc:237] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:32.944319 22682 catalog_manager.cc:5697] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 reported cstate change: term changed from 1 to 2, leader changed from 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67) to 1d6712191714461bb98713ea89b05425 (127.10.114.66). New cstate: current_term: 2 leader_uuid: "1d6712191714461bb98713ea89b05425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.020467 22862 raft_consensus.cc:1275] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.022392 23131 consensus_queue.cc:1048] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.034185 22861 raft_consensus.cc:1275] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.034284 22935 raft_consensus.cc:1275] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.036422 23129 consensus_queue.cc:1048] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:33.037144 23070 consensus_queue.cc:1048] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:33.049300 22937 raft_consensus.cc:1275] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 5a0fdbf077294379970db4d8b22f74b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.051792 23131 consensus_queue.cc:1048] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.109760 22788 raft_consensus.cc:1275] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.111308 23095 consensus_queue.cc:1048] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.123494 22937 raft_consensus.cc:1275] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.125201 23140 consensus_queue.cc:1048] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.331032 22788 raft_consensus.cc:1275] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.332559 23140 consensus_queue.cc:1048] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.344573 22935 raft_consensus.cc:1275] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Refusing update from remote peer 1d6712191714461bb98713ea89b05425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.346933 23095 consensus_queue.cc:1048] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.342499 22684 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59582:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:35.385113 22684 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59582:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:35.458252 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:35.551457 22717 debug-util.cc:398] Leaking SignalData structure 0x7b08001d88c0 after lost signal to thread 10700
W20260709 12:14:35.562433 22717 debug-util.cc:398] Leaking SignalData structure 0x7b08000394a0 after lost signal to thread 22720
W20260709 12:14:35.580257 22717 debug-util.cc:398] Leaking SignalData structure 0x7b0800145240 after lost signal to thread 22812
W20260709 12:14:35.595196 22717 debug-util.cc:398] Leaking SignalData structure 0x7b080031e3c0 after lost signal to thread 22887
W20260709 12:14:35.608960 22717 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8660 after lost signal to thread 22961
W20260709 12:14:35.704520 23197 log.cc:927] Time spent T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
W20260709 12:14:35.710088 23204 log.cc:927] Time spent T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:14:35.775207 23196 log.cc:927] Time spent T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
W20260709 12:14:35.778787 23214 log.cc:927] Time spent T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:14:35.836272 23229 tablet.cc:1724] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:35.899945 23207 log.cc:927] Time spent T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Append to log took a long time: real 0.202s	user 0.005s	sys 0.000s
W20260709 12:14:35.921126 22754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:45191, user_credentials={real_user=slave}} blocked reactor thread for 50678.4us
W20260709 12:14:35.973362 23230 log.cc:927] Time spent T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
W20260709 12:14:35.976406 22828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.65:38103, user_credentials={real_user=slave}} blocked reactor thread for 113189us
I20260709 12:14:35.931308 23235 tablet.cc:1724] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:35.996692 23238 tablet.cc:1724] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:36.006699 23236 log.cc:927] Time spent T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:14:36.007889 23231 log.cc:927] Time spent T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:14:35.964155 23239 tablet.cc:1724] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.029623 23241 tablet.cc:1724] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:36.034070 23237 log.cc:927] Time spent T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Append to log took a long time: real 0.079s	user 0.002s	sys 0.001s
I20260709 12:14:36.045496 22782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff"
dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
mode: GRACEFUL
new_leader_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:56868
I20260709 12:14:36.046711 22782 raft_consensus.cc:606] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Received request to transfer leadership to TS 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:36.060563 23229 tablet.cc:1724] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.069002 23240 tablet.cc:1724] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.074776 23242 tablet.cc:1724] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.102423 23243 tablet.cc:1724] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.119994 23247 tablet.cc:1724] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.136806 23246 tablet.cc:1724] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.174307 23249 tablet.cc:1724] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.199031 23251 tablet.cc:1724] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.201280 23241 tablet.cc:1724] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.223469 23247 tablet.cc:1724] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.208326 23239 tablet.cc:1724] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.241647 23251 tablet.cc:1724] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.248392 23238 tablet.cc:1724] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.239599 23241 tablet.cc:1724] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.275600 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39"
dest_uuid: "1d6712191714461bb98713ea89b05425"
mode: GRACEFUL
new_leader_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:14:36.276412 22861 raft_consensus.cc:606] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Received request to transfer leadership to TS 4b9317ffa3014610919433e0f17a80c0
I20260709 12:14:36.278234 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:36.279007 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:36.257453 23240 tablet.cc:1724] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.258042 23251 tablet.cc:1724] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.286566 23243 tablet.cc:1724] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.264030 22684 catalog_manager.cc:5789] TS 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935) does not have the latest schema for tablet 8002f41aaf7f436abfa8b9095a09ebf1 (table soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]). Expected version 1 got 0
I20260709 12:14:36.263589 23235 tablet.cc:1724] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.292591 22684 catalog_manager.cc:5789] TS 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935) does not have the latest schema for tablet 88796f34c90e411093004e363d11d6e9 (table soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a]). Expected version 1 got 0
I20260709 12:14:36.299540 23249 tablet.cc:1724] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.300366 23172 raft_consensus.cc:993] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: : Instructing follower 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:36.301213 23206 raft_consensus.cc:1081] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Signalling peer 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:36.270685 23229 tablet.cc:1724] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.305469 22934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:44776
I20260709 12:14:36.306335 22934 raft_consensus.cc:493] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:36.306917 22934 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.326529 23242 tablet.cc:1724] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.333777 23243 tablet.cc:1724] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:36.343187 22934 raft_consensus.cc:515] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.347733 22785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:36.348646 22785 raft_consensus.cc:3055] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.349016 22785 raft_consensus.cc:740] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a0fdbf077294379970db4d8b22f74b8, State: Running, Role: LEADER
I20260709 12:14:36.350184 22785 consensus_queue.cc:260] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.351766 22785 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.374969 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be59d1d165244dfa1164fb844d3ecff" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:36.375829 22861 raft_consensus.cc:3060] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.377676 22934 leader_election.cc:290] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:36.382136 22785 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 3.
I20260709 12:14:36.387820 22902 leader_election.cc:304] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:36.389102 23221 raft_consensus.cc:2804] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.385582 22861 raft_consensus.cc:2468] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 3.
I20260709 12:14:36.389655 23221 raft_consensus.cc:697] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:36.391067 23221 consensus_queue.cc:237] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.404031 22681 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: soft_deleted_table [id=d6364d3b33144f8aaa007e042897047a] alter complete (version 1)
I20260709 12:14:36.416716 22684 catalog_manager.cc:5697] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 2 to 3, leader changed from 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65) to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:36.455260 23211 raft_consensus.cc:993] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: : Instructing follower 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:36.455865 23211 raft_consensus.cc:1081] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Signalling peer 4b9317ffa3014610919433e0f17a80c0 to start an election
I20260709 12:14:36.458089 22934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39"
dest_uuid: "4b9317ffa3014610919433e0f17a80c0"
 from {username='slave'} at 127.0.0.1:44770
I20260709 12:14:36.458813 22934 raft_consensus.cc:493] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:36.459235 22934 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.469206 22934 raft_consensus.cc:515] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.471975 22934 leader_election.cc:290] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 election: Requested vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:36.473407 22785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a0fdbf077294379970db4d8b22f74b8"
I20260709 12:14:36.474421 22785 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.473433 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9e39336cf94298b6800cd6bb7c8c39" candidate_uuid: "4b9317ffa3014610919433e0f17a80c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d6712191714461bb98713ea89b05425"
I20260709 12:14:36.475641 22861 raft_consensus.cc:3055] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.475960 22861 raft_consensus.cc:740] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d6712191714461bb98713ea89b05425, State: Running, Role: LEADER
I20260709 12:14:36.477011 22861 consensus_queue.cc:260] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.478403 22861 raft_consensus.cc:3060] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.486240 22785 raft_consensus.cc:2468] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 3.
I20260709 12:14:36.488099 22902 leader_election.cc:304] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0, 5a0fdbf077294379970db4d8b22f74b8; no voters: 
I20260709 12:14:36.489929 22861 raft_consensus.cc:2468] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9317ffa3014610919433e0f17a80c0 in term 3.
I20260709 12:14:36.489984 23173 raft_consensus.cc:2804] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.491888 23173 raft_consensus.cc:697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 3 LEADER]: Becoming Leader. State: Replica: 4b9317ffa3014610919433e0f17a80c0, State: Running, Role: LEADER
I20260709 12:14:36.492988 23173 consensus_queue.cc:237] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:36.509222 22684 catalog_manager.cc:5697] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 reported cstate change: term changed from 2 to 3, leader changed from 1d6712191714461bb98713ea89b05425 (127.10.114.66) to 4b9317ffa3014610919433e0f17a80c0 (127.10.114.67). New cstate: current_term: 3 leader_uuid: "4b9317ffa3014610919433e0f17a80c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.298682 22787 raft_consensus.cc:1275] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:37.301622 22787 raft_consensus.cc:1275] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:37.307312 22863 raft_consensus.cc:1275] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:37.307662 23263 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:37.310050 23263 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:37.319559 23263 consensus_queue.cc:1048] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:37.358558 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:37.358563 22754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:45191, user_credentials={real_user=slave}} blocked reactor thread for 45080.5us
I20260709 12:14:37.371057 22863 raft_consensus.cc:1275] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Refusing update from remote peer 4b9317ffa3014610919433e0f17a80c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:37.377300 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:37.378460 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:37.400353 22753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:37935, user_credentials={real_user=slave}} blocked reactor thread for 57827.9us
I20260709 12:14:37.396193 23261 consensus_queue.cc:1048] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 12:14:37.412993 22754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.67:45191, user_credentials={real_user=slave}} blocked reactor thread for 50673.2us
W20260709 12:14:37.455714 22753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:37935, user_credentials={real_user=slave}} blocked reactor thread for 53433.6us
W20260709 12:14:38.275995 22958 debug-util.cc:398] Leaking SignalData structure 0x7b0800245560 after lost signal to thread 10700
W20260709 12:14:38.277681 22958 debug-util.cc:398] Leaking SignalData structure 0x7b08001302a0 after lost signal to thread 22720
W20260709 12:14:38.279487 22958 debug-util.cc:398] Leaking SignalData structure 0x7b080009ab40 after lost signal to thread 22812
W20260709 12:14:38.281260 22958 debug-util.cc:398] Leaking SignalData structure 0x7b08003d05c0 after lost signal to thread 22887
W20260709 12:14:38.282955 22958 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8f00 after lost signal to thread 22961
W20260709 12:14:38.283742 22958 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5420 after lost signal to thread 23227
I20260709 12:14:38.382009 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:38.392164 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:38.392912 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:39.394557 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:39.405179 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:39.408013 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:40.409619 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.420931 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:40.421670 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:41.423033 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.429656 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:41.430195 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:42.431370 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.437726 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:42.438318 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:43.439545 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:43.447372 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:43.447974 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:44.936780 22901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.010s
W20260709 12:14:44.937326 22901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.009s	sys 0.010s
W20260709 12:14:44.980273 22753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.114.66:37935, user_credentials={real_user=slave}} blocked reactor thread for 739190us
I20260709 12:14:45.153594 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:45.159040 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:45.159549 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:45.988451 22884 debug-util.cc:398] Leaking SignalData structure 0x7b0800324100 after lost signal to thread 10700
W20260709 12:14:45.991168 22884 debug-util.cc:398] Leaking SignalData structure 0x7b08003ada40 after lost signal to thread 22720
W20260709 12:14:45.993397 22884 debug-util.cc:398] Leaking SignalData structure 0x7b08000c66a0 after lost signal to thread 22812
W20260709 12:14:45.995100 22884 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6060 after lost signal to thread 22887
W20260709 12:14:45.996750 22884 debug-util.cc:398] Leaking SignalData structure 0x7b08003086a0 after lost signal to thread 22961
I20260709 12:14:46.161008 10697 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:46.167383 10697 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:46.168021 10697 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:47.240917 10697 tablet_server.cc:179] TabletServer@127.10.114.65:0 shutting down...
I20260709 12:14:47.309141 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:47.312209 10697 tablet_replica.cc:333] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.313836 10697 raft_consensus.cc:2243] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.315096 10697 raft_consensus.cc:2272] T 8002f41aaf7f436abfa8b9095a09ebf1 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.319609 10697 tablet_replica.cc:333] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.320559 10697 raft_consensus.cc:2243] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.321974 10697 raft_consensus.cc:2272] T 81f75985bac34212af112a33371315ae P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.326797 10697 tablet_replica.cc:333] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.327944 10697 raft_consensus.cc:2243] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.328925 10697 raft_consensus.cc:2272] T f82574060263464baab9dad1d23232f8 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.332944 10697 tablet_replica.cc:333] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.333937 10697 raft_consensus.cc:2243] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.334743 10697 raft_consensus.cc:2272] T bda7181f54764982b462aaab78ba1917 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.338857 10697 tablet_replica.cc:333] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.339918 10697 raft_consensus.cc:2243] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.341228 10697 raft_consensus.cc:2272] T b010ba4af92d48af888fa9925c8ee367 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.344637 10697 tablet_replica.cc:333] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.345379 10697 raft_consensus.cc:2243] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.346319 10697 raft_consensus.cc:2272] T 88796f34c90e411093004e363d11d6e9 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.349922 10697 tablet_replica.cc:333] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.350811 10697 raft_consensus.cc:2243] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.352752 10697 raft_consensus.cc:2272] T b7b7f990da8c44099ccf21a815c4132c P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.356952 10697 tablet_replica.cc:333] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.357875 10697 raft_consensus.cc:2243] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.359266 10697 raft_consensus.cc:2272] T dcef81395f40461d98fa8200460db3ea P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.362715 10697 tablet_replica.cc:333] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.363523 10697 raft_consensus.cc:2243] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.364305 10697 raft_consensus.cc:2272] T 5be59d1d165244dfa1164fb844d3ecff P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.368566 10697 tablet_replica.cc:333] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.369648 10697 raft_consensus.cc:2243] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.371384 10697 raft_consensus.cc:2272] T 74d98dcf7da143dd90c25a48d77d05f6 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.375255 22828 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 12:14:47.376361 10697 tablet_replica.cc:333] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.377619 10697 raft_consensus.cc:2243] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.379974 10697 raft_consensus.cc:2272] T 74c86b130f4c4908b7c4426ecfcccb51 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.381932 22828 consensus_peers.cc:597] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.384730 10697 tablet_replica.cc:333] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.385949 10697 raft_consensus.cc:2243] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:47.385983 22902 consensus_peers.cc:597] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.386896 10697 raft_consensus.cc:2272] T 222905fa333c4fc3aa29a0b31fc170cf P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.391326 10697 tablet_replica.cc:333] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.392468 10697 raft_consensus.cc:2243] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.393431 10697 raft_consensus.cc:2272] T 7c23da28b775471cabe6b849c0229e5c P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.394448 22828 consensus_peers.cc:597] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.398088 10697 tablet_replica.cc:333] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.399323 10697 raft_consensus.cc:2243] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.401013 10697 raft_consensus.cc:2272] T bd286fa593a54e44ba0c7af9eb628bb4 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.405756 10697 tablet_replica.cc:333] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.406744 10697 raft_consensus.cc:2243] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.407793 10697 raft_consensus.cc:2272] T 9ea4039dfedc47f2b3189c8279d6efdd P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.412313 10697 tablet_replica.cc:333] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.413268 10697 raft_consensus.cc:2243] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.414103 10697 raft_consensus.cc:2272] T 8f9e39336cf94298b6800cd6bb7c8c39 P 5a0fdbf077294379970db4d8b22f74b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.418431 10697 tablet_replica.cc:333] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.419375 10697 raft_consensus.cc:2243] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.420231 10697 raft_consensus.cc:2272] T 9adf59b620814dd184bf594b18b063c6 P 5a0fdbf077294379970db4d8b22f74b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.424557 10697 tablet_replica.cc:333] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8: stopping tablet replica
I20260709 12:14:47.425477 10697 raft_consensus.cc:2243] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.426437 10697 raft_consensus.cc:2272] T c1ffca70b11f43b7af441db56ba64464 P 5a0fdbf077294379970db4d8b22f74b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.474424 22828 consensus_peers.cc:597] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.487433 22902 consensus_peers.cc:597] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.491868 10697 tablet_server.cc:196] TabletServer@127.10.114.65:0 shutdown complete.
W20260709 12:14:47.527942 22828 consensus_peers.cc:597] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.553499 22902 consensus_peers.cc:597] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.573844 10697 tablet_server.cc:179] TabletServer@127.10.114.66:0 shutting down...
W20260709 12:14:47.582917 22828 consensus_peers.cc:597] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.608937 22828 consensus_peers.cc:597] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.621889 22902 consensus_peers.cc:597] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 -> Peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Couldn't send request to peer 1d6712191714461bb98713ea89b05425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.623998 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:47.624951 10697 tablet_replica.cc:333] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.626307 10697 raft_consensus.cc:2243] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.627323 10697 raft_consensus.cc:2272] T f82574060263464baab9dad1d23232f8 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.631461 10697 tablet_replica.cc:333] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.632253 10697 raft_consensus.cc:2243] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.633332 10697 raft_consensus.cc:2272] T 8002f41aaf7f436abfa8b9095a09ebf1 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.636085 10697 tablet_replica.cc:333] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.636857 10697 raft_consensus.cc:2243] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.637499 10697 raft_consensus.cc:2272] T bd286fa593a54e44ba0c7af9eb628bb4 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.640498 10697 tablet_replica.cc:333] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.641182 10697 raft_consensus.cc:2243] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.642385 10697 raft_consensus.cc:2272] T bda7181f54764982b462aaab78ba1917 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.645594 10697 tablet_replica.cc:333] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.646258 10697 raft_consensus.cc:2243] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.647375 10697 raft_consensus.cc:2272] T 88796f34c90e411093004e363d11d6e9 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.650409 10697 tablet_replica.cc:333] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.651281 10697 raft_consensus.cc:2243] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.651926 10697 raft_consensus.cc:2272] T b7b7f990da8c44099ccf21a815c4132c P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.654917 10697 tablet_replica.cc:333] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.655644 10697 raft_consensus.cc:2243] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.656260 10697 raft_consensus.cc:2272] T b010ba4af92d48af888fa9925c8ee367 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.659179 10697 tablet_replica.cc:333] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.659835 10697 raft_consensus.cc:2243] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.660946 10697 raft_consensus.cc:2272] T c1ffca70b11f43b7af441db56ba64464 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.663862 10697 tablet_replica.cc:333] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.664631 10697 raft_consensus.cc:2243] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.665710 10697 raft_consensus.cc:2272] T 9ea4039dfedc47f2b3189c8279d6efdd P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.668619 10697 tablet_replica.cc:333] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.669307 10697 raft_consensus.cc:2243] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.669975 10697 raft_consensus.cc:2272] T 8f9e39336cf94298b6800cd6bb7c8c39 P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.673244 10697 tablet_replica.cc:333] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.674160 10697 raft_consensus.cc:2243] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.675416 10697 raft_consensus.cc:2272] T 9adf59b620814dd184bf594b18b063c6 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.678452 10697 tablet_replica.cc:333] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.679160 10697 raft_consensus.cc:2243] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.679952 10697 raft_consensus.cc:2272] T 81f75985bac34212af112a33371315ae P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.683224 10697 tablet_replica.cc:333] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.683954 10697 raft_consensus.cc:2243] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.684527 10697 raft_consensus.cc:2272] T 74c86b130f4c4908b7c4426ecfcccb51 P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.687777 10697 tablet_replica.cc:333] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.688391 10697 raft_consensus.cc:2243] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.689648 10697 raft_consensus.cc:2272] T 7c23da28b775471cabe6b849c0229e5c P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.692772 10697 tablet_replica.cc:333] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.693356 10697 raft_consensus.cc:2243] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.693965 10697 raft_consensus.cc:2272] T 222905fa333c4fc3aa29a0b31fc170cf P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.696777 10697 tablet_replica.cc:333] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.697386 10697 raft_consensus.cc:2243] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.698007 10697 raft_consensus.cc:2272] T 74d98dcf7da143dd90c25a48d77d05f6 P 1d6712191714461bb98713ea89b05425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.701081 10697 tablet_replica.cc:333] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.701712 10697 raft_consensus.cc:2243] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.702298 10697 raft_consensus.cc:2272] T 5be59d1d165244dfa1164fb844d3ecff P 1d6712191714461bb98713ea89b05425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.705214 10697 tablet_replica.cc:333] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425: stopping tablet replica
I20260709 12:14:47.705796 10697 raft_consensus.cc:2243] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.706328 10697 raft_consensus.cc:2272] T dcef81395f40461d98fa8200460db3ea P 1d6712191714461bb98713ea89b05425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.717902 22902 consensus_peers.cc:597] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 -> Peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Couldn't send request to peer 1d6712191714461bb98713ea89b05425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.808938 22902 consensus_peers.cc:597] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 -> Peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Couldn't send request to peer 5a0fdbf077294379970db4d8b22f74b8. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.964927 22902 consensus_peers.cc:597] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 -> Peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Couldn't send request to peer 1d6712191714461bb98713ea89b05425. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:48.040000 22902 consensus_peers.cc:597] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 -> Peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Couldn't send request to peer 1d6712191714461bb98713ea89b05425. Status: Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:48.530557 23307 raft_consensus.cc:493] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.531345 23307 raft_consensus.cc:515] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.533991 23307 leader_election.cc:290] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.542649 22902 leader_election.cc:336] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.543567 22902 leader_election.cc:336] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.544143 22902 leader_election.cc:304] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.544190 23307 raft_consensus.cc:493] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.545143 23313 raft_consensus.cc:2749] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.545034 23307 raft_consensus.cc:515] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.546099 23314 raft_consensus.cc:493] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.546839 23314 raft_consensus.cc:515] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.547776 23307 leader_election.cc:290] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
I20260709 12:14:48.549649 23314 leader_election.cc:290] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.552914 22902 leader_election.cc:336] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.557623 22902 leader_election.cc:336] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.557875 23314 raft_consensus.cc:493] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.559036 23314 raft_consensus.cc:515] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.558240 22902 leader_election.cc:304] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.560763 23313 raft_consensus.cc:2749] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:48.561887 22902 leader_election.cc:336] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.562463 23314 leader_election.cc:290] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.562726 22902 leader_election.cc:336] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
I20260709 12:14:48.563282 22902 leader_election.cc:304] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.564687 23307 raft_consensus.cc:493] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.565502 23307 raft_consensus.cc:515] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.566326 23313 raft_consensus.cc:2749] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.570825 23307 leader_election.cc:290] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935), 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103)
W20260709 12:14:48.580168 22902 leader_election.cc:336] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.580893 22902 leader_election.cc:336] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.581501 22902 leader_election.cc:336] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.581935 22902 leader_election.cc:304] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.582756 23316 raft_consensus.cc:2749] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:48.582772 22902 leader_election.cc:336] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.583406 22902 leader_election.cc:304] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.584276 23316 raft_consensus.cc:2749] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:48.760197 10697 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22884)
I20260709 12:14:48.813582 23316 raft_consensus.cc:493] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.814432 23316 raft_consensus.cc:515] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.816625 23316 leader_election.cc:290] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.821152 22902 leader_election.cc:336] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.821969 22902 leader_election.cc:336] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.822395 22902 leader_election.cc:304] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.823232 23316 raft_consensus.cc:2749] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.826442 23316 raft_consensus.cc:493] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5a0fdbf077294379970db4d8b22f74b8)
I20260709 12:14:48.827069 23316 raft_consensus.cc:515] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.829523 23316 leader_election.cc:290] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.834074 22902 leader_election.cc:336] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.834913 22902 leader_election.cc:336] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.835278 22902 leader_election.cc:304] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.835947 23316 raft_consensus.cc:2749] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:48.853876 23316 raft_consensus.cc:493] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:48.854588 23316 raft_consensus.cc:515] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.857610 23316 leader_election.cc:290] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.861840 22902 leader_election.cc:336] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.862555 22902 leader_election.cc:336] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.862907 22902 leader_election.cc:304] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.863564 23316 raft_consensus.cc:2749] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.927385 23316 raft_consensus.cc:493] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:48.928145 23316 raft_consensus.cc:515] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.930873 23316 leader_election.cc:290] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.936139 22902 leader_election.cc:336] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.936946 22902 leader_election.cc:336] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.937364 22902 leader_election.cc:304] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.938185 23316 raft_consensus.cc:2749] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.945508 23316 raft_consensus.cc:493] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:48.946136 23316 raft_consensus.cc:515] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:48.948302 23316 leader_election.cc:290] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:48.952438 22902 leader_election.cc:336] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:48.953225 22902 leader_election.cc:336] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:48.953644 22902 leader_election.cc:304] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:48.954548 23316 raft_consensus.cc:2749] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:49.034004 23316 raft_consensus.cc:493] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:49.034687 23316 raft_consensus.cc:515] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:49.036895 23316 leader_election.cc:290] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:49.042577 22902 leader_election.cc:336] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:49.043488 22902 leader_election.cc:336] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:49.043854 23316 raft_consensus.cc:493] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:49.043996 22902 leader_election.cc:304] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:49.044716 23316 raft_consensus.cc:515] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:49.044997 23307 raft_consensus.cc:2749] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:49.047211 23316 leader_election.cc:290] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:49.054965 22902 leader_election.cc:336] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:49.055830 22902 leader_election.cc:336] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:49.056262 22902 leader_election.cc:304] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:49.057078 23316 raft_consensus.cc:2749] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:49.067224 23316 raft_consensus.cc:493] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:49.067867 23316 raft_consensus.cc:515] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:49.070581 23316 leader_election.cc:290] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:49.074715 22902 leader_election.cc:336] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:49.075459 22902 leader_election.cc:336] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:49.075863 22902 leader_election.cc:304] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:49.076658 23316 raft_consensus.cc:2749] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:49.130214 23316 raft_consensus.cc:493] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d6712191714461bb98713ea89b05425)
I20260709 12:14:49.130930 23316 raft_consensus.cc:515] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a0fdbf077294379970db4d8b22f74b8" member_type: VOTER last_known_addr { host: "127.10.114.65" port: 38103 } } peers { permanent_uuid: "1d6712191714461bb98713ea89b05425" member_type: VOTER last_known_addr { host: "127.10.114.66" port: 37935 } } peers { permanent_uuid: "4b9317ffa3014610919433e0f17a80c0" member_type: VOTER last_known_addr { host: "127.10.114.67" port: 45191 } }
I20260709 12:14:49.132893 23316 leader_election.cc:290] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103), 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935)
W20260709 12:14:49.137317 22902 leader_election.cc:336] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5a0fdbf077294379970db4d8b22f74b8 (127.10.114.65:38103): Network error: Client connection negotiation failed: client connection to 127.10.114.65:38103: connect: Connection refused (error 111)
W20260709 12:14:49.138164 22902 leader_election.cc:336] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d6712191714461bb98713ea89b05425 (127.10.114.66:37935): Network error: Client connection negotiation failed: client connection to 127.10.114.66:37935: connect: Connection refused (error 111)
I20260709 12:14:49.138615 22902 leader_election.cc:304] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b9317ffa3014610919433e0f17a80c0; no voters: 1d6712191714461bb98713ea89b05425, 5a0fdbf077294379970db4d8b22f74b8
I20260709 12:14:49.140558 23316 raft_consensus.cc:2749] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:49.472949 10697 tablet_server.cc:196] TabletServer@127.10.114.66:0 shutdown complete.
I20260709 12:14:49.521560 10697 tablet_server.cc:179] TabletServer@127.10.114.67:0 shutting down...
I20260709 12:14:49.558139 10697 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:49.559098 10697 tablet_replica.cc:333] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.560384 10697 raft_consensus.cc:2243] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.561203 10697 raft_consensus.cc:2272] T 8002f41aaf7f436abfa8b9095a09ebf1 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.563925 10697 tablet_replica.cc:333] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.564574 10697 raft_consensus.cc:2243] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.565644 10697 raft_consensus.cc:2272] T f82574060263464baab9dad1d23232f8 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.568126 10697 tablet_replica.cc:333] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.568733 10697 raft_consensus.cc:2243] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.569247 10697 raft_consensus.cc:2272] T b010ba4af92d48af888fa9925c8ee367 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.571719 10697 tablet_replica.cc:333] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.572301 10697 raft_consensus.cc:2243] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.572806 10697 raft_consensus.cc:2272] T 88796f34c90e411093004e363d11d6e9 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.575294 10697 tablet_replica.cc:333] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.575946 10697 raft_consensus.cc:2243] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.576499 10697 raft_consensus.cc:2272] T b7b7f990da8c44099ccf21a815c4132c P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.579063 10697 tablet_replica.cc:333] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.579759 10697 raft_consensus.cc:2243] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.580325 10697 raft_consensus.cc:2272] T bda7181f54764982b462aaab78ba1917 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.582698 10697 tablet_replica.cc:333] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.583320 10697 raft_consensus.cc:2243] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.583804 10697 raft_consensus.cc:2272] T dcef81395f40461d98fa8200460db3ea P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.586229 10697 tablet_replica.cc:333] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.586956 10697 raft_consensus.cc:2243] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.587954 10697 raft_consensus.cc:2272] T 5be59d1d165244dfa1164fb844d3ecff P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.591068 10697 tablet_replica.cc:333] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.591670 10697 raft_consensus.cc:2243] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.592264 10697 raft_consensus.cc:2272] T 74d98dcf7da143dd90c25a48d77d05f6 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.594587 10697 tablet_replica.cc:333] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.595105 10697 raft_consensus.cc:2243] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.595587 10697 raft_consensus.cc:2272] T bd286fa593a54e44ba0c7af9eb628bb4 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.597913 10697 tablet_replica.cc:333] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.598474 10697 raft_consensus.cc:2243] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.598887 10697 raft_consensus.cc:2272] T 9adf59b620814dd184bf594b18b063c6 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.601097 10697 tablet_replica.cc:333] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.601611 10697 raft_consensus.cc:2243] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.602108 10697 raft_consensus.cc:2272] T 9ea4039dfedc47f2b3189c8279d6efdd P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.604347 10697 tablet_replica.cc:333] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.604889 10697 raft_consensus.cc:2243] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.605787 10697 raft_consensus.cc:2272] T 8f9e39336cf94298b6800cd6bb7c8c39 P 4b9317ffa3014610919433e0f17a80c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.608227 10697 tablet_replica.cc:333] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.608764 10697 raft_consensus.cc:2243] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.609239 10697 raft_consensus.cc:2272] T c1ffca70b11f43b7af441db56ba64464 P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.611677 10697 tablet_replica.cc:333] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.612210 10697 raft_consensus.cc:2243] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.612742 10697 raft_consensus.cc:2272] T 81f75985bac34212af112a33371315ae P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.615263 10697 tablet_replica.cc:333] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.615763 10697 raft_consensus.cc:2243] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.616639 10697 raft_consensus.cc:2272] T 222905fa333c4fc3aa29a0b31fc170cf P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.619096 10697 tablet_replica.cc:333] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.619583 10697 raft_consensus.cc:2243] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.620033 10697 raft_consensus.cc:2272] T 7c23da28b775471cabe6b849c0229e5c P 4b9317ffa3014610919433e0f17a80c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.622733 10697 tablet_replica.cc:333] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0: stopping tablet replica
I20260709 12:14:49.623265 10697 raft_consensus.cc:2243] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.623811 10697 raft_consensus.cc:2272] T 74c86b130f4c4908b7c4426ecfcccb51 P 4b9317ffa3014610919433e0f17a80c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.693420 10697 tablet_server.cc:196] TabletServer@127.10.114.67:0 shutdown complete.
I20260709 12:14:49.738101 10697 master.cc:562] Master@127.10.114.126:45595 shutting down...
I20260709 12:14:49.770684 10697 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.771394 10697 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.771697 10697 tablet_replica.cc:333] T 00000000000000000000000000000000 P a22d8ac9603a4176ab2e7963df24f9b6: stopping tablet replica
I20260709 12:14:49.814164 10697 master.cc:584] Master@127.10.114.126:45595 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (24217 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45835 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (395657 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:14:49.881161 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2313 messages since previous log ~35 seconds ago
I20260709 12:14:49.881405 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2313 messages since previous log ~35 seconds ago
I20260709 12:14:49.881628 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2311 messages since previous log ~35 seconds ago
I20260709 12:14:49.881814 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:49.881969 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:49.882145 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~179 seconds ago
I20260709 12:14:49.882299 10697 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~232 seconds ago
I20260709 12:14:49.882452 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~232 seconds ago
I20260709 12:14:49.882678 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 66 messages since previous log ~2 seconds ago
I20260709 12:14:49.882840 10697 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~23 seconds ago
